-- Logs begin at Tue 2022-09-13 00:39:24 UTC, end at Tue 2022-09-13 01:41:02 UTC. -- Sep 13 01:04:17.150191 dv-cinder-856941-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 13 01:04:17.157997 dv-cinder-856941-3-smb devstack@keystone.service[81453]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 13 01:04:17.161345 dv-cinder-856941-3-smb devstack@keystone.service[81453]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 01:04:17 2022] *** Sep 13 01:04:17.161345 dv-cinder-856941-3-smb devstack@keystone.service[81453]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 01:04:17.161345 dv-cinder-856941-3-smb devstack@keystone.service[81453]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 01:04:17.161345 dv-cinder-856941-3-smb devstack@keystone.service[81453]: nodename: dv-cinder-856941-3-smb Sep 13 01:04:17.161345 dv-cinder-856941-3-smb devstack@keystone.service[81453]: machine: x86_64 Sep 13 01:04:17.161345 dv-cinder-856941-3-smb devstack@keystone.service[81453]: clock source: unix Sep 13 01:04:17.161345 dv-cinder-856941-3-smb devstack@keystone.service[81453]: pcre jit disabled Sep 13 01:04:17.161345 dv-cinder-856941-3-smb devstack@keystone.service[81453]: detected number of CPU cores: 4 Sep 13 01:04:17.161345 dv-cinder-856941-3-smb devstack@keystone.service[81453]: current working directory: / Sep 13 01:04:17.161345 dv-cinder-856941-3-smb devstack@keystone.service[81453]: detected binary path: /usr/bin/uwsgi-core Sep 13 01:04:17.161345 dv-cinder-856941-3-smb devstack@keystone.service[81453]: your processes number limit is 47680 Sep 13 01:04:17.161345 dv-cinder-856941-3-smb devstack@keystone.service[81453]: your memory page size is 4096 bytes Sep 13 01:04:17.161345 dv-cinder-856941-3-smb devstack@keystone.service[81453]: detected max file descriptor number: 2048 Sep 13 01:04:17.161345 dv-cinder-856941-3-smb devstack@keystone.service[81453]: lock engine: pthread robust mutexes Sep 13 01:04:17.161345 dv-cinder-856941-3-smb devstack@keystone.service[81453]: thunder lock: enabled Sep 13 01:04:17.162117 dv-cinder-856941-3-smb devstack@keystone.service[81453]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 13 01:04:17.162117 dv-cinder-856941-3-smb devstack@keystone.service[81453]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 01:04:17.201020 dv-cinder-856941-3-smb devstack@keystone.service[81453]: Python main interpreter initialized at 0x55f54d3a99c0 Sep 13 01:04:17.201020 dv-cinder-856941-3-smb devstack@keystone.service[81453]: python threads support enabled Sep 13 01:04:17.201020 dv-cinder-856941-3-smb devstack@keystone.service[81453]: your server socket listen backlog is limited to 100 connections Sep 13 01:04:17.201020 dv-cinder-856941-3-smb devstack@keystone.service[81453]: your mercy for graceful operations on workers is 90 seconds Sep 13 01:04:17.201398 dv-cinder-856941-3-smb devstack@keystone.service[81453]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 01:04:17.201479 dv-cinder-856941-3-smb devstack@keystone.service[81453]: *** Operational MODE: preforking *** Sep 13 01:04:17.201712 dv-cinder-856941-3-smb devstack@keystone.service[81453]: *** uWSGI is running in multiple interpreter mode *** Sep 13 01:04:17.201712 dv-cinder-856941-3-smb devstack@keystone.service[81453]: spawned uWSGI master process (pid: 81453) Sep 13 01:04:17.201918 dv-cinder-856941-3-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 13 01:04:17.202824 dv-cinder-856941-3-smb devstack@keystone.service[81453]: spawned uWSGI worker 1 (pid: 81466, cores: 1) Sep 13 01:04:17.202824 dv-cinder-856941-3-smb devstack@keystone.service[81453]: spawned uWSGI worker 2 (pid: 81467, cores: 1) Sep 13 01:04:17.202973 dv-cinder-856941-3-smb devstack@keystone.service[81453]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 01:04:21.498549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 01:04:21.498549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: from cryptography.utils import int_from_bytes Sep 13 01:04:21.499325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 01:04:21.499325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: from cryptography.utils import int_from_bytes Sep 13 01:04:21.499325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 01:04:21.499325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: from cryptography.utils import int_from_bytes Sep 13 01:04:21.499883 dv-cinder-856941-3-smb devstack@keystone.service[81467]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 01:04:21.499883 dv-cinder-856941-3-smb devstack@keystone.service[81467]: from cryptography.utils import int_from_bytes Sep 13 01:04:21.549074 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 01:04:21.549251 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 01:04:21.549395 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 01:04:21.549494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] command line args: [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 01:04:21.549595 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 01:04:21.549681 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 01:04:21.549789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] command line args: [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 01:04:21.549874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ================================================================================ {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 01:04:21.550064 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 01:04:21.550149 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] admin_token = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.550226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ================================================================================ {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 01:04:21.550334 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] config_dir = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.550485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] admin_token = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.550574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.550696 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] config_source = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.550821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] config_dir = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.550890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] debug = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.550962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.551098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.552306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] config_source = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.552306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] debug = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.552437 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.552508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.552593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.552653 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.552714 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.552777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.552843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.552907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.552965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553026 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553083 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_config_append = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] list_limit = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553212 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] log_config_append = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_dir = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553380 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_file = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] log_dir = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] log_file = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553690 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553807 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.553990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.554046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.554134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.554237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.554311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.554432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.554533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.554693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.554786 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.554911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.554999 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.555165 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.555241 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.555401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.555481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.555647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.555754 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.555866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.555965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.556108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.556209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.556348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.556429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.556626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.556857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.557689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.557788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] publish_errors = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.557862 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] publish_errors = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.557921 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.558084 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.558210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.558315 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.558410 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.558516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.558663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.558765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.558901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.559013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.559160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] standard_threads = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.559239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] standard_threads = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.559396 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.559475 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.559641 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.559734 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.559804 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.559873 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.559990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] use_journal = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.560071 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] use_journal = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.560142 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] use_json = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.560212 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] use_json = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.560310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] use_stderr = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.560402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] use_stderr = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.560482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] use_syslog = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.560559 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] use_syslog = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.560701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.560778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:04:21.560955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.561038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.561191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.561269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.561450 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.561533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.561688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.561771 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.561935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.562013 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.562172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.562248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.562418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.562494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.562652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.562730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.562898 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.562974 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.563168 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.563251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.563417 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.563496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.563649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.563781 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.563894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.563971 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.564126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.564210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.564368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.564445 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.564611 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.564688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.564845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.564926 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.565098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.565174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.565349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.565507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.565587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.565659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.565814 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.565898 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.566065 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.566153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.566324 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.566400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.566573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.566649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.566819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.566907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.567048 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.567198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.567304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.567381 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.567533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.567617 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.567768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.567849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.568016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.568099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.568260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.568348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.568489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.568565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.568717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.568800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.568962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.569046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.569209 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.569286 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.569447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.569523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.569693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.569777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.569923 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.569999 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.570156 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.570232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.570388 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.570472 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.570618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.570693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.570844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.570919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.571118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.571283 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.571360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.571429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.571548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.571627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.571793 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.571877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.572021 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.572094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.572258 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.572357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.572485 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.572572 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.572765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.572848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.572992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.573067 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.573241 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.573326 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.573472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.573547 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.573708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.573782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.573941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.574023 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.574174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.574249 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.574536 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.574635 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.574704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.574764 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.574882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.574959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.575119 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.575211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.575357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.575436 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.575591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.575682 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.575822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.575916 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.576080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.576167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.576315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.576400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.576544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.576619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.576778 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.576852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.577013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.577097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.577278 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.577360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.577512 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.577631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.577759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.577835 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.578000 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.578335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.578491 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.578574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.578724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.578807 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.578954 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.579026 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.579227 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.579311 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.579463 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.579537 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.579700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.579816 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.579940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.580025 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.580176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.580254 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.580425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.580535 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.580657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.580738 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.580892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.580979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.581124 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.581201 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.581357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.581439 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.581589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.581678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.581851 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.581974 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.582089 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.582167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.582335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.582421 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.582572 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.582650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.582809 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.582893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.583046 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.583143 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.583298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.583377 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.583531 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.583625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.583764 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.583851 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.583992 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.584070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.584221 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.584299 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.584448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.584532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.584681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.584759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.584911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.584989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.585149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.585236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.585382 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.585458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.585627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.585704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.585860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.585946 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.586115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.586205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.586372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.586450 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.586611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.586719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.586842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] auth.external = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.586930 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.external = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.587104 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.587188 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.587390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.587481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.587621 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.587707 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.587852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.password = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.587930 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] auth.password = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.588081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] auth.token = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.588219 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.token = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.588354 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.588489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.588600 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.588678 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.588805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.588885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.589035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.589122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.589280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.589359 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.589530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.589615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.589760 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.589847 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.589994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.590073 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] credential.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.590239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.590317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.590486 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.590576 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.590731 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.590810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.590972 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.591051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.591241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.591338 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.591476 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.591554 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.591705 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.591783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.591964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.592051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.592201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.592281 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.592454 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.592531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.592735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.592822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.592979 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.593061 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.593237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.593394 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.593490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.593574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.593721 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.593801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.593953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.594070 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.594190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.594281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.594432 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.594511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.594677 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.594755 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.594905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.594985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.595175 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.595260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.595412 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.595491 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.595669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.595760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.595905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.595985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.596161 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.596241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.596398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.596477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.596643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.596721 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.596880 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.596958 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.597109 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.597184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.597360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.597439 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.597593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.597671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.597826 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.597906 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.598071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.598157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.598300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.598378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.598534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.598614 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.598781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.598859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.599028 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.599120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.599285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.599366 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.599516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.599595 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.599745 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.599823 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.599986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.600065 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.600231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.600309 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.600475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.600557 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.600727 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.600807 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.600970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.601048 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.601237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.601315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.601471 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.601552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.601706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.601784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.601935 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.602013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.602169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.602249 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.602398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.602476 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.602631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.602708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.602870 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.602949 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.603129 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.603213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.603378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.603457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.603609 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.603689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.604385 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.604477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.604682 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.604767 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.604926 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.605036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.605172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.605253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.605420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.605509 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.605653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.605730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.605891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.605969 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.606120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.606205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.606357 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.606434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.606592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.606669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.606831 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.606915 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.607088 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.607167 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.607441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.607518 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.607696 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.607782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.607946 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.608024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.608179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.608256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.608411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.608496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.608659 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.608736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.608907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.608983 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.609142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.609232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.609379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.609457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.609612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.609688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.609845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.609931 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.610087 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.610164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.610343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.610419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.610575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.610659 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.610821 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.610897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.611085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.611166 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.611339 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.611426 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.611573 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.611650 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.611803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.611879 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.612037 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.612122 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.612272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.612348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.612506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.612582 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.612735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.612821 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.612996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.613074 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.613224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.613301 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.613468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.613552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.613714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.613790 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.613957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.614039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.614185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.614269 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.614429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.614504 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.614664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.614740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.614898 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.614982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.615157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.615245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.615393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.615469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.615637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.615726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.615883 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.615960 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.616119 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.616194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.616373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.616459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.616603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.616679 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.616845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.616920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.617081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.617166 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.617316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.617392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.617549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.617631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.617795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.617879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.618037 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.618113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.618266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.618342 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.618500 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.618585 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.618740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.618816 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.618987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.619075 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.619260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.619347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.620048 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.620138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.620312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.620390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.620567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.620664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.620802 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.620890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.621046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.621127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.621271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.621345 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.621511 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.621588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.621743 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] role.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.621819 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] role.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.621991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] role.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.622069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] role.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.622225 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.622331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.622470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.622551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.622715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.622797 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.622961 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.623039 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.623232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.623316 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.623481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.623562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.623727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.623806 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.623973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.624051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.624218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.624298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.624452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.624530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.624695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.624774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.624941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.625021 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.625185 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.625263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.625430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.625509 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.625826 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.625907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.626065 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.626144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.626315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.626393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.626564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.626643 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.626812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.626890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.627060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.627170 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.627317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.627395 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.627569 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.627650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.627822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.627908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.628060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.628139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.628289 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.628368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.628521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.628607 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.628750 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.628828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.629002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.629080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.629257 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.629343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.629504 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.629582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.629741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.629818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.629975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.630062 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.630207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.630285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.630442 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.630520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.630678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.630764 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.630926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.631004 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.631185 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.631266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.631442 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.631533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.631687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.631765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.631924 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.632002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.632165 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.632253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.632407 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.632485 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.632652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.632729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.632886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.632972 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.633126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.633204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.633358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.633441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.633603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.633689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.633873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.633952 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.634104 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.634191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.634345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.634438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.634608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.634687 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.634867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.connection = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.634946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.connection = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.635176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.635307 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.635426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.635506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.635659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.635741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.635902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.635982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.636140 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.636220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.636379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.636459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.636615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.636692 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.636850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.636928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.637095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.637176 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.637333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.637411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.637576 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.637654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.637811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.637891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.638058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.638137 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.638293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.638371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.638536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.638615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.638766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.638844 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.639005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.639098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.639267 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.639349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:04:21.639422 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 01:04:21.639494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 01:04:21.669166 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.669372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.669460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.669608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.669692 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.669846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.678064 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.678225 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.706929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.707197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.707310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.707543 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.760820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.761126 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.809788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.810015 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.810101 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.810291 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.965889 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.966061 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.966253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.966341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.966476 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.966562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.966697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.966781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.966914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.967007 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.967222 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.967443 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.989678 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.989913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.990002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.990144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.990230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.990369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.990451 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.990589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.990681 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.990809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.990890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.991024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.991128 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:21.991289 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.002662 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.003194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.016125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.016286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.016369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.016524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.016605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.016752 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.016833 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.016981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.017081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.017195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.017275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.017381 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.017463 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.017605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 01:04:22.034060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.034271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 01:04:22.034437 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.034614 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.034695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 01:04:22.034816 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 01:04:22.034981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.035115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.035199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 01:04:22.035386 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.035481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.035652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.035731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.035913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.035992 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.036207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.045592 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.045749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.045898 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.046034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.046140 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.046314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.046428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.046602 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.053392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.053567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.056306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.056486 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.056596 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.056773 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.057415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.057707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.057802 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.057994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.058073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.058260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.058392 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.058524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.058649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.058789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.058914 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.059057 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.059221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.059346 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.059469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.059617 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.059741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.059908 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.082766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.083027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.084248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.084504 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.084629 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.084792 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.089196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.089485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.089611 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.089769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.089910 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.090083 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.096094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.096385 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.096510 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.096671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.101977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.102250 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.102377 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.102553 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.102678 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.102841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.102966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.103233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.103370 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.103493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.103626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.103769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.103893 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.104019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.104146 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.104436 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.119887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.120171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.120454 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.120737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.124199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.124586 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.127455 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.127757 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.127881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.128145 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.131953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.132350 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.135640 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.136136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.138873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.139201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.139377 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.139495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.139682 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.139768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.139973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.140058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.140262 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.140345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.140540 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.140829 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.155892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.156201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.156460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.156546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.156733 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.156830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.157060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.157327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.163467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.164150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.164978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.165685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.166609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.166892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.167261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.167543 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.169644 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.169931 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.170222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.170305 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.170507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.170597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.170839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.170920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.171152 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.171551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.182544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.182834 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.183143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.183272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.183431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.183563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.183815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.183896 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.184115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.184195 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.184404 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.184507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.184803 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.185093 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.199847 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.200539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.202740 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.203717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.205906 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.206582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.207384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.208042 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.208853 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.209140 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.209500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.209582 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.209787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.210186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.215996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.216564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.217416 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.218014 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.220308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.220708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.220913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.220995 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.221269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.221364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.221590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.221872 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.229617 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.229907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.230157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.230243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.230453 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.230739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.237046 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.237333 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.237582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 01:04:22.237666 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.237871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.237954 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.238145 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.238243 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.238423 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.238506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.238700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.238860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.239005 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.239208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.239355 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.239490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.239630 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.239762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.239891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.240019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.240145 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.240327 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.240459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.240588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.240715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.240845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.240973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.241109 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 01:04:22.274769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f54d3a99c0 pid: 81467 (default app) Sep 13 01:04:22.275585 dv-cinder-856941-3-smb devstack@keystone.service[81466]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f54d3a99c0 pid: 81466 (default app) Sep 13 01:04:22.278229 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40d86e-e4c7-4950-b36c-29b7165c25a0 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:22.278513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40d86e-e4c7-4950-b36c-29b7165c25a0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:22.278788 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40d86e-e4c7-4950-b36c-29b7165c25a0 None None] PATH_INFO: `/v3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:22.282890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Tue Sep 13 01:04:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:29.113137 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83ddb2-0f98-4f30-8aa0-a597b68fc80c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:29.113680 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83ddb2-0f98-4f30-8aa0-a597b68fc80c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:29.113680 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83ddb2-0f98-4f30-8aa0-a597b68fc80c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:29.117966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:04:29.123762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2056d-8e7d-4580-901b-b7d527a7e5a2 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:29.124246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2056d-8e7d-4580-901b-b7d527a7e5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:29.124345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2056d-8e7d-4580-901b-b7d527a7e5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:29.195164 dv-cinder-856941-3-smb devstack@keystone.service[81467]: INFO dbcounter [None req-55a2056d-8e7d-4580-901b-b7d527a7e5a2 None None] Registered counter for database keystone Sep 13 01:04:29.214303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG oslo_db.sqlalchemy.engines [None req-55a2056d-8e7d-4580-901b-b7d527a7e5a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:04:29.220410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writer thread running {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:04:29.413448 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG passlib.handlers.bcrypt [None req-55a2056d-8e7d-4580-901b-b7d527a7e5a2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81467) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 01:04:29.413761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG passlib.handlers.bcrypt [None req-55a2056d-8e7d-4580-901b-b7d527a7e5a2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81467) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 01:04:29.473210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-55a2056d-8e7d-4580-901b-b7d527a7e5a2 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:29.474831 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-55a2056d-8e7d-4580-901b-b7d527a7e5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:29.602736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 01:04:29.895886 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83ddb2-0f98-4f30-8aa0-a597b68fc80c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:29.964448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: INFO dbcounter [None req-dd83ddb2-0f98-4f30-8aa0-a597b68fc80c None None] Registered counter for database keystone Sep 13 01:04:29.985911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG oslo_db.sqlalchemy.engines [None req-dd83ddb2-0f98-4f30-8aa0-a597b68fc80c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:04:29.992016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writer thread running {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:04:30.113535 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83ddb2-0f98-4f30-8aa0-a597b68fc80c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:30.117807 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69accaf6-8223-4ed0-8405-8643587599b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:30.118431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69accaf6-8223-4ed0-8405-8643587599b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:30.118729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69accaf6-8223-4ed0-8405-8643587599b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:30.119157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69accaf6-8223-4ed0-8405-8643587599b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:30.127385 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69accaf6-8223-4ed0-8405-8643587599b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:30.179431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: WARNING keystone.common.rbac_enforcer.enforcer [None req-69accaf6-8223-4ed0-8405-8643587599b8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 01:04:30.179712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69accaf6-8223-4ed0-8405-8643587599b8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:30.189808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Sep 13 01:04:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 01:04:30.195753 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2056d-8e7d-4580-901b-b7d527a7e5a2 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:30.213523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2056d-8e7d-4580-901b-b7d527a7e5a2 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:30.217948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7501c-4a30-433e-a4e9-b95b3f828699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:30.219058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7501c-4a30-433e-a4e9-b95b3f828699 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:30.219375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7501c-4a30-433e-a4e9-b95b3f828699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:30.219657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7501c-4a30-433e-a4e9-b95b3f828699 admin admin] PATH_INFO: `/v3/projects/fd4174dd77554b79ab1278edaa747365` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:30.221240 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7501c-4a30-433e-a4e9-b95b3f828699 admin admin] RBAC: Authorizing `identity:get_project(project_id=fd4174dd77554b79ab1278edaa747365)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:30.273839 dv-cinder-856941-3-smb devstack@keystone.service[81467]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9df7501c-4a30-433e-a4e9-b95b3f828699 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 01:04:30.274182 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7501c-4a30-433e-a4e9-b95b3f828699 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:30.278704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Tue Sep 13 01:04:30 2022] GET /identity/v3/projects/fd4174dd77554b79ab1278edaa747365 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:32.390190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef6bf8-fa70-4ec8-b772-71b36358506d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:32.390739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef6bf8-fa70-4ec8-b772-71b36358506d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:32.390739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef6bf8-fa70-4ec8-b772-71b36358506d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:32.394815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:04:32.400440 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97815197-0c33-4dea-9f12-125507ce9fd0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:32.400845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97815197-0c33-4dea-9f12-125507ce9fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:32.401248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97815197-0c33-4dea-9f12-125507ce9fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:32.421462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-97815197-0c33-4dea-9f12-125507ce9fd0 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:32.422965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-97815197-0c33-4dea-9f12-125507ce9fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:32.430782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 01:04:32.705318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef6bf8-fa70-4ec8-b772-71b36358506d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:32.717539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef6bf8-fa70-4ec8-b772-71b36358506d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:32.721746 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539d1d7-5ab6-49ab-b638-f5d343041ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:32.722345 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539d1d7-5ab6-49ab-b638-f5d343041ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:32.722632 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539d1d7-5ab6-49ab-b638-f5d343041ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:32.722909 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539d1d7-5ab6-49ab-b638-f5d343041ef6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:32.731189 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539d1d7-5ab6-49ab-b638-f5d343041ef6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:32.735329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539d1d7-5ab6-49ab-b638-f5d343041ef6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:32.749014 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Sep 13 01:04:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 01:04:32.754235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97815197-0c33-4dea-9f12-125507ce9fd0 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:32.763294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97815197-0c33-4dea-9f12-125507ce9fd0 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:32.767574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beb3b1-65f6-4a19-b622-adbd3b94d6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:32.768190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beb3b1-65f6-4a19-b622-adbd3b94d6df admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:32.768465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beb3b1-65f6-4a19-b622-adbd3b94d6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:32.768762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beb3b1-65f6-4a19-b622-adbd3b94d6df admin admin] PATH_INFO: `/v3/users/5c63bf57b4e7408d9fa4e45538832485` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:32.770050 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49beb3b1-65f6-4a19-b622-adbd3b94d6df admin admin] RBAC: Authorizing `identity:get_user(user_id=5c63bf57b4e7408d9fa4e45538832485)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:32.771897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49beb3b1-65f6-4a19-b622-adbd3b94d6df admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:32.773396 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Tue Sep 13 01:04:32 2022] GET /identity/v3/users/5c63bf57b4e7408d9fa4e45538832485 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:35.002545 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774e3a9-ebfa-4e84-b7ee-b83fdf34ff4d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:35.003121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774e3a9-ebfa-4e84-b7ee-b83fdf34ff4d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:35.003121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774e3a9-ebfa-4e84-b7ee-b83fdf34ff4d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:35.004460 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:04:35.010325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78433aba-b1e0-40d3-99be-81a0a1d8b521 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:35.010742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78433aba-b1e0-40d3-99be-81a0a1d8b521 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:35.010877 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78433aba-b1e0-40d3-99be-81a0a1d8b521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:35.016515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ced753-abca-4918-99e3-9577792a1e6b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:35.016802 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ced753-abca-4918-99e3-9577792a1e6b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:35.017083 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ced753-abca-4918-99e3-9577792a1e6b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:35.018395 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:04:35.023434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b329bc-2763-4369-8285-db0f90015846 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:35.023721 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b329bc-2763-4369-8285-db0f90015846 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:35.023994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b329bc-2763-4369-8285-db0f90015846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:35.029689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-78433aba-b1e0-40d3-99be-81a0a1d8b521 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:35.030857 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-78433aba-b1e0-40d3-99be-81a0a1d8b521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:35.065796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG passlib.handlers.bcrypt [None req-91b329bc-2763-4369-8285-db0f90015846 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81466) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 01:04:35.066216 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG passlib.handlers.bcrypt [None req-91b329bc-2763-4369-8285-db0f90015846 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81466) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 01:04:35.112002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:04:35.115849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-91b329bc-2763-4369-8285-db0f90015846 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:35.117449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-91b329bc-2763-4369-8285-db0f90015846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:35.217364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:04:35.385970 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78433aba-b1e0-40d3-99be-81a0a1d8b521 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:35.410771 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:35.484518 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b329bc-2763-4369-8285-db0f90015846 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:35.494046 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78433aba-b1e0-40d3-99be-81a0a1d8b521 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:35.529760 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436efe4-1df9-461a-91cc-07d62e4df2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:35.530398 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436efe4-1df9-461a-91cc-07d62e4df2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:35.530678 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436efe4-1df9-461a-91cc-07d62e4df2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:35.530954 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436efe4-1df9-461a-91cc-07d62e4df2c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:35.542864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436efe4-1df9-461a-91cc-07d62e4df2c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-1436efe4-1df9-461a-91cc-07d62e4df2c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:04:35.551811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:04:35.552917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:04:35.553716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:04:35.553716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:04:35.553716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:04:35.553716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:04:35.553716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:04:35.553716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:04:35.553716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:04:35.553716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:04:35.553716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:04:35.553716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:04:35.553716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:04:35.553716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:04:35.553716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:04:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:04:35.558889 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436efe4-1df9-461a-91cc-07d62e4df2c3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:35.588383 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b329bc-2763-4369-8285-db0f90015846 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:35.590626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:35.626937 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3480cd5-48c9-4798-b254-6dd8f8a6239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:35.627843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3480cd5-48c9-4798-b254-6dd8f8a6239c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:35.628125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3480cd5-48c9-4798-b254-6dd8f8a6239c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:35.628403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3480cd5-48c9-4798-b254-6dd8f8a6239c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:35.644578 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:35.662585 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436efe4-1df9-461a-91cc-07d62e4df2c3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:35.695128 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3480cd5-48c9-4798-b254-6dd8f8a6239c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:35.695933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13966d76-a809-49eb-81c3-7436c1c2428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:35.697206 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13966d76-a809-49eb-81c3-7436c1c2428e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:35.697318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3480cd5-48c9-4798-b254-6dd8f8a6239c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:35.697541 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13966d76-a809-49eb-81c3-7436c1c2428e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:35.697821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13966d76-a809-49eb-81c3-7436c1c2428e None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:35.698503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13966d76-a809-49eb-81c3-7436c1c2428e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:35.698912 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13966d76-a809-49eb-81c3-7436c1c2428e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:35.700255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13966d76-a809-49eb-81c3-7436c1c2428e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:35.712364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:04:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:04:35.718154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13966d76-a809-49eb-81c3-7436c1c2428e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:35.794965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:04:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 01:04:35.800500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3480cd5-48c9-4798-b254-6dd8f8a6239c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:35.803179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:35.819199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13966d76-a809-49eb-81c3-7436c1c2428e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:35.854296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fc71e-c4a5-465d-a0dd-c18a3b33088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:35.854928 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fc71e-c4a5-465d-a0dd-c18a3b33088d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:35.855243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fc71e-c4a5-465d-a0dd-c18a3b33088d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:35.855509 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fc71e-c4a5-465d-a0dd-c18a3b33088d None admin] PATH_INFO: `/v3/users/5c63bf57b4e7408d9fa4e45538832485` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:35.856644 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fc71e-c4a5-465d-a0dd-c18a3b33088d None admin] RBAC: Authorizing `identity:get_user(user_id=5c63bf57b4e7408d9fa4e45538832485)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:35.858095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fc71e-c4a5-465d-a0dd-c18a3b33088d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:35.859683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:04:35 2022] GET /identity/v3/users/5c63bf57b4e7408d9fa4e45538832485 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:04:35.865002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fc71e-c4a5-465d-a0dd-c18a3b33088d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:35.879193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:35.899311 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3480cd5-48c9-4798-b254-6dd8f8a6239c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:35.933317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d2f45-b424-46c5-8553-56413267add7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:35.934167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d2f45-b424-46c5-8553-56413267add7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:35.934499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d2f45-b424-46c5-8553-56413267add7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:35.934775 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d2f45-b424-46c5-8553-56413267add7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:35.953834 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d2f45-b424-46c5-8553-56413267add7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:35.955328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d2f45-b424-46c5-8553-56413267add7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:35.965411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fc71e-c4a5-465d-a0dd-c18a3b33088d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-372d2f45-b424-46c5-8553-56413267add7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:04:35.973633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:04:35.974613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:04:35.975443 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:04:35.975443 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:04:35.975443 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:04:35.975443 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:04:35.980660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d2f45-b424-46c5-8553-56413267add7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:36.000371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb998b81-5290-4cb6-8acb-89581db3e1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:36.001003 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb998b81-5290-4cb6-8acb-89581db3e1ed None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:36.001284 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb998b81-5290-4cb6-8acb-89581db3e1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:36.001558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb998b81-5290-4cb6-8acb-89581db3e1ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:36.002670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb998b81-5290-4cb6-8acb-89581db3e1ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:36.004162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb998b81-5290-4cb6-8acb-89581db3e1ed None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:36.005694 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:04:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:04:36.012246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb998b81-5290-4cb6-8acb-89581db3e1ed None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:36.036745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:36.083038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d2f45-b424-46c5-8553-56413267add7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:36.091721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:36.111077 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb998b81-5290-4cb6-8acb-89581db3e1ed None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:36.116742 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bf11b-8b62-4097-8a60-7df6df0c21db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:36.117347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bf11b-8b62-4097-8a60-7df6df0c21db None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:36.117628 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bf11b-8b62-4097-8a60-7df6df0c21db None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:36.117904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bf11b-8b62-4097-8a60-7df6df0c21db None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:36.119256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bf11b-8b62-4097-8a60-7df6df0c21db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:36.119576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bf11b-8b62-4097-8a60-7df6df0c21db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:36.120966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bf11b-8b62-4097-8a60-7df6df0c21db None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:36.138708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:04:36.145482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa20eff-81e5-45e0-bd41-4f639079fc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:36.146104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa20eff-81e5-45e0-bd41-4f639079fc28 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:36.146380 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa20eff-81e5-45e0-bd41-4f639079fc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:36.146652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa20eff-81e5-45e0-bd41-4f639079fc28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:36.147423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa20eff-81e5-45e0-bd41-4f639079fc28 None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.domain.id=default, user.id=5c63bf57b4e7408d9fa4e45538832485) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:36.147733 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa20eff-81e5-45e0-bd41-4f639079fc28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:36.149220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa20eff-81e5-45e0-bd41-4f639079fc28 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:36.157258 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 11/21] 10.222.0.20 () {56 vars in 1322 bytes} [Tue Sep 13 01:04:36 2022] GET /identity/v3/role_assignments?user.id=5c63bf57b4e7408d9fa4e45538832485&scope.domain.id=default&role.id=3799feb4caa64e568971222375957f54 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:04:38.699698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1893e61-b33a-401c-a8a7-d58a55f26c49 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:38.700635 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1893e61-b33a-401c-a8a7-d58a55f26c49 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:38.701122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1893e61-b33a-401c-a8a7-d58a55f26c49 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:38.702910 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:38.708488 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43152e02-5ab8-43eb-8f08-26ba6369b57c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:38.709330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43152e02-5ab8-43eb-8f08-26ba6369b57c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:38.709800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43152e02-5ab8-43eb-8f08-26ba6369b57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:38.717799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef7c30-2ef3-47e3-88c5-fcb9d67bb934 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:38.718341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef7c30-2ef3-47e3-88c5-fcb9d67bb934 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:38.718831 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef7c30-2ef3-47e3-88c5-fcb9d67bb934 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:38.720400 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 12/23] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:04:38.725897 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158fa8-2678-4d9a-804f-05795534f10a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:38.726433 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158fa8-2678-4d9a-804f-05795534f10a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:38.726915 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158fa8-2678-4d9a-804f-05795534f10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:38.736036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-43152e02-5ab8-43eb-8f08-26ba6369b57c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:38.737246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-43152e02-5ab8-43eb-8f08-26ba6369b57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:38.760435 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ac158fa8-2678-4d9a-804f-05795534f10a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:38.761996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ac158fa8-2678-4d9a-804f-05795534f10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:38.849657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 12/24] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:04:38.912560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:04:38.992877 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2c98c-de66-4304-83df-f50475ae07cd None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:38.993532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2c98c-de66-4304-83df-f50475ae07cd None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:38.994170 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2c98c-de66-4304-83df-f50475ae07cd None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:38.995879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 13/26] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:39.001747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58717e8b-006c-4460-9862-6fd7674f3872 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:39.002369 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58717e8b-006c-4460-9862-6fd7674f3872 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:39.002851 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58717e8b-006c-4460-9862-6fd7674f3872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:39.026282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-58717e8b-006c-4460-9862-6fd7674f3872 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:39.027529 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-58717e8b-006c-4460-9862-6fd7674f3872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:39.085583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:39.119339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:04:39.298646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2c98c-de66-4304-83df-f50475ae07cd None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:39.324523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58717e8b-006c-4460-9862-6fd7674f3872 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:39.424221 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:39.482632 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2c98c-de66-4304-83df-f50475ae07cd None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:39.500571 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58717e8b-006c-4460-9862-6fd7674f3872 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:39.540336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1be92a-1f62-4e14-89cd-973d4c6984bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:39.541479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1be92a-1f62-4e14-89cd-973d4c6984bb None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:39.541983 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1be92a-1f62-4e14-89cd-973d4c6984bb None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:39.542462 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1be92a-1f62-4e14-89cd-973d4c6984bb None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:39.543389 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1be92a-1f62-4e14-89cd-973d4c6984bb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:39.545751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1be92a-1f62-4e14-89cd-973d4c6984bb None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:39.555960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4c481-3e66-4338-873f-a16d46d9c8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:39.556688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4c481-3e66-4338-873f-a16d46d9c8ee None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:39.556924 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4c481-3e66-4338-873f-a16d46d9c8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:39.557252 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4c481-3e66-4338-873f-a16d46d9c8ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:39.570657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4c481-3e66-4338-873f-a16d46d9c8ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:39.573082 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4c481-3e66-4338-873f-a16d46d9c8ee None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-c7f4c481-3e66-4338-873f-a16d46d9c8ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:04:39.591191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:04:39.592098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:04:39.592903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:04:39.592903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:04:39.592903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:04:39.592903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 14/28] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:04:39.597954 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88eaa4-43ec-44ec-9b1e-b2258d2bf1f8 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:39.598243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88eaa4-43ec-44ec-9b1e-b2258d2bf1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:39.598525 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88eaa4-43ec-44ec-9b1e-b2258d2bf1f8 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:39.600575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 15/29] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:39.601218 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88eaa4-43ec-44ec-9b1e-b2258d2bf1f8 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:39.687457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 15/30] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Sep 13 01:04:39 2022] POST /identity/v3/roles => generated 219 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:04:39.688833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1be92a-1f62-4e14-89cd-973d4c6984bb None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:39.751992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88eaa4-43ec-44ec-9b1e-b2258d2bf1f8 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:39.775668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:39.807463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:39.828151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3a611-5821-4c6e-9305-0990c4762bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:39.830365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3a611-5821-4c6e-9305-0990c4762bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:39.830847 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3a611-5821-4c6e-9305-0990c4762bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:39.831597 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3a611-5821-4c6e-9305-0990c4762bf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:39.864055 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3a611-5821-4c6e-9305-0990c4762bf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-e4d3a611-5821-4c6e-9305-0990c4762bf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:04:39.875900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:04:39.876876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:04:39.877609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:04:39.877609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:04:39.877609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:04:39.877609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:04:39.877609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:04:39.877609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:04:39.877609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:04:39.877609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:04:39.877609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:04:39.877609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:04:39.877609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:04:39.877609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:04:39.880391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 16/31] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:04:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:04:39.884815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa8243-e353-46b6-aa1c-96daa08b9691 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:39.887165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa8243-e353-46b6-aa1c-96daa08b9691 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:39.887672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa8243-e353-46b6-aa1c-96daa08b9691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:39.903971 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1be92a-1f62-4e14-89cd-973d4c6984bb None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:39.917389 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b3aa8243-e353-46b6-aa1c-96daa08b9691 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:39.919005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b3aa8243-e353-46b6-aa1c-96daa08b9691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:39.948162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097201a5-4908-47d5-b50a-1dab89c6283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:39.949114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097201a5-4908-47d5-b50a-1dab89c6283a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:39.949642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097201a5-4908-47d5-b50a-1dab89c6283a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:39.950120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097201a5-4908-47d5-b50a-1dab89c6283a None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:39.951232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097201a5-4908-47d5-b50a-1dab89c6283a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:39.951728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097201a5-4908-47d5-b50a-1dab89c6283a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:39.953735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097201a5-4908-47d5-b50a-1dab89c6283a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:39.972246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 16/32] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:39.977809 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097201a5-4908-47d5-b50a-1dab89c6283a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:40.006362 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 17/33] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:04:40.007059 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa8243-e353-46b6-aa1c-96daa08b9691 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:40.135537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:40.144158 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097201a5-4908-47d5-b50a-1dab89c6283a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:40.198885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa8243-e353-46b6-aa1c-96daa08b9691 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:40.211170 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfae16d-82b3-48a1-b4d8-03a5bac1bc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:40.211867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfae16d-82b3-48a1-b4d8-03a5bac1bc54 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:40.212770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfae16d-82b3-48a1-b4d8-03a5bac1bc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:40.213050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfae16d-82b3-48a1-b4d8-03a5bac1bc54 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:40.213729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfae16d-82b3-48a1-b4d8-03a5bac1bc54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:40.214034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfae16d-82b3-48a1-b4d8-03a5bac1bc54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:40.215454 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfae16d-82b3-48a1-b4d8-03a5bac1bc54 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:40.235620 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:40.240422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 17/34] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:04:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:40.244458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfae16d-82b3-48a1-b4d8-03a5bac1bc54 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:40.269065 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b75674-7758-4123-bb18-c9ce77f05c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:40.269686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b75674-7758-4123-bb18-c9ce77f05c34 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:40.269961 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b75674-7758-4123-bb18-c9ce77f05c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:40.270230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b75674-7758-4123-bb18-c9ce77f05c34 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:40.270984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b75674-7758-4123-bb18-c9ce77f05c34 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:40.272529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b75674-7758-4123-bb18-c9ce77f05c34 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:40.367829 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfae16d-82b3-48a1-b4d8-03a5bac1bc54 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:40.404133 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202e05b-bd98-4a13-9ac2-fe52a1025067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:40.405118 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202e05b-bd98-4a13-9ac2-fe52a1025067 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:40.405636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202e05b-bd98-4a13-9ac2-fe52a1025067 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:40.406123 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202e05b-bd98-4a13-9ac2-fe52a1025067 None admin] PATH_INFO: `/v3/users/5c63bf57b4e7408d9fa4e45538832485` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:40.408000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202e05b-bd98-4a13-9ac2-fe52a1025067 None admin] RBAC: Authorizing `identity:get_user(user_id=5c63bf57b4e7408d9fa4e45538832485)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:40.409693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202e05b-bd98-4a13-9ac2-fe52a1025067 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:40.411502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 18/35] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:04:40 2022] GET /identity/v3/users/5c63bf57b4e7408d9fa4e45538832485 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:40.412890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b38d-4c93-44d3-b5ea-0ed6905cfc0e None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:40.413236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b38d-4c93-44d3-b5ea-0ed6905cfc0e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:40.413580 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b38d-4c93-44d3-b5ea-0ed6905cfc0e None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:40.419030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:40.419030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0b38d-4c93-44d3-b5ea-0ed6905cfc0e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:40.422095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 13 01:04:40 2022] POST /identity/v3/projects => generated 301 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:04:40.423100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b75674-7758-4123-bb18-c9ce77f05c34 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:40.463278 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:40.566422 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b75674-7758-4123-bb18-c9ce77f05c34 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:40.574568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0b38d-4c93-44d3-b5ea-0ed6905cfc0e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:40.608255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64253acb-74f3-47bd-a9d1-99f59fe73c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:40.609118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64253acb-74f3-47bd-a9d1-99f59fe73c74 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:40.609474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64253acb-74f3-47bd-a9d1-99f59fe73c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:40.609880 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64253acb-74f3-47bd-a9d1-99f59fe73c74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:40.611361 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64253acb-74f3-47bd-a9d1-99f59fe73c74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:40.613204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64253acb-74f3-47bd-a9d1-99f59fe73c74 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:40.614921 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:04:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:40.615591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7949da-4c0c-4744-a7d6-b8c85de7fd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:40.616473 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7949da-4c0c-4744-a7d6-b8c85de7fd2f None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:40.616593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db0a30-a8ae-4d47-b1da-7e990c279ca8 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:40.616824 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db0a30-a8ae-4d47-b1da-7e990c279ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:40.617174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db0a30-a8ae-4d47-b1da-7e990c279ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:40.617408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7949da-4c0c-4744-a7d6-b8c85de7fd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:40.617857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7949da-4c0c-4744-a7d6-b8c85de7fd2f None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:40.619463 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7949da-4c0c-4744-a7d6-b8c85de7fd2f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:40.621586 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7949da-4c0c-4744-a7d6-b8c85de7fd2f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:40.640492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-27db0a30-a8ae-4d47-b1da-7e990c279ca8 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:40.640876 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Sep 13 01:04:40 2022] POST /identity/v3/roles => generated 225 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:04:40.642010 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7949da-4c0c-4744-a7d6-b8c85de7fd2f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:40.642580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-27db0a30-a8ae-4d47-b1da-7e990c279ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:40.680086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:40.733866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 20/40] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:04:40.733866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff045bca-eac2-4f80-96e8-53e816e8cdf0 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:40.733866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff045bca-eac2-4f80-96e8-53e816e8cdf0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:40.733866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff045bca-eac2-4f80-96e8-53e816e8cdf0 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:40.736992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 21/41] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:40.742768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4af771-84de-4620-b63e-be6cbda11a48 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:40.743762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4af771-84de-4620-b63e-be6cbda11a48 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:40.744120 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4af771-84de-4620-b63e-be6cbda11a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:40.763482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:40.764433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-9b4af771-84de-4620-b63e-be6cbda11a48 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:40.765788 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9b4af771-84de-4620-b63e-be6cbda11a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:40.787191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7949da-4c0c-4744-a7d6-b8c85de7fd2f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:40.835835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda55e9-1088-4a11-b429-903d97bc52d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:40.836524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda55e9-1088-4a11-b429-903d97bc52d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:40.837490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda55e9-1088-4a11-b429-903d97bc52d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:40.837776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda55e9-1088-4a11-b429-903d97bc52d4 None admin] PATH_INFO: `/v3/domains/default/users/5c63bf57b4e7408d9fa4e45538832485/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:40.840155 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda55e9-1088-4a11-b429-903d97bc52d4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5c63bf57b4e7408d9fa4e45538832485, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:40.841794 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda55e9-1088-4a11-b429-903d97bc52d4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:40.862007 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 21/42] 10.222.0.20 () {58 vars in 1361 bytes} [Tue Sep 13 01:04:40 2022] PUT /identity/v3/domains/default/users/5c63bf57b4e7408d9fa4e45538832485/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:04:40.874212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 22/43] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:04:41.027857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda55e9-1088-4a11-b429-903d97bc52d4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:41.132130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda55e9-1088-4a11-b429-903d97bc52d4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:41.146718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4af771-84de-4620-b63e-be6cbda11a48 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:41.172202 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fc685-20b4-459f-96e5-48a45257b53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:41.172835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fc685-20b4-459f-96e5-48a45257b53c None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:41.173121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fc685-20b4-459f-96e5-48a45257b53c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:41.173404 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fc685-20b4-459f-96e5-48a45257b53c None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:41.174091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fc685-20b4-459f-96e5-48a45257b53c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:41.176160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fc685-20b4-459f-96e5-48a45257b53c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:41.191588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Sep 13 01:04:41 2022] POST /identity/v3/roles => generated 223 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:04:41.358903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:41.366527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4af771-84de-4620-b63e-be6cbda11a48 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:41.404763 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dc14b-46c5-4a4a-be3e-4ef2102eed93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:41.405409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dc14b-46c5-4a4a-be3e-4ef2102eed93 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:41.405693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dc14b-46c5-4a4a-be3e-4ef2102eed93 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:41.405968 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dc14b-46c5-4a4a-be3e-4ef2102eed93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:41.407132 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02dc14b-46c5-4a4a-be3e-4ef2102eed93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:41.408727 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02dc14b-46c5-4a4a-be3e-4ef2102eed93 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:41.410487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 23/45] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:04:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:04:41.419149 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fc685-20b4-459f-96e5-48a45257b53c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:41.429694 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:41.521583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fc685-20b4-459f-96e5-48a45257b53c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:41.553466 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db768c8d-7831-4275-8226-d88ae1b1724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:41.554078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db768c8d-7831-4275-8226-d88ae1b1724a None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:41.554358 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db768c8d-7831-4275-8226-d88ae1b1724a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:41.554633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db768c8d-7831-4275-8226-d88ae1b1724a None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:41.555310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db768c8d-7831-4275-8226-d88ae1b1724a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:41.557415 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db768c8d-7831-4275-8226-d88ae1b1724a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:41.586371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 13 01:04:41 2022] POST /identity/v3/projects => generated 312 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:04:43.030431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fecce4-468c-42f9-b28a-ef76d26ef5f9 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:43.030977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fecce4-468c-42f9-b28a-ef76d26ef5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:43.030977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fecce4-468c-42f9-b28a-ef76d26ef5f9 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:43.032347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:43.037498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c0659-b6d0-4fd5-992b-672c9db53aa6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:43.037909 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c0659-b6d0-4fd5-992b-672c9db53aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:43.038047 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c0659-b6d0-4fd5-992b-672c9db53aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:43.056691 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a59c0659-b6d0-4fd5-992b-672c9db53aa6 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:43.058171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a59c0659-b6d0-4fd5-992b-672c9db53aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:43.109153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:43.124398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:04:43.396004 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fecce4-468c-42f9-b28a-ef76d26ef5f9 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:43.502954 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fecce4-468c-42f9-b28a-ef76d26ef5f9 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:43.536624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03f2c1-ae4c-4b9e-ae3d-1da942a98200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:43.537257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03f2c1-ae4c-4b9e-ae3d-1da942a98200 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:43.537538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03f2c1-ae4c-4b9e-ae3d-1da942a98200 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:43.537813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03f2c1-ae4c-4b9e-ae3d-1da942a98200 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:43.548483 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03f2c1-ae4c-4b9e-ae3d-1da942a98200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-3d03f2c1-ae4c-4b9e-ae3d-1da942a98200 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:04:43.553345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:04:43.554369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:04:43.555165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:04:43.555165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:04:43.555165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:04:43.555165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:04:43.555165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:04:43.555165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:04:43.555165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:04:43.555165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:04:43.555165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:04:43.555165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:04:43.555165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:04:43.555165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:04:43.555165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 25/49] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:04:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:04:43.560545 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c0659-b6d0-4fd5-992b-672c9db53aa6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:43.661018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c0659-b6d0-4fd5-992b-672c9db53aa6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:43.694875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfdd4f-5f0b-47e6-be88-9bcc88230f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:43.695790 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfdd4f-5f0b-47e6-be88-9bcc88230f4b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:43.696105 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfdd4f-5f0b-47e6-be88-9bcc88230f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:43.696376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfdd4f-5f0b-47e6-be88-9bcc88230f4b None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:43.697037 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfdd4f-5f0b-47e6-be88-9bcc88230f4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:43.697342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfdd4f-5f0b-47e6-be88-9bcc88230f4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:43.698728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfdd4f-5f0b-47e6-be88-9bcc88230f4b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:43.706927 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 25/50] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:04:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:43.713870 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03f2c1-ae4c-4b9e-ae3d-1da942a98200 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:43.738968 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:43.743476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49416a7f-8083-45b3-a1b6-93a6de09339a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:43.743766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49416a7f-8083-45b3-a1b6-93a6de09339a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:43.744056 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49416a7f-8083-45b3-a1b6-93a6de09339a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:43.745409 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 26/51] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:04:43.750489 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90a9f6-3946-4353-a2e0-4704ad1919a1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:43.750780 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90a9f6-3946-4353-a2e0-4704ad1919a1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:43.751089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90a9f6-3946-4353-a2e0-4704ad1919a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:43.769251 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fe90a9f6-3946-4353-a2e0-4704ad1919a1 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:43.770493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fe90a9f6-3946-4353-a2e0-4704ad1919a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:43.815623 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03f2c1-ae4c-4b9e-ae3d-1da942a98200 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:43.816135 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:43.838963 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 27/52] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:04:43.850068 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780eb2b3-4d8c-44a3-a54d-f93c4c75eef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:43.850731 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eb2b3-4d8c-44a3-a54d-f93c4c75eef2 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:43.851019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eb2b3-4d8c-44a3-a54d-f93c4c75eef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:43.851328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eb2b3-4d8c-44a3-a54d-f93c4c75eef2 None admin] PATH_INFO: `/v3/users/5c63bf57b4e7408d9fa4e45538832485` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:43.852487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780eb2b3-4d8c-44a3-a54d-f93c4c75eef2 None admin] RBAC: Authorizing `identity:get_user(user_id=5c63bf57b4e7408d9fa4e45538832485)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:43.854059 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780eb2b3-4d8c-44a3-a54d-f93c4c75eef2 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:43.855809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:04:43 2022] GET /identity/v3/users/5c63bf57b4e7408d9fa4e45538832485 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:43.861254 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90a9f6-3946-4353-a2e0-4704ad1919a1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:43.958713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90a9f6-3946-4353-a2e0-4704ad1919a1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:44.101559 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5a9f8-568f-4266-9feb-47d7cf29f51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:44.102669 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5a9f8-568f-4266-9feb-47d7cf29f51d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:44.103194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5a9f8-568f-4266-9feb-47d7cf29f51d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:44.103694 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5a9f8-568f-4266-9feb-47d7cf29f51d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:44.105586 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5a9f8-568f-4266-9feb-47d7cf29f51d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:44.108066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5a9f8-568f-4266-9feb-47d7cf29f51d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:44.115466 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 28/54] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:04:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:44.116666 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780eb2b3-4d8c-44a3-a54d-f93c4c75eef2 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:44.123216 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5a9f8-568f-4266-9feb-47d7cf29f51d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:44.171280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:44.207675 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:44.217214 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780eb2b3-4d8c-44a3-a54d-f93c4c75eef2 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:44.222058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5a9f8-568f-4266-9feb-47d7cf29f51d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:44.251075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d9b74-5e1a-4fd8-8266-a3f38a567c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:44.251703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d9b74-5e1a-4fd8-8266-a3f38a567c9f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:44.251987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d9b74-5e1a-4fd8-8266-a3f38a567c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:44.252263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d9b74-5e1a-4fd8-8266-a3f38a567c9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:44.252985 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d9b74-5e1a-4fd8-8266-a3f38a567c9f None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.domain.id=default, user.id=5c63bf57b4e7408d9fa4e45538832485) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:44.253294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d9b74-5e1a-4fd8-8266-a3f38a567c9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:44.254747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d9b74-5e1a-4fd8-8266-a3f38a567c9f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:44.255031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86089caf-6ae2-4aa5-b028-fb50fb869dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:44.255679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86089caf-6ae2-4aa5-b028-fb50fb869dda None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:44.255957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86089caf-6ae2-4aa5-b028-fb50fb869dda None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:44.256236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86089caf-6ae2-4aa5-b028-fb50fb869dda None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:44.257327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86089caf-6ae2-4aa5-b028-fb50fb869dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:44.259324 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86089caf-6ae2-4aa5-b028-fb50fb869dda None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:44.260892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 29/55] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:04:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:04:44.265279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 27/56] 10.222.0.20 () {56 vars in 1322 bytes} [Tue Sep 13 01:04:44 2022] GET /identity/v3/role_assignments?user.id=5c63bf57b4e7408d9fa4e45538832485&scope.domain.id=default&role.id=3799feb4caa64e568971222375957f54 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:44.266571 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86089caf-6ae2-4aa5-b028-fb50fb869dda None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:44.371191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86089caf-6ae2-4aa5-b028-fb50fb869dda None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:44.388319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:44.408330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8b7e7-aaf4-47da-81b0-bf8468b60e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:44.408947 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8b7e7-aaf4-47da-81b0-bf8468b60e96 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:44.409227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8b7e7-aaf4-47da-81b0-bf8468b60e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:44.409500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8b7e7-aaf4-47da-81b0-bf8468b60e96 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:44.410179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8b7e7-aaf4-47da-81b0-bf8468b60e96 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:44.411673 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8b7e7-aaf4-47da-81b0-bf8468b60e96 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:44.440058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 30/57] 10.222.0.20 () {60 vars in 1140 bytes} [Tue Sep 13 01:04:44 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:04:46.597413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d827a-d9f6-4c2c-b845-6bbeb88188dd None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:46.597919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d827a-d9f6-4c2c-b845-6bbeb88188dd None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:46.598004 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d827a-d9f6-4c2c-b845-6bbeb88188dd None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:46.599334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 28/58] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:46.604783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21cc8b-78d4-463a-a99f-c31ee41fe679 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:46.605152 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21cc8b-78d4-463a-a99f-c31ee41fe679 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:46.605336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21cc8b-78d4-463a-a99f-c31ee41fe679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:46.623620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ba21cc8b-78d4-463a-a99f-c31ee41fe679 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:46.625075 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ba21cc8b-78d4-463a-a99f-c31ee41fe679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:46.688396 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:04:46.963200 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d827a-d9f6-4c2c-b845-6bbeb88188dd None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:47.062470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d827a-d9f6-4c2c-b845-6bbeb88188dd None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:47.094361 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737c62d-ff03-4d35-abb7-48b6435128f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:47.094976 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737c62d-ff03-4d35-abb7-48b6435128f7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:47.095284 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737c62d-ff03-4d35-abb7-48b6435128f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:47.095560 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737c62d-ff03-4d35-abb7-48b6435128f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:47.096664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737c62d-ff03-4d35-abb7-48b6435128f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:47.098116 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737c62d-ff03-4d35-abb7-48b6435128f7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:47.099688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 29/60] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:04:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:47.105715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21cc8b-78d4-463a-a99f-c31ee41fe679 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:47.196950 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:47.200987 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21cc8b-78d4-463a-a99f-c31ee41fe679 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:47.234183 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1da24-4f66-4c30-a99c-6f22a5031c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:47.234715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1da24-4f66-4c30-a99c-6f22a5031c9f None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:47.234992 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1da24-4f66-4c30-a99c-6f22a5031c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:47.235308 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1da24-4f66-4c30-a99c-6f22a5031c9f None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:47.235963 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1da24-4f66-4c30-a99c-6f22a5031c9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:47.237387 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1da24-4f66-4c30-a99c-6f22a5031c9f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:47.263669 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 32/61] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:04:47 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:04:50.496740 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784aa03-5743-4c9e-b226-5af190073660 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:50.497246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784aa03-5743-4c9e-b226-5af190073660 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:50.497354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784aa03-5743-4c9e-b226-5af190073660 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:50.498777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 30/62] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:50.505160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7348c45-e22c-4937-b662-f2ddf4222096 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:50.505552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7348c45-e22c-4937-b662-f2ddf4222096 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:50.505716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7348c45-e22c-4937-b662-f2ddf4222096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:50.540521 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b7348c45-e22c-4937-b662-f2ddf4222096 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:50.542053 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b7348c45-e22c-4937-b662-f2ddf4222096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:50.636403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 33/63] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:04:50.775603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ecade-3b17-452f-8b19-261d84f02b33 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:50.775947 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ecade-3b17-452f-8b19-261d84f02b33 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:50.776176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ecade-3b17-452f-8b19-261d84f02b33 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:50.777569 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 31/64] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:50.793344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55217d7-c205-474a-a96c-d06abb488eea None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:50.793640 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55217d7-c205-474a-a96c-d06abb488eea None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:50.793903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55217d7-c205-474a-a96c-d06abb488eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:50.820074 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e55217d7-c205-474a-a96c-d06abb488eea None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:50.821823 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e55217d7-c205-474a-a96c-d06abb488eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:50.892202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1a1fc-c1b1-4ce4-b01a-454328f41e98 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:50.892498 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1a1fc-c1b1-4ce4-b01a-454328f41e98 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:50.892758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1a1fc-c1b1-4ce4-b01a-454328f41e98 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:50.894236 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 32/65] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:50.904606 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f9e73-03df-4c87-ad38-f032eddd7505 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:50.904893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f9e73-03df-4c87-ad38-f032eddd7505 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:50.905174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f9e73-03df-4c87-ad38-f032eddd7505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:50.936799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 34/66] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:04:50.944179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f63f9e73-03df-4c87-ad38-f032eddd7505 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:50.945988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f63f9e73-03df-4c87-ad38-f032eddd7505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:50.974376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:51.042350 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 33/67] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 13 01:04:51.054795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55217d7-c205-474a-a96c-d06abb488eea None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:51.084177 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:51.100661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cad80-09d0-41f1-8cce-43ac9265d05b None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:51.101033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cad80-09d0-41f1-8cce-43ac9265d05b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:51.101219 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cad80-09d0-41f1-8cce-43ac9265d05b None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:51.103945 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 34/68] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:04:51.111397 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d631a-2dae-4158-a071-ee6f1fede8ac None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:51.111681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d631a-2dae-4158-a071-ee6f1fede8ac None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:51.111955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d631a-2dae-4158-a071-ee6f1fede8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:51.147731 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-404d631a-2dae-4158-a071-ee6f1fede8ac None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:51.149671 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-404d631a-2dae-4158-a071-ee6f1fede8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:51.209046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55217d7-c205-474a-a96c-d06abb488eea None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:51.257800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ab9d1-be55-4e25-809e-870127c2b9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:51.258720 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ab9d1-be55-4e25-809e-870127c2b9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:51.259221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ab9d1-be55-4e25-809e-870127c2b9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:51.259507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ab9d1-be55-4e25-809e-870127c2b9f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:51.285496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ab9d1-be55-4e25-809e-870127c2b9f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:04:51.289224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 35/69] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-8e2ab9d1-be55-4e25-809e-870127c2b9f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:04:51.294148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:04:51.295126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:04:51.295883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:04:51.295883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:04:51.295883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:04:51.295883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:04:51.295883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:04:51.295883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:04:51.295883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:04:51.295883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:04:51.295883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:04:51.295883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:04:51.295883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:04:51.295883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:04:51.295883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 35/70] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:04:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:04:51.295883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ab9d1-be55-4e25-809e-870127c2b9f8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:51.308140 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d631a-2dae-4158-a071-ee6f1fede8ac None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:51.378317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:51.403997 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ab9d1-be55-4e25-809e-870127c2b9f8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:51.417079 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:51.437500 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d631a-2dae-4158-a071-ee6f1fede8ac None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:51.448022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a9ee3-294b-400d-b332-c0349aa0de65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:51.448942 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a9ee3-294b-400d-b332-c0349aa0de65 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:51.449364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a9ee3-294b-400d-b332-c0349aa0de65 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:51.449805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a9ee3-294b-400d-b332-c0349aa0de65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:51.461353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a9ee3-294b-400d-b332-c0349aa0de65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-5f3a9ee3-294b-400d-b332-c0349aa0de65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:04:51.467386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:04:51.468372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:04:51.469304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:04:51.469304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:04:51.469304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:04:51.469304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:04:51.469304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:04:51.469304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:04:51.469304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:04:51.469304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:04:51.469304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:04:51.469304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:04:51.469304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:04:51.469304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:04:51.471237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:04:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:04:51.472144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a9ee3-294b-400d-b332-c0349aa0de65 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:51.478118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543c4a2-ab8f-4b83-91bb-eca2472c68bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:51.478904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543c4a2-ab8f-4b83-91bb-eca2472c68bd None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:51.479208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543c4a2-ab8f-4b83-91bb-eca2472c68bd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:51.479622 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543c4a2-ab8f-4b83-91bb-eca2472c68bd None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:51.480466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543c4a2-ab8f-4b83-91bb-eca2472c68bd None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:51.480769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543c4a2-ab8f-4b83-91bb-eca2472c68bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:51.482298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543c4a2-ab8f-4b83-91bb-eca2472c68bd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:51.491042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 36/72] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:04:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:51.493118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1161-a2e7-40cc-b69e-9a518dcc6359 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:51.493271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1161-a2e7-40cc-b69e-9a518dcc6359 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:51.493550 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1161-a2e7-40cc-b69e-9a518dcc6359 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:51.494888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 37/73] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:51.499900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d1161-a2e7-40cc-b69e-9a518dcc6359 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:51.589233 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a9ee3-294b-400d-b332-c0349aa0de65 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:51.598751 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d1161-a2e7-40cc-b69e-9a518dcc6359 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:51.623075 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd6fc8-f728-4995-85ca-8ad61bfb453e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:51.623747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd6fc8-f728-4995-85ca-8ad61bfb453e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:51.624293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd6fc8-f728-4995-85ca-8ad61bfb453e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:51.624596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd6fc8-f728-4995-85ca-8ad61bfb453e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:51.626380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:51.633518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d93b4f-57be-402c-9c8e-e59f5302db22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:51.634198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d93b4f-57be-402c-9c8e-e59f5302db22 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:51.634479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d93b4f-57be-402c-9c8e-e59f5302db22 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:51.634757 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d93b4f-57be-402c-9c8e-e59f5302db22 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:51.635451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d93b4f-57be-402c-9c8e-e59f5302db22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:51.635551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd6fc8-f728-4995-85ca-8ad61bfb453e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:04:51.635751 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d93b4f-57be-402c-9c8e-e59f5302db22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:51.637138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d93b4f-57be-402c-9c8e-e59f5302db22 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-12bd6fc8-f728-4995-85ca-8ad61bfb453e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:04:51.640352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:04:51.641215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:04:51.641965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:04:51.641965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:04:51.641965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:04:51.641965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:04:51.641965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:04:51.641965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:04:51.641965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:04:51.641965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:04:51.641965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:04:51.641965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:04:51.641965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:04:51.641965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:04:51.641965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 37/74] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:04:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:04:51.643817 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd6fc8-f728-4995-85ca-8ad61bfb453e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:51.651342 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:04:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:51.651342 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a247a1-43aa-4ce5-9a0a-f2b3938fbed6 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:51.651342 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a247a1-43aa-4ce5-9a0a-f2b3938fbed6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:51.651342 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a247a1-43aa-4ce5-9a0a-f2b3938fbed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:51.666770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c0a247a1-43aa-4ce5-9a0a-f2b3938fbed6 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:51.667982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c0a247a1-43aa-4ce5-9a0a-f2b3938fbed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:51.669910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:51.734898 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 39/76] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:04:51.735843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a247a1-43aa-4ce5-9a0a-f2b3938fbed6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:51.743278 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd6fc8-f728-4995-85ca-8ad61bfb453e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:51.781613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad8e6c-db62-4e68-be98-aa2e4087fddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:51.782521 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad8e6c-db62-4e68-be98-aa2e4087fddd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:51.782810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad8e6c-db62-4e68-be98-aa2e4087fddd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:51.783092 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad8e6c-db62-4e68-be98-aa2e4087fddd None admin] PATH_INFO: `/v3/users/fae5f077c4984c84b963e756212a526f` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:51.803244 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad8e6c-db62-4e68-be98-aa2e4087fddd None admin] RBAC: Authorizing `identity:get_user(user_id=fae5f077c4984c84b963e756212a526f)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:51.804797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad8e6c-db62-4e68-be98-aa2e4087fddd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:51.806973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 38/77] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:04:51 2022] GET /identity/v3/users/fae5f077c4984c84b963e756212a526f => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:51.807770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad8e6c-db62-4e68-be98-aa2e4087fddd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:51.843008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a247a1-43aa-4ce5-9a0a-f2b3938fbed6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:51.865205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:51.880262 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b9c17-9998-42ac-93d8-c5e62aa8bc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:51.881033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9c17-9998-42ac-93d8-c5e62aa8bc80 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:51.881322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9c17-9998-42ac-93d8-c5e62aa8bc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:51.881601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9c17-9998-42ac-93d8-c5e62aa8bc80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:51.888754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:51.894103 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b9c17-9998-42ac-93d8-c5e62aa8bc80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-316b9c17-9998-42ac-93d8-c5e62aa8bc80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:04:51.899563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:04:51.900536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:04:51.901298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:04:51.901298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:04:51.901298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:04:51.901298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:04:51.901298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:04:51.901298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:04:51.901298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:04:51.901298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:04:51.901298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:04:51.901298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:04:51.901298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:04:51.901298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:04:51.901298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 40/78] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:04:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:04:51.901914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b9c17-9998-42ac-93d8-c5e62aa8bc80 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:51.924909 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad8e6c-db62-4e68-be98-aa2e4087fddd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:51.961812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8835690-5530-4356-a681-931033be97c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:51.962831 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8835690-5530-4356-a681-931033be97c3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:51.963297 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8835690-5530-4356-a681-931033be97c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:51.963576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8835690-5530-4356-a681-931033be97c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:51.964243 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8835690-5530-4356-a681-931033be97c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:51.964548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8835690-5530-4356-a681-931033be97c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:51.965925 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8835690-5530-4356-a681-931033be97c3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:51.976360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 39/79] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:04:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:51.981819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8835690-5530-4356-a681-931033be97c3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:52.013805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b9c17-9998-42ac-93d8-c5e62aa8bc80 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:52.047716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b0dac-7be6-4f6d-a6ae-963929187d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:52.048343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b0dac-7be6-4f6d-a6ae-963929187d88 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:52.048628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b0dac-7be6-4f6d-a6ae-963929187d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:52.048903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b0dac-7be6-4f6d-a6ae-963929187d88 None admin] PATH_INFO: `/v3/users/5c63bf57b4e7408d9fa4e45538832485` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:52.050021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b0dac-7be6-4f6d-a6ae-963929187d88 None admin] RBAC: Authorizing `identity:get_user(user_id=5c63bf57b4e7408d9fa4e45538832485)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:52.051533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b0dac-7be6-4f6d-a6ae-963929187d88 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:52.057565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 41/80] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:04:51 2022] GET /identity/v3/users/5c63bf57b4e7408d9fa4e45538832485 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:52.057565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b0dac-7be6-4f6d-a6ae-963929187d88 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:52.087689 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8835690-5530-4356-a681-931033be97c3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:52.100795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:52.118091 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:52.121894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b9f81-39ae-457b-9c7a-5fc4558b9064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:52.122510 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b9f81-39ae-457b-9c7a-5fc4558b9064 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:52.122810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b9f81-39ae-457b-9c7a-5fc4558b9064 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:52.123082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b9f81-39ae-457b-9c7a-5fc4558b9064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:52.152499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b0dac-7be6-4f6d-a6ae-963929187d88 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:52.186024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0498c1-e3df-4664-abf9-561288f96412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:52.186626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0498c1-e3df-4664-abf9-561288f96412 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:52.186908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0498c1-e3df-4664-abf9-561288f96412 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:52.187212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0498c1-e3df-4664-abf9-561288f96412 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:52.187873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0498c1-e3df-4664-abf9-561288f96412 None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:52.188173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0498c1-e3df-4664-abf9-561288f96412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:52.189548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0498c1-e3df-4664-abf9-561288f96412 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:52.190597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b9f81-39ae-457b-9c7a-5fc4558b9064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:52.192259 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b9f81-39ae-457b-9c7a-5fc4558b9064 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:52.198931 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 42/81] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:04:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:52.199747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0498c1-e3df-4664-abf9-561288f96412 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:52.290638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 40/82] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:04:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:04:52.295415 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b9f81-39ae-457b-9c7a-5fc4558b9064 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:52.304645 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0498c1-e3df-4664-abf9-561288f96412 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:52.305627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:52.331373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:52.340041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099f2f7-cd0a-43eb-bdc5-b7979944a223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:52.340687 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099f2f7-cd0a-43eb-bdc5-b7979944a223 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:52.340970 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099f2f7-cd0a-43eb-bdc5-b7979944a223 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:52.341463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099f2f7-cd0a-43eb-bdc5-b7979944a223 None admin] PATH_INFO: `/v3/users/fae5f077c4984c84b963e756212a526f` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:52.342386 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099f2f7-cd0a-43eb-bdc5-b7979944a223 None admin] RBAC: Authorizing `identity:get_user(user_id=fae5f077c4984c84b963e756212a526f)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:52.343878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099f2f7-cd0a-43eb-bdc5-b7979944a223 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:52.349979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 43/83] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:04:52 2022] GET /identity/v3/users/fae5f077c4984c84b963e756212a526f => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:52.349979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099f2f7-cd0a-43eb-bdc5-b7979944a223 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:52.390610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b9f81-39ae-457b-9c7a-5fc4558b9064 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:52.428123 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374eb28-5a55-4f39-af29-ee2009474f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:52.428770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374eb28-5a55-4f39-af29-ee2009474f21 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:52.429058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374eb28-5a55-4f39-af29-ee2009474f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:52.429338 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374eb28-5a55-4f39-af29-ee2009474f21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:52.430533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374eb28-5a55-4f39-af29-ee2009474f21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:52.432022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374eb28-5a55-4f39-af29-ee2009474f21 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:52.433604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 41/84] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:04:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:52.434438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374eb28-5a55-4f39-af29-ee2009474f21 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:52.447862 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099f2f7-cd0a-43eb-bdc5-b7979944a223 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:52.482373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd93b5d-b9e0-4c90-b84d-eefab7a4baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:52.482983 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd93b5d-b9e0-4c90-b84d-eefab7a4baba None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:52.483297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd93b5d-b9e0-4c90-b84d-eefab7a4baba None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:52.483569 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd93b5d-b9e0-4c90-b84d-eefab7a4baba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:52.515421 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:52.534463 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374eb28-5a55-4f39-af29-ee2009474f21 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:52.547405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:52.554766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd93b5d-b9e0-4c90-b84d-eefab7a4baba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:52.557002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd93b5d-b9e0-4c90-b84d-eefab7a4baba None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:52.571982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eab01-2960-4847-9391-828fb8c7fec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:52.572622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eab01-2960-4847-9391-828fb8c7fec0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:52.572905 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eab01-2960-4847-9391-828fb8c7fec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:52.573208 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eab01-2960-4847-9391-828fb8c7fec0 None admin] PATH_INFO: `/v3/users/fae5f077c4984c84b963e756212a526f` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:52.574349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9eab01-2960-4847-9391-828fb8c7fec0 None admin] RBAC: Authorizing `identity:get_user(user_id=fae5f077c4984c84b963e756212a526f)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:52.575805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9eab01-2960-4847-9391-828fb8c7fec0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:52.577852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 42/85] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:04:52 2022] GET /identity/v3/users/fae5f077c4984c84b963e756212a526f => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:52.578402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eab01-2960-4847-9391-828fb8c7fec0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:52.655227 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 44/86] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:04:52.656007 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd93b5d-b9e0-4c90-b84d-eefab7a4baba None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:52.684805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eab01-2960-4847-9391-828fb8c7fec0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:52.718882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d38257-925d-4005-994e-b8ded4814936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:52.719573 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d38257-925d-4005-994e-b8ded4814936 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:52.719858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d38257-925d-4005-994e-b8ded4814936 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:52.720131 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d38257-925d-4005-994e-b8ded4814936 None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:52.721243 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d38257-925d-4005-994e-b8ded4814936 None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:52.722685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d38257-925d-4005-994e-b8ded4814936 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:52.724349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 43/87] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:04:52 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:52.725089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d38257-925d-4005-994e-b8ded4814936 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:52.747330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:52.751156 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:52.757515 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd93b5d-b9e0-4c90-b84d-eefab7a4baba None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:52.791495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c354e-604d-43e3-bb77-e96c1011a293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:52.792107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c354e-604d-43e3-bb77-e96c1011a293 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:52.792389 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c354e-604d-43e3-bb77-e96c1011a293 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:52.792672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c354e-604d-43e3-bb77-e96c1011a293 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:52.826953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d38257-925d-4005-994e-b8ded4814936 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:52.860517 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c354e-604d-43e3-bb77-e96c1011a293 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:52.860982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a952a29-5d2c-4564-afa9-c3c1fc12829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:52.861596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a952a29-5d2c-4564-afa9-c3c1fc12829c None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:52.861880 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a952a29-5d2c-4564-afa9-c3c1fc12829c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:52.861994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c354e-604d-43e3-bb77-e96c1011a293 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:52.862170 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a952a29-5d2c-4564-afa9-c3c1fc12829c None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:52.862804 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a952a29-5d2c-4564-afa9-c3c1fc12829c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:52.864276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a952a29-5d2c-4564-afa9-c3c1fc12829c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:52.885501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 44/88] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:04:52 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:04:52.886847 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a952a29-5d2c-4564-afa9-c3c1fc12829c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:52.965811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:52.973207 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 45/89] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:04:52.979725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c354e-604d-43e3-bb77-e96c1011a293 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:52.993756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:53.029542 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a952a29-5d2c-4564-afa9-c3c1fc12829c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:53.074885 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07941a6c-7a55-407f-9967-429eaf3759ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:53.075617 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07941a6c-7a55-407f-9967-429eaf3759ad None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:53.075901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07941a6c-7a55-407f-9967-429eaf3759ad None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:53.076180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07941a6c-7a55-407f-9967-429eaf3759ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:53.092352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c354e-604d-43e3-bb77-e96c1011a293 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:53.136852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73103974-d2bd-49fa-985d-d51cb7fd00ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:53.137489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73103974-d2bd-49fa-985d-d51cb7fd00ba None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:53.137773 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73103974-d2bd-49fa-985d-d51cb7fd00ba None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:53.138053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73103974-d2bd-49fa-985d-d51cb7fd00ba None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:53.139828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73103974-d2bd-49fa-985d-d51cb7fd00ba None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:53.141234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73103974-d2bd-49fa-985d-d51cb7fd00ba None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:53.147298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 46/90] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:04:52 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:53.147298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73103974-d2bd-49fa-985d-d51cb7fd00ba None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:53.163218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07941a6c-7a55-407f-9967-429eaf3759ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:53.165029 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07941a6c-7a55-407f-9967-429eaf3759ad None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:53.228441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:53.272768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:53.278319 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73103974-d2bd-49fa-985d-d51cb7fd00ba None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:53.309481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 45/91] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:04:53.310749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07941a6c-7a55-407f-9967-429eaf3759ad None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:53.321621 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea1b05-875b-4bf5-8a4a-2cf9c48cac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:53.322246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea1b05-875b-4bf5-8a4a-2cf9c48cac20 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:53.322638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea1b05-875b-4bf5-8a4a-2cf9c48cac20 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:53.322923 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea1b05-875b-4bf5-8a4a-2cf9c48cac20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:53.323732 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea1b05-875b-4bf5-8a4a-2cf9c48cac20 None admin] RBAC: Adding query filter params (role.id=6ce9c4ba7196458380036520a04c9404, scope.project.id=22ce08feb9bd450698aac43ae261b3c3, user.id=fae5f077c4984c84b963e756212a526f) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:53.324048 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea1b05-875b-4bf5-8a4a-2cf9c48cac20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:53.325695 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea1b05-875b-4bf5-8a4a-2cf9c48cac20 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:53.332152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 47/92] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:04:53 2022] GET /identity/v3/role_assignments?user.id=fae5f077c4984c84b963e756212a526f&scope.project.id=22ce08feb9bd450698aac43ae261b3c3&role.id=6ce9c4ba7196458380036520a04c9404 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:53.332792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea1b05-875b-4bf5-8a4a-2cf9c48cac20 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:53.439122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07941a6c-7a55-407f-9967-429eaf3759ad None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:53.467254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea1b05-875b-4bf5-8a4a-2cf9c48cac20 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:53.486739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf98170-1ddb-4b7b-b049-78f6dcb92a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:53.488500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf98170-1ddb-4b7b-b049-78f6dcb92a06 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:53.488805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf98170-1ddb-4b7b-b049-78f6dcb92a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:53.489970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf98170-1ddb-4b7b-b049-78f6dcb92a06 None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:53.493703 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf98170-1ddb-4b7b-b049-78f6dcb92a06 None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:53.495227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf98170-1ddb-4b7b-b049-78f6dcb92a06 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:53.497152 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 46/93] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:04:53 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:53.497774 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf98170-1ddb-4b7b-b049-78f6dcb92a06 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:53.524926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:53.535558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ba3ab-0b59-46c8-8649-092f9af7d26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:53.537196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ba3ab-0b59-46c8-8649-092f9af7d26a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:53.537486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ba3ab-0b59-46c8-8649-092f9af7d26a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:53.538686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ba3ab-0b59-46c8-8649-092f9af7d26a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:53.539548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ba3ab-0b59-46c8-8649-092f9af7d26a None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=22ce08feb9bd450698aac43ae261b3c3, user.id=5c63bf57b4e7408d9fa4e45538832485) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:53.539866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ba3ab-0b59-46c8-8649-092f9af7d26a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:53.541683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ba3ab-0b59-46c8-8649-092f9af7d26a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:53.560892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 48/94] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:04:53 2022] GET /identity/v3/role_assignments?user.id=5c63bf57b4e7408d9fa4e45538832485&scope.project.id=22ce08feb9bd450698aac43ae261b3c3&role.id=3799feb4caa64e568971222375957f54 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:53.562505 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ba3ab-0b59-46c8-8649-092f9af7d26a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:53.578391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:53.647138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf98170-1ddb-4b7b-b049-78f6dcb92a06 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:53.690900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513854f-9e55-4bfe-b50f-00eec53fc972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:53.691668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513854f-9e55-4bfe-b50f-00eec53fc972 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:53.691872 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513854f-9e55-4bfe-b50f-00eec53fc972 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:53.692153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513854f-9e55-4bfe-b50f-00eec53fc972 None admin] PATH_INFO: `/v3/projects/aa573b9e7c5040ff8a9acfed6adb9624` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:53.693493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513854f-9e55-4bfe-b50f-00eec53fc972 None admin] RBAC: Authorizing `identity:get_project(project_id=aa573b9e7c5040ff8a9acfed6adb9624)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:53.694964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513854f-9e55-4bfe-b50f-00eec53fc972 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:53.702263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 47/95] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:04:53 2022] GET /identity/v3/projects/aa573b9e7c5040ff8a9acfed6adb9624 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:53.713541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513854f-9e55-4bfe-b50f-00eec53fc972 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:53.795790 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ba3ab-0b59-46c8-8649-092f9af7d26a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:53.833906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513854f-9e55-4bfe-b50f-00eec53fc972 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:53.846403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:53.852569 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042dea9-e9b0-4121-980b-b0f49f6f2276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:53.853208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042dea9-e9b0-4121-980b-b0f49f6f2276 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:53.853491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042dea9-e9b0-4121-980b-b0f49f6f2276 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:53.853767 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042dea9-e9b0-4121-980b-b0f49f6f2276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:53.854514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042dea9-e9b0-4121-980b-b0f49f6f2276 None admin] RBAC: Adding query filter params (role.id=6f1196f44c2040ee86de4a614692041d, scope.project.id=22ce08feb9bd450698aac43ae261b3c3, user.id=fae5f077c4984c84b963e756212a526f) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:53.854824 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042dea9-e9b0-4121-980b-b0f49f6f2276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:53.856404 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042dea9-e9b0-4121-980b-b0f49f6f2276 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:53.862529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 49/96] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:04:53 2022] GET /identity/v3/role_assignments?user.id=fae5f077c4984c84b963e756212a526f&scope.project.id=22ce08feb9bd450698aac43ae261b3c3&role.id=6f1196f44c2040ee86de4a614692041d => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:53.880774 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5895f-d66d-4eca-9ff9-100d84e00eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:53.881468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5895f-d66d-4eca-9ff9-100d84e00eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:53.881760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5895f-d66d-4eca-9ff9-100d84e00eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:53.882037 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5895f-d66d-4eca-9ff9-100d84e00eb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:53.883663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5895f-d66d-4eca-9ff9-100d84e00eb1 None admin] RBAC: Adding query filter params (role.id=6ce9c4ba7196458380036520a04c9404, scope.project.id=aa573b9e7c5040ff8a9acfed6adb9624, user.id=fae5f077c4984c84b963e756212a526f) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:53.883968 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5895f-d66d-4eca-9ff9-100d84e00eb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:53.885685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5895f-d66d-4eca-9ff9-100d84e00eb1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:53.897127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 48/97] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:04:53 2022] GET /identity/v3/role_assignments?user.id=fae5f077c4984c84b963e756212a526f&scope.project.id=aa573b9e7c5040ff8a9acfed6adb9624&role.id=6ce9c4ba7196458380036520a04c9404 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:04:55.797810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b998437-a7ed-48a3-8c9f-f4ff305885c6 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:55.798852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b998437-a7ed-48a3-8c9f-f4ff305885c6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:55.799366 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b998437-a7ed-48a3-8c9f-f4ff305885c6 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:55.800926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 50/98] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:55.807088 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bdeb6-9249-40da-9149-2f86003a927d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:55.807996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bdeb6-9249-40da-9149-2f86003a927d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:55.808498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bdeb6-9249-40da-9149-2f86003a927d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:55.836418 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-038bdeb6-9249-40da-9149-2f86003a927d None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:55.837995 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-038bdeb6-9249-40da-9149-2f86003a927d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:55.919853 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 49/99] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:04:56.284084 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ded8e-6e3f-4dc1-b5dd-9c0cb1d214a4 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:56.284767 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ded8e-6e3f-4dc1-b5dd-9c0cb1d214a4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:56.285257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ded8e-6e3f-4dc1-b5dd-9c0cb1d214a4 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:56.286816 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 51/100] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:56.292971 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3f7c0-658d-4caf-b217-88852c4bb771 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:56.293486 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3f7c0-658d-4caf-b217-88852c4bb771 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:56.293984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3f7c0-658d-4caf-b217-88852c4bb771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:56.318663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b3f3f7c0-658d-4caf-b217-88852c4bb771 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:56.320767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b3f3f7c0-658d-4caf-b217-88852c4bb771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:56.349409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c0804-1ec9-482a-a575-ba858b7863ef None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:56.349696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c0804-1ec9-482a-a575-ba858b7863ef None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:56.350016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c0804-1ec9-482a-a575-ba858b7863ef None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:56.351707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 52/101] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:56.356718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ca5b9-6f8e-40a8-9167-2c83ba5cbe6c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:56.357012 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ca5b9-6f8e-40a8-9167-2c83ba5cbe6c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:56.357297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ca5b9-6f8e-40a8-9167-2c83ba5cbe6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:56.386190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0e5ca5b9-6f8e-40a8-9167-2c83ba5cbe6c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:56.392263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0e5ca5b9-6f8e-40a8-9167-2c83ba5cbe6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:56.463281 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 50/102] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:04:56.464704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3f7c0-658d-4caf-b217-88852c4bb771 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:56.512711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:56.519524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:56.551462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 53/103] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:04:56.614677 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c701a-a0a6-4a45-a1ba-3582a4b83503 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:56.614988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c701a-a0a6-4a45-a1ba-3582a4b83503 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:56.615269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c701a-a0a6-4a45-a1ba-3582a4b83503 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:56.616760 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 54/104] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:04:56.622598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3f7c0-658d-4caf-b217-88852c4bb771 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:56.629252 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42717b65-b9a9-467c-8af0-c8d0a02cce6a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:56.629589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42717b65-b9a9-467c-8af0-c8d0a02cce6a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:56.629867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42717b65-b9a9-467c-8af0-c8d0a02cce6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:56.656326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-42717b65-b9a9-467c-8af0-c8d0a02cce6a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:56.657531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-42717b65-b9a9-467c-8af0-c8d0a02cce6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:56.704832 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90d0f0-8908-40f0-899d-fc5a028ef434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:56.706534 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90d0f0-8908-40f0-899d-fc5a028ef434 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:56.708340 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90d0f0-8908-40f0-899d-fc5a028ef434 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:56.708834 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90d0f0-8908-40f0-899d-fc5a028ef434 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:56.733215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90d0f0-8908-40f0-899d-fc5a028ef434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0b90d0f0-8908-40f0-899d-fc5a028ef434 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:04:56.740891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:04:56.741733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:04:56.742582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:04:56.742582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:04:56.742582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:04:56.742582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:04:56.742582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:04:56.742582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:04:56.742582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:04:56.742582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:04:56.742582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:04:56.742582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:04:56.742582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:04:56.742582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:04:56.749840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 51/105] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:04:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:04:56.754633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90d0f0-8908-40f0-899d-fc5a028ef434 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:56.805997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 55/106] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:04:56.888770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42717b65-b9a9-467c-8af0-c8d0a02cce6a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:56.918562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:56.925285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90d0f0-8908-40f0-899d-fc5a028ef434 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:56.979166 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d9233-0944-4702-9e3c-6fcb476bdc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:56.979787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d9233-0944-4702-9e3c-6fcb476bdc8d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:56.980067 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d9233-0944-4702-9e3c-6fcb476bdc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:56.980341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d9233-0944-4702-9e3c-6fcb476bdc8d None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:56.981015 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d9233-0944-4702-9e3c-6fcb476bdc8d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:56.981318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d9233-0944-4702-9e3c-6fcb476bdc8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:56.982726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d9233-0944-4702-9e3c-6fcb476bdc8d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:56.995811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 52/107] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:04:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:56.997626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d9233-0944-4702-9e3c-6fcb476bdc8d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:57.100845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42717b65-b9a9-467c-8af0-c8d0a02cce6a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:57.105559 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d9233-0944-4702-9e3c-6fcb476bdc8d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:57.134591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:57.143089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72742659-9fcb-4af1-8a51-de1ed6276cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:57.143089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72742659-9fcb-4af1-8a51-de1ed6276cae None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:57.143089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72742659-9fcb-4af1-8a51-de1ed6276cae None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:57.143089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72742659-9fcb-4af1-8a51-de1ed6276cae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:57.143425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72742659-9fcb-4af1-8a51-de1ed6276cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:57.144513 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72742659-9fcb-4af1-8a51-de1ed6276cae None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:57.146087 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 53/108] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:04:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:57.151520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72742659-9fcb-4af1-8a51-de1ed6276cae None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:57.177335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b728ae-2dcb-4022-934f-3b11d18c4e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:57.177996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b728ae-2dcb-4022-934f-3b11d18c4e4e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:57.178275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b728ae-2dcb-4022-934f-3b11d18c4e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:57.178544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b728ae-2dcb-4022-934f-3b11d18c4e4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:57.195654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:57.209535 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b728ae-2dcb-4022-934f-3b11d18c4e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-26b728ae-2dcb-4022-934f-3b11d18c4e4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:04:57.215321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:04:57.216228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:04:57.216984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:04:57.216984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:04:57.216984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:04:57.216984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:04:57.216984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:04:57.216984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:04:57.216984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:04:57.216984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:04:57.216984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:04:57.216984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:04:57.216984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:04:57.216984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:04:57.221556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 56/109] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:04:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:04:57.222395 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b728ae-2dcb-4022-934f-3b11d18c4e4e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:57.292122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72742659-9fcb-4af1-8a51-de1ed6276cae None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:57.328013 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e0161-1285-443e-9308-1edacab98342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:57.328652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e0161-1285-443e-9308-1edacab98342 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:57.328937 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e0161-1285-443e-9308-1edacab98342 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:57.329214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e0161-1285-443e-9308-1edacab98342 None admin] PATH_INFO: `/v3/users/631d1b739389448f84d4034847b40a16` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:57.343758 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e0161-1285-443e-9308-1edacab98342 None admin] RBAC: Authorizing `identity:get_user(user_id=631d1b739389448f84d4034847b40a16)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:57.343934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b728ae-2dcb-4022-934f-3b11d18c4e4e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:57.345301 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e0161-1285-443e-9308-1edacab98342 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:57.347128 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 54/110] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:04:57 2022] GET /identity/v3/users/631d1b739389448f84d4034847b40a16 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:57.352368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e0161-1285-443e-9308-1edacab98342 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:57.384156 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903c8bb-9b4a-4ad6-929e-f7217c5d9fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:57.385233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903c8bb-9b4a-4ad6-929e-f7217c5d9fb8 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:57.385799 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903c8bb-9b4a-4ad6-929e-f7217c5d9fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:57.386162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903c8bb-9b4a-4ad6-929e-f7217c5d9fb8 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:57.386841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903c8bb-9b4a-4ad6-929e-f7217c5d9fb8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:57.388736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903c8bb-9b4a-4ad6-929e-f7217c5d9fb8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:57.417369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 57/111] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 13 01:04:57 2022] POST /identity/v3/projects => generated 302 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:04:57.428153 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903c8bb-9b4a-4ad6-929e-f7217c5d9fb8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:57.452840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:57.474040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e0161-1285-443e-9308-1edacab98342 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:57.479095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:57.517209 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05492d-48c7-40fd-a19b-9a227f25c53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:57.518272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05492d-48c7-40fd-a19b-9a227f25c53c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:57.518616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05492d-48c7-40fd-a19b-9a227f25c53c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:57.518905 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05492d-48c7-40fd-a19b-9a227f25c53c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:57.532036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05492d-48c7-40fd-a19b-9a227f25c53c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0c05492d-48c7-40fd-a19b-9a227f25c53c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:04:57.537314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:04:57.538264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:04:57.539658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:04:57.539658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:04:57.539658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:04:57.539658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:04:57.539658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:04:57.539658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:04:57.539658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:04:57.539658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:04:57.539658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:04:57.539658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:04:57.539658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:04:57.539658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:04:57.539658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 55/112] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:04:57.545451 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dc908-354c-436c-ac61-037b83bd303d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:57.545789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dc908-354c-436c-ac61-037b83bd303d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:57.546022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dc908-354c-436c-ac61-037b83bd303d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:57.551160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 56/113] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:57.551160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dc908-354c-436c-ac61-037b83bd303d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:57.599545 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903c8bb-9b4a-4ad6-929e-f7217c5d9fb8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:57.642856 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c59528-ef84-4cfd-acc5-69d35f78cb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:57.643451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c59528-ef84-4cfd-acc5-69d35f78cb4d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:57.643737 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c59528-ef84-4cfd-acc5-69d35f78cb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:57.644018 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c59528-ef84-4cfd-acc5-69d35f78cb4d None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:57.644736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c59528-ef84-4cfd-acc5-69d35f78cb4d None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:57.645001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c59528-ef84-4cfd-acc5-69d35f78cb4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:57.646387 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c59528-ef84-4cfd-acc5-69d35f78cb4d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:57.655816 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 58/114] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:04:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:57.656647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c59528-ef84-4cfd-acc5-69d35f78cb4d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:57.683482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dc908-354c-436c-ac61-037b83bd303d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:57.718835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd150b7-5af2-4beb-866d-b7995946a5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:57.719472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd150b7-5af2-4beb-866d-b7995946a5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:57.719752 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd150b7-5af2-4beb-866d-b7995946a5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:57.720026 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd150b7-5af2-4beb-866d-b7995946a5c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:57.732563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:57.764787 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:57.776973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c59528-ef84-4cfd-acc5-69d35f78cb4d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:57.793676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd150b7-5af2-4beb-866d-b7995946a5c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:57.795186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd150b7-5af2-4beb-866d-b7995946a5c6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:57.812473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b5516-84f0-49e9-b898-9a11ecdf1f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:57.813102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b5516-84f0-49e9-b898-9a11ecdf1f38 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:57.813362 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b5516-84f0-49e9-b898-9a11ecdf1f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:57.813632 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b5516-84f0-49e9-b898-9a11ecdf1f38 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:57.814302 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b5516-84f0-49e9-b898-9a11ecdf1f38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:57.814608 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b5516-84f0-49e9-b898-9a11ecdf1f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:57.816018 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b5516-84f0-49e9-b898-9a11ecdf1f38 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:57.825089 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 59/115] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:57.826313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78870a92-074f-4872-b79b-2b47cd680fa1 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:57.826576 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78870a92-074f-4872-b79b-2b47cd680fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:57.827221 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78870a92-074f-4872-b79b-2b47cd680fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:57.849452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-78870a92-074f-4872-b79b-2b47cd680fa1 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:57.850661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-78870a92-074f-4872-b79b-2b47cd680fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:57.909413 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 57/116] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:04:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:04:57.910619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bab978-2864-43c8-a307-0d588c5701d7 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:57.910911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bab978-2864-43c8-a307-0d588c5701d7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:57.911225 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bab978-2864-43c8-a307-0d588c5701d7 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:57.912553 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 58/117] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:04:57.913251 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bab978-2864-43c8-a307-0d588c5701d7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:57.931461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 60/118] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:04:57.943336 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78870a92-074f-4872-b79b-2b47cd680fa1 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:57.964134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:58.028097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bab978-2864-43c8-a307-0d588c5701d7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:58.055277 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:58.069465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175dd91-e78b-45bc-9b02-08c6206c97cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:58.070745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175dd91-e78b-45bc-9b02-08c6206c97cb None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:58.071598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175dd91-e78b-45bc-9b02-08c6206c97cb None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:58.072324 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175dd91-e78b-45bc-9b02-08c6206c97cb None admin] PATH_INFO: `/v3/users/fae5f077c4984c84b963e756212a526f` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:58.074274 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175dd91-e78b-45bc-9b02-08c6206c97cb None admin] RBAC: Authorizing `identity:get_user(user_id=fae5f077c4984c84b963e756212a526f)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:58.076220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175dd91-e78b-45bc-9b02-08c6206c97cb None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:58.077081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78870a92-074f-4872-b79b-2b47cd680fa1 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:58.078848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 59/119] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:04:57 2022] GET /identity/v3/users/fae5f077c4984c84b963e756212a526f => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:58.080765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175dd91-e78b-45bc-9b02-08c6206c97cb None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:58.117786 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812f1e8-e4b3-4b1e-b355-511811b2de2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:58.118421 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812f1e8-e4b3-4b1e-b355-511811b2de2a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:58.118698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812f1e8-e4b3-4b1e-b355-511811b2de2a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:58.118971 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812f1e8-e4b3-4b1e-b355-511811b2de2a None admin] PATH_INFO: `/v3/users/5c63bf57b4e7408d9fa4e45538832485` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:58.120245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812f1e8-e4b3-4b1e-b355-511811b2de2a None admin] RBAC: Authorizing `identity:get_user(user_id=5c63bf57b4e7408d9fa4e45538832485)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:58.121688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812f1e8-e4b3-4b1e-b355-511811b2de2a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:58.123293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 61/120] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:04:57 2022] GET /identity/v3/users/5c63bf57b4e7408d9fa4e45538832485 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:58.127792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed05e51-5372-4cef-991b-2acb8563c099 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:58.127792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed05e51-5372-4cef-991b-2acb8563c099 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:58.127792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed05e51-5372-4cef-991b-2acb8563c099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:58.144460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4ed05e51-5372-4cef-991b-2acb8563c099 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:04:58.145646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4ed05e51-5372-4cef-991b-2acb8563c099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:04:58.217834 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 62/121] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:04:58.218612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed05e51-5372-4cef-991b-2acb8563c099 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:58.227840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175dd91-e78b-45bc-9b02-08c6206c97cb None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:58.243134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:58.270362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9404cf-da0d-4d99-8d23-b135af9117bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:58.271546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9404cf-da0d-4d99-8d23-b135af9117bd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:58.271913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9404cf-da0d-4d99-8d23-b135af9117bd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:58.272268 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9404cf-da0d-4d99-8d23-b135af9117bd None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:58.273621 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9404cf-da0d-4d99-8d23-b135af9117bd None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:58.275761 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9404cf-da0d-4d99-8d23-b135af9117bd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:58.278073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 60/122] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:04:58 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:58.278868 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9404cf-da0d-4d99-8d23-b135af9117bd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:58.322572 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:58.326100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed05e51-5372-4cef-991b-2acb8563c099 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:58.372033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878f180-f4ac-411e-b9ec-b6112413688e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:58.372775 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878f180-f4ac-411e-b9ec-b6112413688e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:58.373058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878f180-f4ac-411e-b9ec-b6112413688e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:58.373334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878f180-f4ac-411e-b9ec-b6112413688e None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:58.375287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878f180-f4ac-411e-b9ec-b6112413688e None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:58.378368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878f180-f4ac-411e-b9ec-b6112413688e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:58.381583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 63/123] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:04:58 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:58.383789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878f180-f4ac-411e-b9ec-b6112413688e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:58.402996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9404cf-da0d-4d99-8d23-b135af9117bd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:58.449037 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabd80e-6151-4c5a-a84d-9503f7e809f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:58.449684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabd80e-6151-4c5a-a84d-9503f7e809f4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:58.449952 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabd80e-6151-4c5a-a84d-9503f7e809f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:58.450280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabd80e-6151-4c5a-a84d-9503f7e809f4 None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:58.451644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabd80e-6151-4c5a-a84d-9503f7e809f4 None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:58.453984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabd80e-6151-4c5a-a84d-9503f7e809f4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:58.456112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 61/124] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:04:58 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:58.456725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabd80e-6151-4c5a-a84d-9503f7e809f4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:58.512827 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878f180-f4ac-411e-b9ec-b6112413688e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:58.517517 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:58.551751 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab4a32-a31b-4e76-80ba-6cbc674ea6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:58.552381 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab4a32-a31b-4e76-80ba-6cbc674ea6fe None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:58.552660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab4a32-a31b-4e76-80ba-6cbc674ea6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:58.552934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab4a32-a31b-4e76-80ba-6cbc674ea6fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:58.563741 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab4a32-a31b-4e76-80ba-6cbc674ea6fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-0fab4a32-a31b-4e76-80ba-6cbc674ea6fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:04:58.568536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:04:58.569379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:04:58.571941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:04:58.571941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:04:58.571941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:04:58.571941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:04:58.571941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:04:58.571941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:04:58.571941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:04:58.571941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:04:58.571941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:04:58.571941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:04:58.571941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:04:58.571941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:04:58.571941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 64/125] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:04:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:04:58.571941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab4a32-a31b-4e76-80ba-6cbc674ea6fe None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:58.582695 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:58.584949 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabd80e-6151-4c5a-a84d-9503f7e809f4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:58.624697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0f56b-5141-49c3-bc4d-cf8920206f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:58.625324 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0f56b-5141-49c3-bc4d-cf8920206f63 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:58.625605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0f56b-5141-49c3-bc4d-cf8920206f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:58.625884 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0f56b-5141-49c3-bc4d-cf8920206f63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:58.626616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0f56b-5141-49c3-bc4d-cf8920206f63 None admin] RBAC: Adding query filter params (role.id=0a3b51ca53dc4d88b4be340e21144870, scope.project.id=22ce08feb9bd450698aac43ae261b3c3, user.id=631d1b739389448f84d4034847b40a16) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:58.626927 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0f56b-5141-49c3-bc4d-cf8920206f63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:58.628402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0f56b-5141-49c3-bc4d-cf8920206f63 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:58.634439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 62/126] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:04:58 2022] GET /identity/v3/role_assignments?user.id=631d1b739389448f84d4034847b40a16&scope.project.id=22ce08feb9bd450698aac43ae261b3c3&role.id=0a3b51ca53dc4d88b4be340e21144870 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:58.636044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0f56b-5141-49c3-bc4d-cf8920206f63 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:58.699913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab4a32-a31b-4e76-80ba-6cbc674ea6fe None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:58.753665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0fea9-b738-45be-b286-3cd4189a0a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:58.754348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0fea9-b738-45be-b286-3cd4189a0a7f None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:58.754631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0fea9-b738-45be-b286-3cd4189a0a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:58.754914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0fea9-b738-45be-b286-3cd4189a0a7f None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3/users/fae5f077c4984c84b963e756212a526f/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:58.756973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0fea9-b738-45be-b286-3cd4189a0a7f None admin] RBAC: Authorizing `identity:create_grant(project_id=22ce08feb9bd450698aac43ae261b3c3, user_id=fae5f077c4984c84b963e756212a526f, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:58.758653 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0fea9-b738-45be-b286-3cd4189a0a7f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:58.772238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0f56b-5141-49c3-bc4d-cf8920206f63 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:58.779986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 65/127] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:04:58 2022] PUT /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3/users/fae5f077c4984c84b963e756212a526f/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:04:58.781098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0fea9-b738-45be-b286-3cd4189a0a7f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:58.787629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:58.819988 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff375289-eab0-4e16-86dc-70263658c4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:58.820719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff375289-eab0-4e16-86dc-70263658c4c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:58.821036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff375289-eab0-4e16-86dc-70263658c4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:58.821394 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff375289-eab0-4e16-86dc-70263658c4c3 None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3/users/5c63bf57b4e7408d9fa4e45538832485/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:58.823751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff375289-eab0-4e16-86dc-70263658c4c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=22ce08feb9bd450698aac43ae261b3c3, user_id=5c63bf57b4e7408d9fa4e45538832485, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:58.825366 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff375289-eab0-4e16-86dc-70263658c4c3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:58.857038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 63/128] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:04:58 2022] PUT /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3/users/5c63bf57b4e7408d9fa4e45538832485/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:04:58.857913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff375289-eab0-4e16-86dc-70263658c4c3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:58.868567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:58.922043 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0fea9-b738-45be-b286-3cd4189a0a7f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:58.971601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d71cb-198a-4994-8ffb-0bff49cc6bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:58.972864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d71cb-198a-4994-8ffb-0bff49cc6bcb None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:58.973406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d71cb-198a-4994-8ffb-0bff49cc6bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:58.973926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d71cb-198a-4994-8ffb-0bff49cc6bcb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:58.989767 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d71cb-198a-4994-8ffb-0bff49cc6bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-638d71cb-198a-4994-8ffb-0bff49cc6bcb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:04:58.997364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:04:58.998426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:04:58.999216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:04:58.999216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:04:58.999216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:04:58.999216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:04:58.999216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:04:58.999216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:04:58.999216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:04:58.999216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:04:58.999216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:04:58.999216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:04:58.999216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:04:58.999216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:04:59.001881 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 66/129] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:04:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:04:59.008663 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d71cb-198a-4994-8ffb-0bff49cc6bcb None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:59.029638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff375289-eab0-4e16-86dc-70263658c4c3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:59.082053 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713e948-886b-496b-ab87-5711ec9fa70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:59.083546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713e948-886b-496b-ab87-5711ec9fa70b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:59.084306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713e948-886b-496b-ab87-5711ec9fa70b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:59.084783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713e948-886b-496b-ab87-5711ec9fa70b None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:59.086172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713e948-886b-496b-ab87-5711ec9fa70b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:59.086714 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713e948-886b-496b-ab87-5711ec9fa70b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:59.088366 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713e948-886b-496b-ab87-5711ec9fa70b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:59.099088 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 64/130] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:04:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:59.110632 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713e948-886b-496b-ab87-5711ec9fa70b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:59.148197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d71cb-198a-4994-8ffb-0bff49cc6bcb None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:59.152675 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:59.179513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:59.189524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d860a9-772a-43d0-91dd-87338add88d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:59.190167 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d860a9-772a-43d0-91dd-87338add88d6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:59.190846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d860a9-772a-43d0-91dd-87338add88d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:59.191181 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d860a9-772a-43d0-91dd-87338add88d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:59.192617 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d860a9-772a-43d0-91dd-87338add88d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:04:59.193328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d860a9-772a-43d0-91dd-87338add88d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:59.196222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d860a9-772a-43d0-91dd-87338add88d6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:59.208499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 67/131] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:04:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:04:59.215618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d860a9-772a-43d0-91dd-87338add88d6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:59.240213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713e948-886b-496b-ab87-5711ec9fa70b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:59.286713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120b4ee-7d93-48cc-b0ac-7c5d96b752dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:59.287754 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120b4ee-7d93-48cc-b0ac-7c5d96b752dd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:59.288234 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120b4ee-7d93-48cc-b0ac-7c5d96b752dd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:59.289229 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120b4ee-7d93-48cc-b0ac-7c5d96b752dd None admin] PATH_INFO: `/v3/users/fae5f077c4984c84b963e756212a526f` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:59.290749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120b4ee-7d93-48cc-b0ac-7c5d96b752dd None admin] RBAC: Authorizing `identity:get_user(user_id=fae5f077c4984c84b963e756212a526f)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:59.292507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120b4ee-7d93-48cc-b0ac-7c5d96b752dd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:59.296299 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 65/132] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:04:59 2022] GET /identity/v3/users/fae5f077c4984c84b963e756212a526f => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:59.306043 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120b4ee-7d93-48cc-b0ac-7c5d96b752dd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:59.357865 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d860a9-772a-43d0-91dd-87338add88d6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:59.404275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776dc5c-349b-49de-9e7e-b5f676fe11ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:59.405697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776dc5c-349b-49de-9e7e-b5f676fe11ad None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:59.406260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776dc5c-349b-49de-9e7e-b5f676fe11ad None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:59.406753 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776dc5c-349b-49de-9e7e-b5f676fe11ad None admin] PATH_INFO: `/v3/users/fae5f077c4984c84b963e756212a526f` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:59.408196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776dc5c-349b-49de-9e7e-b5f676fe11ad None admin] RBAC: Authorizing `identity:get_user(user_id=fae5f077c4984c84b963e756212a526f)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:59.410577 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776dc5c-349b-49de-9e7e-b5f676fe11ad None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:59.413229 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 68/133] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:04:59 2022] GET /identity/v3/users/fae5f077c4984c84b963e756212a526f => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:59.421038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776dc5c-349b-49de-9e7e-b5f676fe11ad None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:59.428448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:59.433110 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120b4ee-7d93-48cc-b0ac-7c5d96b752dd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:59.485592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a85f4-5090-4248-8259-fa35e05cd842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:59.486481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a85f4-5090-4248-8259-fa35e05cd842 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:59.486929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a85f4-5090-4248-8259-fa35e05cd842 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:59.487361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a85f4-5090-4248-8259-fa35e05cd842 None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:59.488689 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a85f4-5090-4248-8259-fa35e05cd842 None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:59.490380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a85f4-5090-4248-8259-fa35e05cd842 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:59.493096 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 66/134] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:04:59 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:04:59.499854 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a85f4-5090-4248-8259-fa35e05cd842 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:59.502503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:59.569050 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776dc5c-349b-49de-9e7e-b5f676fe11ad None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:59.610561 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe93d0a-c5a1-49f8-b984-102c708800ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:59.611723 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe93d0a-c5a1-49f8-b984-102c708800ac None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:59.612184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe93d0a-c5a1-49f8-b984-102c708800ac None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:59.612689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe93d0a-c5a1-49f8-b984-102c708800ac None admin] PATH_INFO: `/v3/projects/aa573b9e7c5040ff8a9acfed6adb9624` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:59.613981 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe93d0a-c5a1-49f8-b984-102c708800ac None admin] RBAC: Authorizing `identity:get_project(project_id=aa573b9e7c5040ff8a9acfed6adb9624)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:59.615639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe93d0a-c5a1-49f8-b984-102c708800ac None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:59.618706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 69/135] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:04:59 2022] GET /identity/v3/projects/aa573b9e7c5040ff8a9acfed6adb9624 => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:04:59.624977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe93d0a-c5a1-49f8-b984-102c708800ac None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:04:59.698619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a85f4-5090-4248-8259-fa35e05cd842 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:59.739622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92ceee-a5f5-4010-b4c7-1c4f577dd1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:59.740565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92ceee-a5f5-4010-b4c7-1c4f577dd1e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:59.741014 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92ceee-a5f5-4010-b4c7-1c4f577dd1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:59.741447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92ceee-a5f5-4010-b4c7-1c4f577dd1e5 None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3/users/fae5f077c4984c84b963e756212a526f/roles/6f1196f44c2040ee86de4a614692041d` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:59.744031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b92ceee-a5f5-4010-b4c7-1c4f577dd1e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=22ce08feb9bd450698aac43ae261b3c3, user_id=fae5f077c4984c84b963e756212a526f, role_id=6f1196f44c2040ee86de4a614692041d)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:59.746023 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b92ceee-a5f5-4010-b4c7-1c4f577dd1e5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:59.761797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 67/136] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:04:59 2022] PUT /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3/users/fae5f077c4984c84b963e756212a526f/roles/6f1196f44c2040ee86de4a614692041d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:04:59.819516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe93d0a-c5a1-49f8-b984-102c708800ac None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:04:59.850050 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:04:59.865044 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc701989-bb6c-4120-988a-d1a2ff2b9209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:04:59.865805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc701989-bb6c-4120-988a-d1a2ff2b9209 None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:04:59.866087 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc701989-bb6c-4120-988a-d1a2ff2b9209 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:04:59.866363 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc701989-bb6c-4120-988a-d1a2ff2b9209 None admin] PATH_INFO: `/v3/projects/aa573b9e7c5040ff8a9acfed6adb9624/users/fae5f077c4984c84b963e756212a526f/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:04:59.868911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc701989-bb6c-4120-988a-d1a2ff2b9209 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa573b9e7c5040ff8a9acfed6adb9624, user_id=fae5f077c4984c84b963e756212a526f, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:04:59.870453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc701989-bb6c-4120-988a-d1a2ff2b9209 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:04:59.897793 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 70/137] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:04:59 2022] PUT /identity/v3/projects/aa573b9e7c5040ff8a9acfed6adb9624/users/fae5f077c4984c84b963e756212a526f/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:05:00.177075 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19a03a-f4ed-458d-819c-2151ebc1178a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:00.178183 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19a03a-f4ed-458d-819c-2151ebc1178a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:00.178688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19a03a-f4ed-458d-819c-2151ebc1178a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:00.181338 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 68/138] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:00.187165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54dff-c21f-4ae9-8331-4b6d0b2eddf6 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:00.187718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54dff-c21f-4ae9-8331-4b6d0b2eddf6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:00.188207 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54dff-c21f-4ae9-8331-4b6d0b2eddf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:00.208493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c3a54dff-c21f-4ae9-8331-4b6d0b2eddf6 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:00.210070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c3a54dff-c21f-4ae9-8331-4b6d0b2eddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:00.286012 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 71/139] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:00.794533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19a03a-f4ed-458d-819c-2151ebc1178a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:00.830400 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:00.910270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19a03a-f4ed-458d-819c-2151ebc1178a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:00.947228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d1fa3-b03b-468b-b7a6-329ff98a9ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:00.948271 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d1fa3-b03b-468b-b7a6-329ff98a9ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:00.948764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d1fa3-b03b-468b-b7a6-329ff98a9ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:00.949257 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d1fa3-b03b-468b-b7a6-329ff98a9ed5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:00.950574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d1fa3-b03b-468b-b7a6-329ff98a9ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:00.952722 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d1fa3-b03b-468b-b7a6-329ff98a9ed5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:00.954792 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 69/140] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:00.961133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a54dff-c21f-4ae9-8331-4b6d0b2eddf6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:01.083497 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a54dff-c21f-4ae9-8331-4b6d0b2eddf6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:01.104583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:01.126696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482400a-f59d-4302-840b-d282e39d1eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:01.127685 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482400a-f59d-4302-840b-d282e39d1eb2 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:01.128187 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482400a-f59d-4302-840b-d282e39d1eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:01.128672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482400a-f59d-4302-840b-d282e39d1eb2 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:01.129598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482400a-f59d-4302-840b-d282e39d1eb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:01.131288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482400a-f59d-4302-840b-d282e39d1eb2 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:01.162580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 72/141] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:05:00 2022] POST /identity/v3/users => generated 283 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:05:01.921580 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56506dc-bf64-41ea-8dff-ca58edae5774 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:01.922611 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56506dc-bf64-41ea-8dff-ca58edae5774 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:01.923126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56506dc-bf64-41ea-8dff-ca58edae5774 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:01.924699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 70/142] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:01.931790 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51043e2f-cc1d-4cb0-8e50-ad20767e8762 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:01.932361 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51043e2f-cc1d-4cb0-8e50-ad20767e8762 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:01.932861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51043e2f-cc1d-4cb0-8e50-ad20767e8762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:01.952928 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-51043e2f-cc1d-4cb0-8e50-ad20767e8762 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:01.954470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-51043e2f-cc1d-4cb0-8e50-ad20767e8762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:01.967586 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6fd0e-c9d4-4397-914d-c6ca84dba1f7 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:01.968619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6fd0e-c9d4-4397-914d-c6ca84dba1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:01.969125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6fd0e-c9d4-4397-914d-c6ca84dba1f7 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:01.970688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 71/143] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:05:01.982458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda395a-5d6b-4535-ac91-7243648d0dab None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:01.982735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda395a-5d6b-4535-ac91-7243648d0dab None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:01.983003 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda395a-5d6b-4535-ac91-7243648d0dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:02.009249 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ddda395a-5d6b-4535-ac91-7243648d0dab None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:02.010446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ddda395a-5d6b-4535-ac91-7243648d0dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:02.083696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 73/144] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:02.135376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 72/145] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:05:02.208456 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0836174-9ff1-49af-8cec-b8e30a1e6556 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:02.208725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0836174-9ff1-49af-8cec-b8e30a1e6556 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:02.208937 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0836174-9ff1-49af-8cec-b8e30a1e6556 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:02.210903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 74/146] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:02.216882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7412429-3a39-4c54-bd2f-b0a666c46033 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:02.217176 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7412429-3a39-4c54-bd2f-b0a666c46033 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:02.217451 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7412429-3a39-4c54-bd2f-b0a666c46033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:02.241654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e7412429-3a39-4c54-bd2f-b0a666c46033 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:02.242957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e7412429-3a39-4c54-bd2f-b0a666c46033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:02.269355 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:02.322255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 73/147] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:02.436358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0836174-9ff1-49af-8cec-b8e30a1e6556 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:02.548901 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0836174-9ff1-49af-8cec-b8e30a1e6556 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:02.550827 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:02.593537 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811952b-bf53-4b25-9927-e320e1e7c04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:02.594535 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811952b-bf53-4b25-9927-e320e1e7c04d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:02.595098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811952b-bf53-4b25-9927-e320e1e7c04d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:02.595657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811952b-bf53-4b25-9927-e320e1e7c04d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:02.607691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811952b-bf53-4b25-9927-e320e1e7c04d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-f811952b-bf53-4b25-9927-e320e1e7c04d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:02.618556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:02.619952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:02.620749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:02.620749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:02.620749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:02.620749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:02.620749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:02.620749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:02.620749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:02.620749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:02.620749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:02.620749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:02.620749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:02.620749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:02.623256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 75/148] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:02.629439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7412429-3a39-4c54-bd2f-b0a666c46033 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:02.719190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811952b-bf53-4b25-9927-e320e1e7c04d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:02.767091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7412429-3a39-4c54-bd2f-b0a666c46033 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:02.828479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9576c22-0e21-4f99-9073-8cc1f49bffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:02.829731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9576c22-0e21-4f99-9073-8cc1f49bffe5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:02.830295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9576c22-0e21-4f99-9073-8cc1f49bffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:02.831048 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9576c22-0e21-4f99-9073-8cc1f49bffe5 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:02.832885 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9576c22-0e21-4f99-9073-8cc1f49bffe5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:02.833402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9576c22-0e21-4f99-9073-8cc1f49bffe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:02.835099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9576c22-0e21-4f99-9073-8cc1f49bffe5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:02.848500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 74/149] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:02.850115 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9576c22-0e21-4f99-9073-8cc1f49bffe5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:02.878803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811952b-bf53-4b25-9927-e320e1e7c04d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:02.879883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:02.928521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb523095-144d-45d4-a1fa-80eca66e3305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:02.930423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb523095-144d-45d4-a1fa-80eca66e3305 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:02.930923 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb523095-144d-45d4-a1fa-80eca66e3305 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:02.931704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb523095-144d-45d4-a1fa-80eca66e3305 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:02.947108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb523095-144d-45d4-a1fa-80eca66e3305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-bb523095-144d-45d4-a1fa-80eca66e3305 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:02.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:02.955382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:02.956138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:02.956138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:02.956138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:02.956138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:02.956138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:02.956138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:02.956138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:02.956138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:02.956138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:02.956138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:02.956138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:05:02.956138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:02.959481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 76/150] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:05:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:05:02.961809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb523095-144d-45d4-a1fa-80eca66e3305 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:02.987218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9576c22-0e21-4f99-9073-8cc1f49bffe5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:02.998588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:03.031232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4bbff-41a5-41fb-883e-c7e7505a56c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:03.031904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4bbff-41a5-41fb-883e-c7e7505a56c9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:03.032190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4bbff-41a5-41fb-883e-c7e7505a56c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:03.032466 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4bbff-41a5-41fb-883e-c7e7505a56c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:03.045727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4bbff-41a5-41fb-883e-c7e7505a56c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-41f4bbff-41a5-41fb-883e-c7e7505a56c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:03.051285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:03.052154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:03.052932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:03.052932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:03.052932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:03.052932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:03.052932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:03.052932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:03.052932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:03.052932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:03.052932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:03.052932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:03.052932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:03.052932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:03.052932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 75/151] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:03.053568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4bbff-41a5-41fb-883e-c7e7505a56c9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:03.114216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb523095-144d-45d4-a1fa-80eca66e3305 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:03.154710 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:03.163573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a786822-6981-4213-b5ca-4f29df628fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:03.164570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a786822-6981-4213-b5ca-4f29df628fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:03.165058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a786822-6981-4213-b5ca-4f29df628fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:03.166064 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a786822-6981-4213-b5ca-4f29df628fd1 None admin] PATH_INFO: `/v3/users/fae5f077c4984c84b963e756212a526f` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:03.167785 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a786822-6981-4213-b5ca-4f29df628fd1 None admin] RBAC: Authorizing `identity:get_user(user_id=fae5f077c4984c84b963e756212a526f)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:03.170274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a786822-6981-4213-b5ca-4f29df628fd1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:03.172587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 77/152] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:02 2022] GET /identity/v3/users/fae5f077c4984c84b963e756212a526f => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:03.173908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a786822-6981-4213-b5ca-4f29df628fd1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:03.189737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4bbff-41a5-41fb-883e-c7e7505a56c9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:03.236761 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2d91b-1b23-45a3-8bb9-dc426c9bc4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:03.238027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2d91b-1b23-45a3-8bb9-dc426c9bc4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:03.238533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2d91b-1b23-45a3-8bb9-dc426c9bc4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:03.239447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2d91b-1b23-45a3-8bb9-dc426c9bc4a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:03.240999 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2d91b-1b23-45a3-8bb9-dc426c9bc4a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:03.242285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2d91b-1b23-45a3-8bb9-dc426c9bc4a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:03.244979 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2d91b-1b23-45a3-8bb9-dc426c9bc4a7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:03.259097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 76/153] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:03.262558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2d91b-1b23-45a3-8bb9-dc426c9bc4a7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:03.282576 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:03.293547 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a786822-6981-4213-b5ca-4f29df628fd1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:03.385809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c70e1a-e6d5-4dba-a855-ef95d270f822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:03.386427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c70e1a-e6d5-4dba-a855-ef95d270f822 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:03.386640 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c70e1a-e6d5-4dba-a855-ef95d270f822 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:03.386966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c70e1a-e6d5-4dba-a855-ef95d270f822 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:03.387754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c70e1a-e6d5-4dba-a855-ef95d270f822 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:03.387979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c70e1a-e6d5-4dba-a855-ef95d270f822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:03.389395 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c70e1a-e6d5-4dba-a855-ef95d270f822 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:03.393629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2d91b-1b23-45a3-8bb9-dc426c9bc4a7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:03.409022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 78/154] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:03.410626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6cd78-004d-40bc-af25-e8fc7f5f774c None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:03.410626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6cd78-004d-40bc-af25-e8fc7f5f774c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:03.410910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6cd78-004d-40bc-af25-e8fc7f5f774c None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:03.412309 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 79/155] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:03.413008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6cd78-004d-40bc-af25-e8fc7f5f774c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:03.440940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831eafa-5172-4d65-932c-e48f710b1c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:03.441877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831eafa-5172-4d65-932c-e48f710b1c62 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:03.443758 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831eafa-5172-4d65-932c-e48f710b1c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:03.444260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831eafa-5172-4d65-932c-e48f710b1c62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:03.469046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:03.605292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6cd78-004d-40bc-af25-e8fc7f5f774c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:03.609504 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831eafa-5172-4d65-932c-e48f710b1c62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:03.610991 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831eafa-5172-4d65-932c-e48f710b1c62 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:03.684890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0434c-bc22-434a-9a3e-50ac8774cb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:03.685456 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0434c-bc22-434a-9a3e-50ac8774cb6c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:03.685734 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0434c-bc22-434a-9a3e-50ac8774cb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:03.686008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0434c-bc22-434a-9a3e-50ac8774cb6c None admin] PATH_INFO: `/v3/users/5c63bf57b4e7408d9fa4e45538832485` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:03.691751 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0434c-bc22-434a-9a3e-50ac8774cb6c None admin] RBAC: Authorizing `identity:get_user(user_id=5c63bf57b4e7408d9fa4e45538832485)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:03.693300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0434c-bc22-434a-9a3e-50ac8774cb6c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:03.695500 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 80/156] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:03 2022] GET /identity/v3/users/5c63bf57b4e7408d9fa4e45538832485 => generated 247 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:03.697235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5682cd-33ff-487c-a494-62714c5e337c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:03.697524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5682cd-33ff-487c-a494-62714c5e337c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:03.697794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5682cd-33ff-487c-a494-62714c5e337c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:03.740068 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0c5682cd-33ff-487c-a494-62714c5e337c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:03.741267 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0c5682cd-33ff-487c-a494-62714c5e337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:03.765008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:03.796070 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 77/157] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:03.796937 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831eafa-5172-4d65-932c-e48f710b1c62 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:03.884735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:03.886619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 81/158] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:03.887736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5682cd-33ff-487c-a494-62714c5e337c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:04.015033 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831eafa-5172-4d65-932c-e48f710b1c62 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:04.088008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084066a-a9ce-4f78-8083-9ceade3b4d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:04.088666 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084066a-a9ce-4f78-8083-9ceade3b4d5d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:04.088946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084066a-a9ce-4f78-8083-9ceade3b4d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:04.089219 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084066a-a9ce-4f78-8083-9ceade3b4d5d None admin] PATH_INFO: `/v3/users/631d1b739389448f84d4034847b40a16` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:04.090399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084066a-a9ce-4f78-8083-9ceade3b4d5d None admin] RBAC: Authorizing `identity:get_user(user_id=631d1b739389448f84d4034847b40a16)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:04.091885 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084066a-a9ce-4f78-8083-9ceade3b4d5d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:04.093613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 78/159] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:03 2022] GET /identity/v3/users/631d1b739389448f84d4034847b40a16 => generated 289 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:04.094390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084066a-a9ce-4f78-8083-9ceade3b4d5d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:04.103305 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5682cd-33ff-487c-a494-62714c5e337c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:04.197355 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100700ea-690e-4892-8480-048210cf3e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:04.198005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100700ea-690e-4892-8480-048210cf3e97 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:04.198292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100700ea-690e-4892-8480-048210cf3e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:04.198567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100700ea-690e-4892-8480-048210cf3e97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:04.241192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:04.304654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084066a-a9ce-4f78-8083-9ceade3b4d5d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:04.320765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:04.337662 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100700ea-690e-4892-8480-048210cf3e97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:04.339175 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100700ea-690e-4892-8480-048210cf3e97 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:04.367738 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d07ad-1d7a-48bd-aa46-111171a8313b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:04.368390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d07ad-1d7a-48bd-aa46-111171a8313b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:04.368669 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d07ad-1d7a-48bd-aa46-111171a8313b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:04.368945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d07ad-1d7a-48bd-aa46-111171a8313b None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:04.370899 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d07ad-1d7a-48bd-aa46-111171a8313b None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:04.372389 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d07ad-1d7a-48bd-aa46-111171a8313b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:04.374058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 79/160] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:04 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:04.374830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d07ad-1d7a-48bd-aa46-111171a8313b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:04.479666 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 82/161] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:04.481395 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d09de-ef4b-4592-87ff-9e2d18375a7d None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:04.481825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d09de-ef4b-4592-87ff-9e2d18375a7d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:04.482104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d09de-ef4b-4592-87ff-9e2d18375a7d None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:04.483431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 83/162] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:04.484270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d09de-ef4b-4592-87ff-9e2d18375a7d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:04.591582 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:04.610546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d07ad-1d7a-48bd-aa46-111171a8313b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:04.658586 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c06c1-fd79-4b1d-83ee-060b5eec553b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:04.659251 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c06c1-fd79-4b1d-83ee-060b5eec553b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:04.659533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c06c1-fd79-4b1d-83ee-060b5eec553b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:04.659806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c06c1-fd79-4b1d-83ee-060b5eec553b None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:04.661658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c06c1-fd79-4b1d-83ee-060b5eec553b None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:04.666053 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c06c1-fd79-4b1d-83ee-060b5eec553b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:04.667946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 80/163] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:04 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:04.669374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c06c1-fd79-4b1d-83ee-060b5eec553b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:04.694157 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d09de-ef4b-4592-87ff-9e2d18375a7d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:04.760322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c1c09-23e9-4f93-8faa-2d1e1038b91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:04.761343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c1c09-23e9-4f93-8faa-2d1e1038b91f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:04.761634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c1c09-23e9-4f93-8faa-2d1e1038b91f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:04.761916 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c1c09-23e9-4f93-8faa-2d1e1038b91f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:04.762941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:04.774742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c1c09-23e9-4f93-8faa-2d1e1038b91f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-cd5c1c09-23e9-4f93-8faa-2d1e1038b91f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:04.780066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:04.780902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:04.781661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:04.781661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:04.781661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:04.781661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:04.781661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:04.781661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:04.781661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:04.781661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:04.781661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:04.781661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:04.781661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:04.781661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:04.782450 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 84/164] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:05:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:04.782576 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c1c09-23e9-4f93-8faa-2d1e1038b91f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:04.872562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c06c1-fd79-4b1d-83ee-060b5eec553b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:04.914448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85364aa7-44f9-4aab-9a1e-26c97e1ed8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:04.915057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85364aa7-44f9-4aab-9a1e-26c97e1ed8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:04.915390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85364aa7-44f9-4aab-9a1e-26c97e1ed8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:04.915662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85364aa7-44f9-4aab-9a1e-26c97e1ed8d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:04.916398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85364aa7-44f9-4aab-9a1e-26c97e1ed8d7 None admin] RBAC: Adding query filter params (role.id=6ce9c4ba7196458380036520a04c9404, scope.project.id=22ce08feb9bd450698aac43ae261b3c3, user.id=fae5f077c4984c84b963e756212a526f) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:04.916706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85364aa7-44f9-4aab-9a1e-26c97e1ed8d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:04.918335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85364aa7-44f9-4aab-9a1e-26c97e1ed8d7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:04.926020 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 81/165] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:04 2022] GET /identity/v3/role_assignments?user.id=fae5f077c4984c84b963e756212a526f&scope.project.id=22ce08feb9bd450698aac43ae261b3c3&role.id=6ce9c4ba7196458380036520a04c9404 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:04.932186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65cdb6-2d0e-4fd3-9a66-1d9578b509b9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:04.932540 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65cdb6-2d0e-4fd3-9a66-1d9578b509b9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:04.932739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65cdb6-2d0e-4fd3-9a66-1d9578b509b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:04.969395 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cc65cdb6-2d0e-4fd3-9a66-1d9578b509b9 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:04.970630 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cc65cdb6-2d0e-4fd3-9a66-1d9578b509b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:04.997815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c1c09-23e9-4f93-8faa-2d1e1038b91f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:05.018506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:05.053563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 82/166] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:05.055047 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65cdb6-2d0e-4fd3-9a66-1d9578b509b9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:05.099891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5346b3e-2f08-4c91-89ee-45a9db0f0469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:05.100563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5346b3e-2f08-4c91-89ee-45a9db0f0469 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:05.100943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5346b3e-2f08-4c91-89ee-45a9db0f0469 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:05.101217 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5346b3e-2f08-4c91-89ee-45a9db0f0469 None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:05.108020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5346b3e-2f08-4c91-89ee-45a9db0f0469 None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:05.109564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5346b3e-2f08-4c91-89ee-45a9db0f0469 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:05.111758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 85/167] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:04 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:05.112619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5346b3e-2f08-4c91-89ee-45a9db0f0469 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:05.139607 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:05.241244 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65cdb6-2d0e-4fd3-9a66-1d9578b509b9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:05.280986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5346b3e-2f08-4c91-89ee-45a9db0f0469 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:05.318288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6b482-08ef-44a5-aed4-d99d081f77e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:05.318906 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6b482-08ef-44a5-aed4-d99d081f77e2 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:05.319266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6b482-08ef-44a5-aed4-d99d081f77e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:05.320148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6b482-08ef-44a5-aed4-d99d081f77e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:05.320834 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6b482-08ef-44a5-aed4-d99d081f77e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:05.327088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6b482-08ef-44a5-aed4-d99d081f77e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:05.327088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6b482-08ef-44a5-aed4-d99d081f77e2 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:05.331791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 86/168] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:05:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:05.332540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6b482-08ef-44a5-aed4-d99d081f77e2 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:05.336669 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685d5a7-298a-4df5-bd9c-d4a874ca8150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:05.337627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685d5a7-298a-4df5-bd9c-d4a874ca8150 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:05.338121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685d5a7-298a-4df5-bd9c-d4a874ca8150 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:05.338601 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685d5a7-298a-4df5-bd9c-d4a874ca8150 None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3/users/631d1b739389448f84d4034847b40a16/roles/0a3b51ca53dc4d88b4be340e21144870` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:05.343840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685d5a7-298a-4df5-bd9c-d4a874ca8150 None admin] RBAC: Authorizing `identity:create_grant(project_id=22ce08feb9bd450698aac43ae261b3c3, user_id=631d1b739389448f84d4034847b40a16, role_id=0a3b51ca53dc4d88b4be340e21144870)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:05.345512 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685d5a7-298a-4df5-bd9c-d4a874ca8150 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:05.377836 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 83/169] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:05:05 2022] PUT /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3/users/631d1b739389448f84d4034847b40a16/roles/0a3b51ca53dc4d88b4be340e21144870 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:05:05.379479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0256092-e2de-4770-994e-2791cbbfe18f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:05.379989 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0256092-e2de-4770-994e-2791cbbfe18f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:05.380506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0256092-e2de-4770-994e-2791cbbfe18f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:05.387447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 84/170] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:05.388678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0256092-e2de-4770-994e-2791cbbfe18f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:05.391496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:05.468315 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6b482-08ef-44a5-aed4-d99d081f77e2 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:05.512805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb306365-0950-4e24-b2d6-89a36d0fff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:05.513440 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb306365-0950-4e24-b2d6-89a36d0fff42 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:05.514534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb306365-0950-4e24-b2d6-89a36d0fff42 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:05.514884 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb306365-0950-4e24-b2d6-89a36d0fff42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:05.517554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb306365-0950-4e24-b2d6-89a36d0fff42 None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=22ce08feb9bd450698aac43ae261b3c3, user.id=5c63bf57b4e7408d9fa4e45538832485) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:05.517892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb306365-0950-4e24-b2d6-89a36d0fff42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:05.519581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb306365-0950-4e24-b2d6-89a36d0fff42 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:05.535769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 87/171] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:05 2022] GET /identity/v3/role_assignments?user.id=5c63bf57b4e7408d9fa4e45538832485&scope.project.id=22ce08feb9bd450698aac43ae261b3c3&role.id=3799feb4caa64e568971222375957f54 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:05.537207 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a9682-efb4-42fa-9570-1a80387f114b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:05.537489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a9682-efb4-42fa-9570-1a80387f114b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:05.537764 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a9682-efb4-42fa-9570-1a80387f114b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:05.577768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-557a9682-efb4-42fa-9570-1a80387f114b None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:05.584800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-557a9682-efb4-42fa-9570-1a80387f114b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:05.634600 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:05.648679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0256092-e2de-4770-994e-2791cbbfe18f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:05.702775 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 88/172] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:05.708033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a9682-efb4-42fa-9570-1a80387f114b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:05.739878 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e5d56-43ac-49bb-b7cd-5d316cdbbfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:05.740534 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e5d56-43ac-49bb-b7cd-5d316cdbbfa0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:05.740808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e5d56-43ac-49bb-b7cd-5d316cdbbfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:05.741079 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e5d56-43ac-49bb-b7cd-5d316cdbbfa0 None admin] PATH_INFO: `/v3/users/fae5f077c4984c84b963e756212a526f` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:05.742499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e5d56-43ac-49bb-b7cd-5d316cdbbfa0 None admin] RBAC: Authorizing `identity:get_user(user_id=fae5f077c4984c84b963e756212a526f)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:05.743995 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e5d56-43ac-49bb-b7cd-5d316cdbbfa0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:05.745979 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 85/173] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:05 2022] GET /identity/v3/users/fae5f077c4984c84b963e756212a526f => generated 275 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:05.758302 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:05.761196 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e5d56-43ac-49bb-b7cd-5d316cdbbfa0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:05.847223 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a9682-efb4-42fa-9570-1a80387f114b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:05.899577 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e5d56-43ac-49bb-b7cd-5d316cdbbfa0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:05.901493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a0c8e-a706-487e-a870-d6fc79070b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:05.902257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a0c8e-a706-487e-a870-d6fc79070b3d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:05.902593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a0c8e-a706-487e-a870-d6fc79070b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:05.902873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a0c8e-a706-487e-a870-d6fc79070b3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:05.928037 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a0c8e-a706-487e-a870-d6fc79070b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-811a0c8e-a706-487e-a870-d6fc79070b3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:05.933449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:05.934638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:05.935470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:05.935470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:05.935470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:05.935470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:05.935470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:05.935470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:05.935470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:05.935470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:05.935470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:05.935470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:05.935470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:05.935470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:05.936072 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 89/174] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:05.941155 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a0c8e-a706-487e-a870-d6fc79070b3d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:05.948770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1261d8-724e-4f04-9f3e-4bf2d8465756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:05.949399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1261d8-724e-4f04-9f3e-4bf2d8465756 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:05.949675 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1261d8-724e-4f04-9f3e-4bf2d8465756 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:05.949943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1261d8-724e-4f04-9f3e-4bf2d8465756 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:05.999972 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:06.047143 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1261d8-724e-4f04-9f3e-4bf2d8465756 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:06.048610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1261d8-724e-4f04-9f3e-4bf2d8465756 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:06.056502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:06.065298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a0c8e-a706-487e-a870-d6fc79070b3d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:06.106622 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7946788-7723-4ae2-b4c7-7162b4422aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:06.107270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7946788-7723-4ae2-b4c7-7162b4422aee None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:06.107554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7946788-7723-4ae2-b4c7-7162b4422aee None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:06.107835 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7946788-7723-4ae2-b4c7-7162b4422aee None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:06.108511 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7946788-7723-4ae2-b4c7-7162b4422aee None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:06.108820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7946788-7723-4ae2-b4c7-7162b4422aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:06.110356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7946788-7723-4ae2-b4c7-7162b4422aee None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:06.125437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 90/175] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:06.126814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfc75e-1f3a-4ae7-a490-452b39c9e6e2 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:06.127121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfc75e-1f3a-4ae7-a490-452b39c9e6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:06.127406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfc75e-1f3a-4ae7-a490-452b39c9e6e2 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:06.129977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 91/176] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:06.131738 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfc75e-1f3a-4ae7-a490-452b39c9e6e2 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:06.233825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 86/177] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:06.235251 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a053a-b3ce-4138-81d6-601ff8a182d0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:06.235984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a053a-b3ce-4138-81d6-601ff8a182d0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:06.236287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a053a-b3ce-4138-81d6-601ff8a182d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:06.260241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b53a053a-b3ce-4138-81d6-601ff8a182d0 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:06.262191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b53a053a-b3ce-4138-81d6-601ff8a182d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:06.268112 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfc75e-1f3a-4ae7-a490-452b39c9e6e2 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:06.324917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c6b48-14e5-4d1f-95c8-42be1174f5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:06.325669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c6b48-14e5-4d1f-95c8-42be1174f5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:06.331097 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c6b48-14e5-4d1f-95c8-42be1174f5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:06.331097 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c6b48-14e5-4d1f-95c8-42be1174f5e9 None admin] PATH_INFO: `/v3/users/fae5f077c4984c84b963e756212a526f` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:06.331097 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c6b48-14e5-4d1f-95c8-42be1174f5e9 None admin] RBAC: Authorizing `identity:get_user(user_id=fae5f077c4984c84b963e756212a526f)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:06.331097 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c6b48-14e5-4d1f-95c8-42be1174f5e9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:06.332110 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 92/178] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:06 2022] GET /identity/v3/users/fae5f077c4984c84b963e756212a526f => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:06.336643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c6b48-14e5-4d1f-95c8-42be1174f5e9 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:06.346044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:06.359572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 87/179] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:06.360258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a053a-b3ce-4138-81d6-601ff8a182d0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:06.386125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:06.467730 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a053a-b3ce-4138-81d6-601ff8a182d0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:06.504835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462d7dc-bdf2-4146-add3-a3867778072d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:06.505396 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462d7dc-bdf2-4146-add3-a3867778072d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:06.505779 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462d7dc-bdf2-4146-add3-a3867778072d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:06.506058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462d7dc-bdf2-4146-add3-a3867778072d None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:06.507878 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462d7dc-bdf2-4146-add3-a3867778072d None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:06.509335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462d7dc-bdf2-4146-add3-a3867778072d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:06.511238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 88/180] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:06 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:06.512077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462d7dc-bdf2-4146-add3-a3867778072d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:06.517913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c6b48-14e5-4d1f-95c8-42be1174f5e9 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:06.555872 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a38b8-91a8-451a-8807-2c329bd1e37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:06.556964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a38b8-91a8-451a-8807-2c329bd1e37c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:06.557505 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a38b8-91a8-451a-8807-2c329bd1e37c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:06.557977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a38b8-91a8-451a-8807-2c329bd1e37c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:06.569149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a38b8-91a8-451a-8807-2c329bd1e37c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-fe2a38b8-91a8-451a-8807-2c329bd1e37c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:06.577892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:06.578789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:06.579612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:06.579612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:06.579612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:06.579612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:06.579612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:06.579612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:06.579612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:06.579612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:06.579612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:06.579612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:06.579612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:05:06.579612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:06.581942 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 93/181] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:05:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:06.583581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0da24-78ab-4aa4-a29f-975be6710713 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:06.584061 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0da24-78ab-4aa4-a29f-975be6710713 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:06.584542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0da24-78ab-4aa4-a29f-975be6710713 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:06.586123 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 94/182] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:06.591245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0da24-78ab-4aa4-a29f-975be6710713 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:06.598735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:06.627852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462d7dc-bdf2-4146-add3-a3867778072d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:06.669422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd4c3f-ab74-467f-a73f-fb332f429bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:06.670050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd4c3f-ab74-467f-a73f-fb332f429bed None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:06.670317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd4c3f-ab74-467f-a73f-fb332f429bed None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:06.670591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd4c3f-ab74-467f-a73f-fb332f429bed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:06.694239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:06.715290 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0da24-78ab-4aa4-a29f-975be6710713 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:06.748339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd4c3f-ab74-467f-a73f-fb332f429bed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:06.750200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd4c3f-ab74-467f-a73f-fb332f429bed None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:06.753848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61c237-1914-4bdc-aa42-73a6b3005735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:06.754619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61c237-1914-4bdc-aa42-73a6b3005735 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:06.755119 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61c237-1914-4bdc-aa42-73a6b3005735 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:06.755530 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61c237-1914-4bdc-aa42-73a6b3005735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:06.756410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61c237-1914-4bdc-aa42-73a6b3005735 None admin] RBAC: Adding query filter params (role.id=6f1196f44c2040ee86de4a614692041d, scope.project.id=22ce08feb9bd450698aac43ae261b3c3, user.id=fae5f077c4984c84b963e756212a526f) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:06.756903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61c237-1914-4bdc-aa42-73a6b3005735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:06.759022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61c237-1914-4bdc-aa42-73a6b3005735 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:06.765501 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 95/183] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:06 2022] GET /identity/v3/role_assignments?user.id=fae5f077c4984c84b963e756212a526f&scope.project.id=22ce08feb9bd450698aac43ae261b3c3&role.id=6f1196f44c2040ee86de4a614692041d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:06.766547 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61c237-1914-4bdc-aa42-73a6b3005735 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:06.834824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:06.886489 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 89/184] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:06.892457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d571a-c13c-426c-bd91-c2734b14c5a7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:06.892742 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d571a-c13c-426c-bd91-c2734b14c5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:06.893021 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d571a-c13c-426c-bd91-c2734b14c5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:06.914511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-382d571a-c13c-426c-bd91-c2734b14c5a7 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:06.915775 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-382d571a-c13c-426c-bd91-c2734b14c5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:06.925880 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61c237-1914-4bdc-aa42-73a6b3005735 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:06.973613 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052b0b0-d86d-455e-b737-322261a082f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:06.974232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052b0b0-d86d-455e-b737-322261a082f1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:06.974502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052b0b0-d86d-455e-b737-322261a082f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:06.974769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052b0b0-d86d-455e-b737-322261a082f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:06.975466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052b0b0-d86d-455e-b737-322261a082f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:06.975795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052b0b0-d86d-455e-b737-322261a082f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:06.977601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052b0b0-d86d-455e-b737-322261a082f1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:06.988050 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 96/185] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:06.988785 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052b0b0-d86d-455e-b737-322261a082f1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:06.997192 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 90/186] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:06.997899 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d571a-c13c-426c-bd91-c2734b14c5a7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:07.007703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:07.120670 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:07.131024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d571a-c13c-426c-bd91-c2734b14c5a7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:07.132254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052b0b0-d86d-455e-b737-322261a082f1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:07.186528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1d83c-6f22-4924-8cb6-4b592e6bb2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:07.186764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a722f2-e5c3-4b65-ad95-cf874c299c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:07.187186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1d83c-6f22-4924-8cb6-4b592e6bb2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:07.187465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1d83c-6f22-4924-8cb6-4b592e6bb2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:07.187658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a722f2-e5c3-4b65-ad95-cf874c299c18 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:07.187758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1d83c-6f22-4924-8cb6-4b592e6bb2e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:07.188096 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a722f2-e5c3-4b65-ad95-cf874c299c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:07.188473 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a722f2-e5c3-4b65-ad95-cf874c299c18 None admin] PATH_INFO: `/v3/projects/aa573b9e7c5040ff8a9acfed6adb9624` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:07.189762 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a722f2-e5c3-4b65-ad95-cf874c299c18 None admin] RBAC: Authorizing `identity:get_project(project_id=aa573b9e7c5040ff8a9acfed6adb9624)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:07.191439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a722f2-e5c3-4b65-ad95-cf874c299c18 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:07.193403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 91/187] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:06 2022] GET /identity/v3/projects/aa573b9e7c5040ff8a9acfed6adb9624 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:07.194056 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a722f2-e5c3-4b65-ad95-cf874c299c18 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:07.199645 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1d83c-6f22-4924-8cb6-4b592e6bb2e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-67f1d83c-6f22-4924-8cb6-4b592e6bb2e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:07.205255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:07.206104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:07.206879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:07.206879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:07.206879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:07.206879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:07.206879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:07.206879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:07.206879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:07.206879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:07.206879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:07.206879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:07.206879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:07.206879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:07.206879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 97/188] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:05:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:07.207565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1d83c-6f22-4924-8cb6-4b592e6bb2e5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:07.283946 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:07.323152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1d83c-6f22-4924-8cb6-4b592e6bb2e5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:07.342162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a722f2-e5c3-4b65-ad95-cf874c299c18 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:07.377799 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c2a2b-9950-4721-96b4-e843a72e367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:07.378453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c2a2b-9950-4721-96b4-e843a72e367d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:07.378741 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c2a2b-9950-4721-96b4-e843a72e367d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:07.379017 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c2a2b-9950-4721-96b4-e843a72e367d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:07.379767 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c2a2b-9950-4721-96b4-e843a72e367d None admin] RBAC: Adding query filter params (role.id=6ce9c4ba7196458380036520a04c9404, scope.project.id=aa573b9e7c5040ff8a9acfed6adb9624, user.id=fae5f077c4984c84b963e756212a526f) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:07.380075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c2a2b-9950-4721-96b4-e843a72e367d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:07.381585 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c2a2b-9950-4721-96b4-e843a72e367d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:07.388577 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af38ec6-6aac-4840-84b0-6db2a07bcb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:07.389208 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af38ec6-6aac-4840-84b0-6db2a07bcb69 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:07.389484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af38ec6-6aac-4840-84b0-6db2a07bcb69 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:07.389755 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af38ec6-6aac-4840-84b0-6db2a07bcb69 None admin] PATH_INFO: `/v3/users/84fb532a82544cca8684c76f3a50f71a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:07.399199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 98/189] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:07 2022] GET /identity/v3/role_assignments?user.id=fae5f077c4984c84b963e756212a526f&scope.project.id=aa573b9e7c5040ff8a9acfed6adb9624&role.id=6ce9c4ba7196458380036520a04c9404 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:07.399199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c2a2b-9950-4721-96b4-e843a72e367d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:07.414687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af38ec6-6aac-4840-84b0-6db2a07bcb69 None admin] RBAC: Authorizing `identity:get_user(user_id=84fb532a82544cca8684c76f3a50f71a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:07.416304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af38ec6-6aac-4840-84b0-6db2a07bcb69 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:07.418176 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 92/190] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:07 2022] GET /identity/v3/users/84fb532a82544cca8684c76f3a50f71a => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:07.420637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af38ec6-6aac-4840-84b0-6db2a07bcb69 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:07.454746 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:07.547588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af38ec6-6aac-4840-84b0-6db2a07bcb69 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:07.590552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7eadb3-76d0-4234-957a-05a95c345931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:07.591236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eadb3-76d0-4234-957a-05a95c345931 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:07.591510 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eadb3-76d0-4234-957a-05a95c345931 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:07.591776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eadb3-76d0-4234-957a-05a95c345931 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:07.593736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7eadb3-76d0-4234-957a-05a95c345931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:07.595206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7eadb3-76d0-4234-957a-05a95c345931 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:07.599373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 93/191] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:07.600857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7eadb3-76d0-4234-957a-05a95c345931 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:07.617407 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c2a2b-9950-4721-96b4-e843a72e367d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:07.664658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0092473-a57f-4584-bc33-deeb90e85180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:07.665628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0092473-a57f-4584-bc33-deeb90e85180 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:07.666121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0092473-a57f-4584-bc33-deeb90e85180 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:07.668780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0092473-a57f-4584-bc33-deeb90e85180 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:07.669702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0092473-a57f-4584-bc33-deeb90e85180 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:07.670210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0092473-a57f-4584-bc33-deeb90e85180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:07.671836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0092473-a57f-4584-bc33-deeb90e85180 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:07.673580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:07.686030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 99/192] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:05:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:07.687597 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0092473-a57f-4584-bc33-deeb90e85180 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:07.711835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:07.729488 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7eadb3-76d0-4234-957a-05a95c345931 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:07.774279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677cbd5-0705-4849-ba9c-62a7885d5560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:07.774905 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677cbd5-0705-4849-ba9c-62a7885d5560 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:07.775991 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677cbd5-0705-4849-ba9c-62a7885d5560 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:07.776295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677cbd5-0705-4849-ba9c-62a7885d5560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:07.832809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0092473-a57f-4584-bc33-deeb90e85180 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:07.867538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90785bed-6a0c-4f44-a6c9-02162543f4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:07.868041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677cbd5-0705-4849-ba9c-62a7885d5560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:07.868148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90785bed-6a0c-4f44-a6c9-02162543f4af None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:07.868410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90785bed-6a0c-4f44-a6c9-02162543f4af None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:07.868682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90785bed-6a0c-4f44-a6c9-02162543f4af None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:07.869332 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90785bed-6a0c-4f44-a6c9-02162543f4af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:07.869499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677cbd5-0705-4849-ba9c-62a7885d5560 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:07.870779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90785bed-6a0c-4f44-a6c9-02162543f4af None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:07.894054 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 100/193] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:05:07 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:05:07.894859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90785bed-6a0c-4f44-a6c9-02162543f4af None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:07.963748 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:07.993183 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:08.008881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 94/194] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:08.014545 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677cbd5-0705-4849-ba9c-62a7885d5560 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:08.030779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90785bed-6a0c-4f44-a6c9-02162543f4af None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:08.072408 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08bfc6-28f6-47a5-9f78-59e03e7cdfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:08.073093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08bfc6-28f6-47a5-9f78-59e03e7cdfdc None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:08.073435 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08bfc6-28f6-47a5-9f78-59e03e7cdfdc None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:08.073731 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08bfc6-28f6-47a5-9f78-59e03e7cdfdc None admin] PATH_INFO: `/v3/users/84fb532a82544cca8684c76f3a50f71a` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:08.075033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08bfc6-28f6-47a5-9f78-59e03e7cdfdc None admin] RBAC: Authorizing `identity:get_user(user_id=84fb532a82544cca8684c76f3a50f71a)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:08.076522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08bfc6-28f6-47a5-9f78-59e03e7cdfdc None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:08.078709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 101/195] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:07 2022] GET /identity/v3/users/84fb532a82544cca8684c76f3a50f71a => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:08.084335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08bfc6-28f6-47a5-9f78-59e03e7cdfdc None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:08.135683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677cbd5-0705-4849-ba9c-62a7885d5560 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:08.170502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0c936-3c6a-4fdc-b6ea-8dfb3a84f562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:08.171163 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0c936-3c6a-4fdc-b6ea-8dfb3a84f562 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:08.171445 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0c936-3c6a-4fdc-b6ea-8dfb3a84f562 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:08.171717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0c936-3c6a-4fdc-b6ea-8dfb3a84f562 None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:08.172903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0c936-3c6a-4fdc-b6ea-8dfb3a84f562 None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:08.174348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0c936-3c6a-4fdc-b6ea-8dfb3a84f562 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:08.176233 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 95/196] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:08 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:08.177189 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18b976-ebcf-4766-8220-dbcd3de68de5 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:08.177468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18b976-ebcf-4766-8220-dbcd3de68de5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:08.177742 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18b976-ebcf-4766-8220-dbcd3de68de5 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:08.179864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 96/197] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:08.185906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4d682-15f7-4cf8-ab54-da503310c6dc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:08.186183 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4d682-15f7-4cf8-ab54-da503310c6dc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:08.186452 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4d682-15f7-4cf8-ab54-da503310c6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:08.199777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08bfc6-28f6-47a5-9f78-59e03e7cdfdc None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:08.206796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-67e4d682-15f7-4cf8-ab54-da503310c6dc None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:08.208621 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-67e4d682-15f7-4cf8-ab54-da503310c6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:08.225483 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:08.241445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f253d3-1795-423c-b9f5-fe800b52c952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:08.242047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f253d3-1795-423c-b9f5-fe800b52c952 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:08.242354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f253d3-1795-423c-b9f5-fe800b52c952 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:08.242602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f253d3-1795-423c-b9f5-fe800b52c952 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:08.269685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:08.295845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 97/198] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:08.296789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4d682-15f7-4cf8-ab54-da503310c6dc None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:08.345995 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f253d3-1795-423c-b9f5-fe800b52c952 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:08.348225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f253d3-1795-423c-b9f5-fe800b52c952 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:08.443597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4d682-15f7-4cf8-ab54-da503310c6dc None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:08.503886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 102/199] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 01:05:08.505657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef622e20-1ecc-4252-9107-130442574c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:08.506277 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef622e20-1ecc-4252-9107-130442574c1f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:08.506555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef622e20-1ecc-4252-9107-130442574c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:08.511908 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef622e20-1ecc-4252-9107-130442574c1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:08.512710 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef622e20-1ecc-4252-9107-130442574c1f None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e, user.id=84fb532a82544cca8684c76f3a50f71a) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:08.513745 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f253d3-1795-423c-b9f5-fe800b52c952 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:08.516072 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef622e20-1ecc-4252-9107-130442574c1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:08.517531 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef622e20-1ecc-4252-9107-130442574c1f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:08.531672 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 98/200] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:08 2022] GET /identity/v3/role_assignments?user.id=84fb532a82544cca8684c76f3a50f71a&scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e&role.id=3799feb4caa64e568971222375957f54 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:08.544127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:08.613165 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef622e20-1ecc-4252-9107-130442574c1f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:08.673051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:08.687198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f253d3-1795-423c-b9f5-fe800b52c952 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:08.734703 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef622e20-1ecc-4252-9107-130442574c1f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:08.768955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2420c2c-bda9-439a-b83b-d16e80c1150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:08.769597 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2420c2c-bda9-439a-b83b-d16e80c1150c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:08.769880 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2420c2c-bda9-439a-b83b-d16e80c1150c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:08.770155 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2420c2c-bda9-439a-b83b-d16e80c1150c None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:08.771323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2420c2c-bda9-439a-b83b-d16e80c1150c None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:08.773113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0f9ba-fe88-4acf-aa4f-556824e44016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:08.773370 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2420c2c-bda9-439a-b83b-d16e80c1150c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:08.773832 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f9ba-fe88-4acf-aa4f-556824e44016 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:08.774125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f9ba-fe88-4acf-aa4f-556824e44016 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:08.774401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f9ba-fe88-4acf-aa4f-556824e44016 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:08.776523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 103/201] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:08 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:08.785336 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2420c2c-bda9-439a-b83b-d16e80c1150c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:08.791719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0f9ba-fe88-4acf-aa4f-556824e44016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-08b0f9ba-fe88-4acf-aa4f-556824e44016 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:08.798419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:08.799608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:08.800401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:08.800401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:08.800401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:08.800401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:08.800401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:08.800401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:08.800401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:08.800401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:08.800401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:08.800401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:08.800401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:08.800401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:08.800401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 99/202] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:08.807121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0f9ba-fe88-4acf-aa4f-556824e44016 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:08.950728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:08.979387 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2420c2c-bda9-439a-b83b-d16e80c1150c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:08.997706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0f9ba-fe88-4acf-aa4f-556824e44016 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:09.015356 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:09.043393 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc892fe4-d211-40c2-be4e-90bc3c5cd1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:09.044016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc892fe4-d211-40c2-be4e-90bc3c5cd1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:09.044293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc892fe4-d211-40c2-be4e-90bc3c5cd1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:09.044564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc892fe4-d211-40c2-be4e-90bc3c5cd1f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:09.045299 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc892fe4-d211-40c2-be4e-90bc3c5cd1f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:09.045599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc892fe4-d211-40c2-be4e-90bc3c5cd1f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:09.047118 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc892fe4-d211-40c2-be4e-90bc3c5cd1f2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:09.057274 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 100/203] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:09.063975 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc892fe4-d211-40c2-be4e-90bc3c5cd1f2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:09.088108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929df677-b5f8-4479-b2e9-c48cf382f50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:09.088803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929df677-b5f8-4479-b2e9-c48cf382f50a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:09.089087 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929df677-b5f8-4479-b2e9-c48cf382f50a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:09.089368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929df677-b5f8-4479-b2e9-c48cf382f50a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:09.090306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929df677-b5f8-4479-b2e9-c48cf382f50a None admin] RBAC: Adding query filter params (role.id=6f1196f44c2040ee86de4a614692041d, scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e, user.id=84fb532a82544cca8684c76f3a50f71a) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:09.090623 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929df677-b5f8-4479-b2e9-c48cf382f50a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:09.092138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929df677-b5f8-4479-b2e9-c48cf382f50a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:09.109085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 104/204] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:08 2022] GET /identity/v3/role_assignments?user.id=84fb532a82544cca8684c76f3a50f71a&scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e&role.id=6f1196f44c2040ee86de4a614692041d => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:09.182749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc892fe4-d211-40c2-be4e-90bc3c5cd1f2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:09.223204 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a32b5-c587-457d-8747-6270977ebc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:09.223917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a32b5-c587-457d-8747-6270977ebc43 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:09.224195 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a32b5-c587-457d-8747-6270977ebc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:09.224567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a32b5-c587-457d-8747-6270977ebc43 None admin] PATH_INFO: `/v3/users/631d1b739389448f84d4034847b40a16` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:09.225831 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a32b5-c587-457d-8747-6270977ebc43 None admin] RBAC: Authorizing `identity:get_user(user_id=631d1b739389448f84d4034847b40a16)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:09.228014 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a32b5-c587-457d-8747-6270977ebc43 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:09.230382 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 101/205] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:09 2022] GET /identity/v3/users/631d1b739389448f84d4034847b40a16 => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:09.236199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929df677-b5f8-4479-b2e9-c48cf382f50a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:09.409890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929df677-b5f8-4479-b2e9-c48cf382f50a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:09.476407 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b663b-fdce-4189-8f7e-904af70393d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:09.477006 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b663b-fdce-4189-8f7e-904af70393d6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:09.477283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b663b-fdce-4189-8f7e-904af70393d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:09.477565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b663b-fdce-4189-8f7e-904af70393d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:09.505201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:09.573307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b663b-fdce-4189-8f7e-904af70393d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:09.575553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b663b-fdce-4189-8f7e-904af70393d6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:09.702471 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 105/206] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:09.708069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a32b5-c587-457d-8747-6270977ebc43 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:09.760485 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:09.835733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a32b5-c587-457d-8747-6270977ebc43 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:09.877940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6886ca-e869-475f-b491-1695d42b6f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:09.878575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6886ca-e869-475f-b491-1695d42b6f39 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:09.878849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6886ca-e869-475f-b491-1695d42b6f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:09.879144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6886ca-e869-475f-b491-1695d42b6f39 None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:09.880273 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6886ca-e869-475f-b491-1695d42b6f39 None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:09.882328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6886ca-e869-475f-b491-1695d42b6f39 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:09.884823 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 102/207] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:09 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:09.891754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b663b-fdce-4189-8f7e-904af70393d6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:09.973205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:10.044696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b663b-fdce-4189-8f7e-904af70393d6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:10.106586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd39d14-600d-4c76-a64f-1dbdde430a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:10.107220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd39d14-600d-4c76-a64f-1dbdde430a33 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:10.107497 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd39d14-600d-4c76-a64f-1dbdde430a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:10.107769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd39d14-600d-4c76-a64f-1dbdde430a33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:10.108495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd39d14-600d-4c76-a64f-1dbdde430a33 None admin] RBAC: Adding query filter params (role.id=0a3b51ca53dc4d88b4be340e21144870, scope.project.id=22ce08feb9bd450698aac43ae261b3c3, user.id=631d1b739389448f84d4034847b40a16) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:10.108800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd39d14-600d-4c76-a64f-1dbdde430a33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:10.110241 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd39d14-600d-4c76-a64f-1dbdde430a33 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:10.116313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 106/208] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:09 2022] GET /identity/v3/role_assignments?user.id=631d1b739389448f84d4034847b40a16&scope.project.id=22ce08feb9bd450698aac43ae261b3c3&role.id=0a3b51ca53dc4d88b4be340e21144870 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:10.450777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569b293-2d49-4fc2-bd02-a11401c0bf9e None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:10.451127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569b293-2d49-4fc2-bd02-a11401c0bf9e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:10.451363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569b293-2d49-4fc2-bd02-a11401c0bf9e None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:10.453141 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 103/209] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:10.458373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a94d3-2373-429e-a5a6-3d36a7dfe1a9 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:10.458663 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a94d3-2373-429e-a5a6-3d36a7dfe1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:10.458938 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a94d3-2373-429e-a5a6-3d36a7dfe1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:10.483318 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-871a94d3-2373-429e-a5a6-3d36a7dfe1a9 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:10.484556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-871a94d3-2373-429e-a5a6-3d36a7dfe1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:10.576322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 107/210] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:10.872444 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569b293-2d49-4fc2-bd02-a11401c0bf9e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:10.884740 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a01e7a-12fd-4c4e-8536-b09de25faed5 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:10.885135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a01e7a-12fd-4c4e-8536-b09de25faed5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:10.885414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a01e7a-12fd-4c4e-8536-b09de25faed5 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:10.886881 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 108/211] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:10.892354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2e7fa-45fc-4c46-b0c6-1d22d99ae409 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:10.892743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2e7fa-45fc-4c46-b0c6-1d22d99ae409 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:10.893023 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2e7fa-45fc-4c46-b0c6-1d22d99ae409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:10.915236 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ecf2e7fa-45fc-4c46-b0c6-1d22d99ae409 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:10.916419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ecf2e7fa-45fc-4c46-b0c6-1d22d99ae409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:10.967496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:10.993483 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569b293-2d49-4fc2-bd02-a11401c0bf9e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:11.002121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 109/212] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:11.006118 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:11.034767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4285f5-5f95-45d5-92a4-90548290752c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:11.035428 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4285f5-5f95-45d5-92a4-90548290752c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:11.035765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4285f5-5f95-45d5-92a4-90548290752c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:11.036033 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4285f5-5f95-45d5-92a4-90548290752c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:11.048223 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4285f5-5f95-45d5-92a4-90548290752c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0c4285f5-5f95-45d5-92a4-90548290752c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:11.053246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:11.055154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:11.055944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:11.055944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:11.055944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:11.055944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:11.055944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:11.055944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:11.055944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:11.055944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:11.055944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:11.055944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:11.055944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:11.055944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:11.055944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 104/213] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:11.062822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2e7fa-45fc-4c46-b0c6-1d22d99ae409 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:11.170095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2e7fa-45fc-4c46-b0c6-1d22d99ae409 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:11.205229 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73cff8-82a3-4677-939f-9849f385867a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:11.206162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73cff8-82a3-4677-939f-9849f385867a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:11.206664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73cff8-82a3-4677-939f-9849f385867a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:11.207176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73cff8-82a3-4677-939f-9849f385867a None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:11.208079 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73cff8-82a3-4677-939f-9849f385867a None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:11.208586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73cff8-82a3-4677-939f-9849f385867a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:11.210937 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73cff8-82a3-4677-939f-9849f385867a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:11.219459 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 110/214] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:11.227118 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4285f5-5f95-45d5-92a4-90548290752c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:11.312677 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73cff8-82a3-4677-939f-9849f385867a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:11.335556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4285f5-5f95-45d5-92a4-90548290752c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:11.363456 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:11.372509 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6b5d0-18bd-42a5-aa8c-5123b9e51456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:11.373150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6b5d0-18bd-42a5-aa8c-5123b9e51456 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:11.373428 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6b5d0-18bd-42a5-aa8c-5123b9e51456 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:11.373699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6b5d0-18bd-42a5-aa8c-5123b9e51456 None admin] PATH_INFO: `/v3/users/918e420b623a4bf2ab035d8a137f7c1b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:11.389928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6b5d0-18bd-42a5-aa8c-5123b9e51456 None admin] RBAC: Authorizing `identity:get_user(user_id=918e420b623a4bf2ab035d8a137f7c1b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:11.392561 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6b5d0-18bd-42a5-aa8c-5123b9e51456 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:11.394732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 105/215] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:11 2022] GET /identity/v3/users/918e420b623a4bf2ab035d8a137f7c1b => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:11.404214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6b5d0-18bd-42a5-aa8c-5123b9e51456 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:11.427045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73cff8-82a3-4677-939f-9849f385867a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:11.442259 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:11.468136 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae924e8-c5df-44da-af02-238a0c04b848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:11.468837 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae924e8-c5df-44da-af02-238a0c04b848 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:11.469117 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae924e8-c5df-44da-af02-238a0c04b848 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:11.469392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae924e8-c5df-44da-af02-238a0c04b848 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:11.470568 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae924e8-c5df-44da-af02-238a0c04b848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:11.472122 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae924e8-c5df-44da-af02-238a0c04b848 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:11.473691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 111/216] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:11.474888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfee2b2-e8d5-4fd5-ba6a-70b3b852ad20 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:11.475203 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfee2b2-e8d5-4fd5-ba6a-70b3b852ad20 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:11.477852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfee2b2-e8d5-4fd5-ba6a-70b3b852ad20 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:11.477852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 112/217] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:11.483317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfee2b2-e8d5-4fd5-ba6a-70b3b852ad20 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:11.534238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6b5d0-18bd-42a5-aa8c-5123b9e51456 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:11.571810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77da2f-b571-431f-9274-d458ed947135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:11.572426 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77da2f-b571-431f-9274-d458ed947135 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:11.572709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77da2f-b571-431f-9274-d458ed947135 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:11.572985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77da2f-b571-431f-9274-d458ed947135 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:11.588813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfee2b2-e8d5-4fd5-ba6a-70b3b852ad20 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:11.596950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:11.626800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddac3b-24be-4cd8-b344-b0b556ab7d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:11.627440 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddac3b-24be-4cd8-b344-b0b556ab7d72 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:11.627720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddac3b-24be-4cd8-b344-b0b556ab7d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:11.627991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddac3b-24be-4cd8-b344-b0b556ab7d72 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:11.628649 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddac3b-24be-4cd8-b344-b0b556ab7d72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:11.630134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddac3b-24be-4cd8-b344-b0b556ab7d72 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:11.645507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77da2f-b571-431f-9274-d458ed947135 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:11.647007 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77da2f-b571-431f-9274-d458ed947135 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:11.655755 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 113/218] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:05:11 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:05:11.656989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a91537-edba-46b3-b7ff-6a75d4d6f114 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:11.657276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a91537-edba-46b3-b7ff-6a75d4d6f114 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:11.657899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a91537-edba-46b3-b7ff-6a75d4d6f114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:11.677941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-17a91537-edba-46b3-b7ff-6a75d4d6f114 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:11.679142 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-17a91537-edba-46b3-b7ff-6a75d4d6f114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:11.692520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:11.791523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 106/219] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 01:05:11.792517 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77da2f-b571-431f-9274-d458ed947135 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:11.798120 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 114/220] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:11.903362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77da2f-b571-431f-9274-d458ed947135 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:11.934919 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:11.946460 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e294f63-dae9-4733-afbe-dab343d014a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:11.947164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e294f63-dae9-4733-afbe-dab343d014a5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:11.947453 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e294f63-dae9-4733-afbe-dab343d014a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:11.947727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e294f63-dae9-4733-afbe-dab343d014a5 None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:11.948870 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e294f63-dae9-4733-afbe-dab343d014a5 None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:11.950327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e294f63-dae9-4733-afbe-dab343d014a5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:11.952482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 107/221] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:11 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:11.958509 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a91537-edba-46b3-b7ff-6a75d4d6f114 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:12.032279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890f1a3-4ef0-4332-bc43-ef3dabfe7861 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:12.032279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890f1a3-4ef0-4332-bc43-ef3dabfe7861 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:12.032548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890f1a3-4ef0-4332-bc43-ef3dabfe7861 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:12.033860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 108/222] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:05:12.041619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1d5ef-8bdc-46ab-87bb-c652b83eea7c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:12.041892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1d5ef-8bdc-46ab-87bb-c652b83eea7c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:12.042165 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1d5ef-8bdc-46ab-87bb-c652b83eea7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:12.062410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:12.062711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-42b1d5ef-8bdc-46ab-87bb-c652b83eea7c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:12.063916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-42b1d5ef-8bdc-46ab-87bb-c652b83eea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:12.080017 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a91537-edba-46b3-b7ff-6a75d4d6f114 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:12.125064 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a87e79-4970-463f-800c-cbc36513f633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:12.125692 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a87e79-4970-463f-800c-cbc36513f633 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:12.126283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a87e79-4970-463f-800c-cbc36513f633 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:12.126455 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a87e79-4970-463f-800c-cbc36513f633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:12.127218 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a87e79-4970-463f-800c-cbc36513f633 None admin] RBAC: Adding query filter params (role.id=6ce9c4ba7196458380036520a04c9404, scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e, user.id=918e420b623a4bf2ab035d8a137f7c1b) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:12.127531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a87e79-4970-463f-800c-cbc36513f633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:12.128994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a87e79-4970-463f-800c-cbc36513f633 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:12.139112 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 115/223] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:11 2022] GET /identity/v3/role_assignments?user.id=918e420b623a4bf2ab035d8a137f7c1b&scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e&role.id=6ce9c4ba7196458380036520a04c9404 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:12.139957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a87e79-4970-463f-800c-cbc36513f633 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:12.157182 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 109/224] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:05:12.278823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a87e79-4970-463f-800c-cbc36513f633 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:12.320936 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567c32e-0eb8-4534-b12a-06cd314b9a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:12.321590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567c32e-0eb8-4534-b12a-06cd314b9a8e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:12.321867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567c32e-0eb8-4534-b12a-06cd314b9a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:12.322142 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567c32e-0eb8-4534-b12a-06cd314b9a8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:12.335302 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567c32e-0eb8-4534-b12a-06cd314b9a8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-1567c32e-0eb8-4534-b12a-06cd314b9a8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:12.341033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:12.341897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:12.342915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:12.342915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:12.342915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:12.342915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:12.342915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:12.342915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:12.342915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:12.342915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:12.342915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:12.342915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:12.342915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:05:12.342915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:12.342915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 116/225] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:12.347998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1d5ef-8bdc-46ab-87bb-c652b83eea7c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:12.475848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1d5ef-8bdc-46ab-87bb-c652b83eea7c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:12.483286 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567c32e-0eb8-4534-b12a-06cd314b9a8e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:12.513296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:12.524279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:12.541878 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c8a61-0e02-42b3-b9e4-d1733fea5441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:12.542418 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c8a61-0e02-42b3-b9e4-d1733fea5441 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:12.542699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c8a61-0e02-42b3-b9e4-d1733fea5441 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:12.542978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c8a61-0e02-42b3-b9e4-d1733fea5441 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:12.543691 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c8a61-0e02-42b3-b9e4-d1733fea5441 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:12.543995 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c8a61-0e02-42b3-b9e4-d1733fea5441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:12.545380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c8a61-0e02-42b3-b9e4-d1733fea5441 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:12.554717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 110/226] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:12.561002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c8a61-0e02-42b3-b9e4-d1733fea5441 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:12.645893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567c32e-0eb8-4534-b12a-06cd314b9a8e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:12.688667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05c11c-d9b2-4622-abe6-0ecbcfd7b8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:12.689574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05c11c-d9b2-4622-abe6-0ecbcfd7b8bd None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:12.690450 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05c11c-d9b2-4622-abe6-0ecbcfd7b8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:12.690865 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05c11c-d9b2-4622-abe6-0ecbcfd7b8bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:12.704191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05c11c-d9b2-4622-abe6-0ecbcfd7b8bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-4a05c11c-d9b2-4622-abe6-0ecbcfd7b8bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:12.711095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:12.712191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:12.713184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:12.713184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:12.713184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:12.713184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:12.713184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:12.713184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:12.713184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:12.713184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:12.713184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:12.713184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:12.713184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:12.713184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:12.715532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 117/227] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:05:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:05:12.720871 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05c11c-d9b2-4622-abe6-0ecbcfd7b8bd None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:12.812437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:12.829260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c8a61-0e02-42b3-b9e4-d1733fea5441 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:12.843160 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05c11c-d9b2-4622-abe6-0ecbcfd7b8bd None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:12.875887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cac643-8358-4d8c-be42-f12ce61a9a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:12.876598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cac643-8358-4d8c-be42-f12ce61a9a71 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:12.876825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cac643-8358-4d8c-be42-f12ce61a9a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:12.877103 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cac643-8358-4d8c-be42-f12ce61a9a71 None admin] PATH_INFO: `/v3/users/84fb532a82544cca8684c76f3a50f71a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:12.878291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cac643-8358-4d8c-be42-f12ce61a9a71 None admin] RBAC: Authorizing `identity:get_user(user_id=84fb532a82544cca8684c76f3a50f71a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:12.879810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cac643-8358-4d8c-be42-f12ce61a9a71 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:12.882339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 111/228] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:12 2022] GET /identity/v3/users/84fb532a82544cca8684c76f3a50f71a => generated 283 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:12.887904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cac643-8358-4d8c-be42-f12ce61a9a71 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:12.919222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265401e-a968-4239-bac9-a343340b680d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:12.919851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265401e-a968-4239-bac9-a343340b680d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:12.920137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265401e-a968-4239-bac9-a343340b680d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:12.920411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265401e-a968-4239-bac9-a343340b680d None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:12.921085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265401e-a968-4239-bac9-a343340b680d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:12.921386 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265401e-a968-4239-bac9-a343340b680d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:12.922774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265401e-a968-4239-bac9-a343340b680d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:12.943895 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 118/229] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:05:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:12.950264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265401e-a968-4239-bac9-a343340b680d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:12.993908 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:13.035714 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cac643-8358-4d8c-be42-f12ce61a9a71 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:13.073695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f806c-972d-437f-ade8-102527235b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:13.074830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f806c-972d-437f-ade8-102527235b3e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:13.075341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f806c-972d-437f-ade8-102527235b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:13.075959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f806c-972d-437f-ade8-102527235b3e None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:13.077754 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f806c-972d-437f-ade8-102527235b3e None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:13.079651 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f806c-972d-437f-ade8-102527235b3e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:13.082121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 112/230] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:12 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:13.093510 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f806c-972d-437f-ade8-102527235b3e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:13.176781 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265401e-a968-4239-bac9-a343340b680d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:13.248054 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bc32f-1dc3-426b-9734-2976a2896f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:13.249225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bc32f-1dc3-426b-9734-2976a2896f0c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:13.250019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bc32f-1dc3-426b-9734-2976a2896f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:13.250904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bc32f-1dc3-426b-9734-2976a2896f0c None admin] PATH_INFO: `/v3/users/84fb532a82544cca8684c76f3a50f71a` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:13.252662 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bc32f-1dc3-426b-9734-2976a2896f0c None admin] RBAC: Authorizing `identity:get_user(user_id=84fb532a82544cca8684c76f3a50f71a)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:13.254752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bc32f-1dc3-426b-9734-2976a2896f0c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:13.263147 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 119/231] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:12 2022] GET /identity/v3/users/84fb532a82544cca8684c76f3a50f71a => generated 283 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:13.263554 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f806c-972d-437f-ade8-102527235b3e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:13.272076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bc32f-1dc3-426b-9734-2976a2896f0c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:13.289517 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:13.289775 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:13.310409 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa870fd4-b380-4854-998c-03de0b16fef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:13.311415 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa870fd4-b380-4854-998c-03de0b16fef1 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:13.311847 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa870fd4-b380-4854-998c-03de0b16fef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:13.312531 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa870fd4-b380-4854-998c-03de0b16fef1 None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e/users/84fb532a82544cca8684c76f3a50f71a/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:13.315858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa870fd4-b380-4854-998c-03de0b16fef1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c380370c2d3b42b9a44e5b6771f49f7e, user_id=84fb532a82544cca8684c76f3a50f71a, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:13.318606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa870fd4-b380-4854-998c-03de0b16fef1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:13.342559 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 113/232] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:05:13 2022] PUT /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e/users/84fb532a82544cca8684c76f3a50f71a/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:05:13.424364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bc32f-1dc3-426b-9734-2976a2896f0c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:13.471329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1357ac4-fe85-4e47-b1cb-feb7be6537ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:13.472326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1357ac4-fe85-4e47-b1cb-feb7be6537ed None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:13.472780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1357ac4-fe85-4e47-b1cb-feb7be6537ed None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:13.473201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1357ac4-fe85-4e47-b1cb-feb7be6537ed None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:13.476920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1357ac4-fe85-4e47-b1cb-feb7be6537ed None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:13.478436 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1357ac4-fe85-4e47-b1cb-feb7be6537ed None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:13.480441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 120/233] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:13 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:13.488849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa870fd4-b380-4854-998c-03de0b16fef1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:13.645707 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa870fd4-b380-4854-998c-03de0b16fef1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:13.691096 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9f82d-bd02-4432-a351-a00601f960a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:13.692007 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9f82d-bd02-4432-a351-a00601f960a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:13.692434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9f82d-bd02-4432-a351-a00601f960a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:13.692877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9f82d-bd02-4432-a351-a00601f960a1 None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e/users/84fb532a82544cca8684c76f3a50f71a/roles/6f1196f44c2040ee86de4a614692041d` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:13.695440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9f82d-bd02-4432-a351-a00601f960a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c380370c2d3b42b9a44e5b6771f49f7e, user_id=84fb532a82544cca8684c76f3a50f71a, role_id=6f1196f44c2040ee86de4a614692041d)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:13.697115 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9f82d-bd02-4432-a351-a00601f960a1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:13.714700 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 114/234] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:05:13 2022] PUT /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e/users/84fb532a82544cca8684c76f3a50f71a/roles/6f1196f44c2040ee86de4a614692041d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:05:14.433378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4d581-e854-4ba8-9cad-2a9dd645ea32 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:14.433871 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4d581-e854-4ba8-9cad-2a9dd645ea32 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:14.433944 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4d581-e854-4ba8-9cad-2a9dd645ea32 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:14.435467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 121/235] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:14.441038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959d6f5-587b-4f2b-a57e-1a236b4e07c9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:14.441484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959d6f5-587b-4f2b-a57e-1a236b4e07c9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:14.441675 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959d6f5-587b-4f2b-a57e-1a236b4e07c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:14.473245 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5959d6f5-587b-4f2b-a57e-1a236b4e07c9 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:14.474501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5959d6f5-587b-4f2b-a57e-1a236b4e07c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:14.528194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:14.573662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 115/236] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:14.644312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccded02-4fc3-41c0-99d8-d4bdc2f01cd4 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:14.644626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccded02-4fc3-41c0-99d8-d4bdc2f01cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:14.644864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccded02-4fc3-41c0-99d8-d4bdc2f01cd4 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:14.646223 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 122/237] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:14.652325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84139a-7366-4980-bc71-ad4ebaa467b3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:14.652613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84139a-7366-4980-bc71-ad4ebaa467b3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:14.652888 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84139a-7366-4980-bc71-ad4ebaa467b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:14.681131 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8f84139a-7366-4980-bc71-ad4ebaa467b3 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:14.682259 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8f84139a-7366-4980-bc71-ad4ebaa467b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:14.781629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 116/238] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:14.896019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca47971-e433-4ca9-ae3b-5c4d9cb4905f None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:14.896340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca47971-e433-4ca9-ae3b-5c4d9cb4905f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:14.896572 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca47971-e433-4ca9-ae3b-5c4d9cb4905f None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:14.898245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 123/239] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:14.903352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f42c07-e366-4187-b80d-d243f6ea8bf2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:14.903698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f42c07-e366-4187-b80d-d243f6ea8bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:14.903966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f42c07-e366-4187-b80d-d243f6ea8bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:14.904504 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca47971-e433-4ca9-ae3b-5c4d9cb4905f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:14.930853 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b7f42c07-e366-4187-b80d-d243f6ea8bf2 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:14.932130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b7f42c07-e366-4187-b80d-d243f6ea8bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:15.032317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:15.065453 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 117/240] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:15.072313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca47971-e433-4ca9-ae3b-5c4d9cb4905f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:15.114045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f42c07-e366-4187-b80d-d243f6ea8bf2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:15.118759 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792328a-162c-4733-891b-b4fb2b36860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:15.119431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792328a-162c-4733-891b-b4fb2b36860a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:15.119715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792328a-162c-4733-891b-b4fb2b36860a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:15.119990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792328a-162c-4733-891b-b4fb2b36860a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:15.131019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792328a-162c-4733-891b-b4fb2b36860a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-0792328a-162c-4733-891b-b4fb2b36860a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:15.135984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:15.136868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:15.137978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:15.137978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:15.137978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:15.137978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:15.137978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:15.137978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:15.137978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:15.137978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:15.137978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:15.137978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:15.137978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:15.137978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:15.137978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 124/241] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:15.144694 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792328a-162c-4733-891b-b4fb2b36860a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:15.172091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:15.275466 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f42c07-e366-4187-b80d-d243f6ea8bf2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:15.315612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fa865-c28d-4c8f-a3b4-9b163803fc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:15.316445 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fa865-c28d-4c8f-a3b4-9b163803fc90 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:15.316736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fa865-c28d-4c8f-a3b4-9b163803fc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:15.317013 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fa865-c28d-4c8f-a3b4-9b163803fc90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:15.318245 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fa865-c28d-4c8f-a3b4-9b163803fc90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:15.320006 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fa865-c28d-4c8f-a3b4-9b163803fc90 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:15.321910 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 118/242] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:15.329798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fa865-c28d-4c8f-a3b4-9b163803fc90 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:15.338519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792328a-162c-4733-891b-b4fb2b36860a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:15.393967 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3769bb-ad0d-4296-bf01-e32a5b70b9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:15.395238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3769bb-ad0d-4296-bf01-e32a5b70b9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:15.395238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3769bb-ad0d-4296-bf01-e32a5b70b9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:15.395238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3769bb-ad0d-4296-bf01-e32a5b70b9d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:15.396059 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3769bb-ad0d-4296-bf01-e32a5b70b9d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:15.396363 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3769bb-ad0d-4296-bf01-e32a5b70b9d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:15.398281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3769bb-ad0d-4296-bf01-e32a5b70b9d6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:15.399683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:15.408071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 125/243] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:15.411312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3769bb-ad0d-4296-bf01-e32a5b70b9d6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:15.482296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:15.487402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fa865-c28d-4c8f-a3b4-9b163803fc90 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:15.522503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3769bb-ad0d-4296-bf01-e32a5b70b9d6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:15.531939 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf2c9e-8844-442e-bb3c-8dedfdc7707f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:15.533089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf2c9e-8844-442e-bb3c-8dedfdc7707f None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:15.533516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf2c9e-8844-442e-bb3c-8dedfdc7707f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:15.534224 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf2c9e-8844-442e-bb3c-8dedfdc7707f None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:15.535368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf2c9e-8844-442e-bb3c-8dedfdc7707f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:15.537116 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf2c9e-8844-442e-bb3c-8dedfdc7707f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:15.560854 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ca0e1-cc20-4501-9811-99b105433f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:15.561758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ca0e1-cc20-4501-9811-99b105433f49 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:15.562096 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ca0e1-cc20-4501-9811-99b105433f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:15.562475 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ca0e1-cc20-4501-9811-99b105433f49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:15.565083 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 119/244] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:05:15 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:05:15.566487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf2c9e-8844-442e-bb3c-8dedfdc7707f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:15.576707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ca0e1-cc20-4501-9811-99b105433f49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-742ca0e1-cc20-4501-9811-99b105433f49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:15.583034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:15.584121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:15.585235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:15.585235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:15.585235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:15.585235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:15.585235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:15.585235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:15.585235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:15.585235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:15.585235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:15.585235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:15.585235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:15.585235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:15.585235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 126/245] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:15.592423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ca0e1-cc20-4501-9811-99b105433f49 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:15.660012 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:15.728388 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf2c9e-8844-442e-bb3c-8dedfdc7707f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:15.752155 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ca0e1-cc20-4501-9811-99b105433f49 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:15.809980 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d686d8-61f4-4ef9-990c-8f9bdd764706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:15.812792 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d686d8-61f4-4ef9-990c-8f9bdd764706 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:15.813363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d686d8-61f4-4ef9-990c-8f9bdd764706 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:15.813788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d686d8-61f4-4ef9-990c-8f9bdd764706 None admin] PATH_INFO: `/v3/users/5692c434d49241f5bbc6e2ce8ff20e99` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:15.830578 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b69c6-431d-4669-bfbe-e471bf7beb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:15.831322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b69c6-431d-4669-bfbe-e471bf7beb71 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:15.831642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d686d8-61f4-4ef9-990c-8f9bdd764706 None admin] RBAC: Authorizing `identity:get_user(user_id=5692c434d49241f5bbc6e2ce8ff20e99)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:15.831758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b69c6-431d-4669-bfbe-e471bf7beb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:15.832054 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b69c6-431d-4669-bfbe-e471bf7beb71 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:15.832826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b69c6-431d-4669-bfbe-e471bf7beb71 None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:15.833110 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d686d8-61f4-4ef9-990c-8f9bdd764706 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:15.833261 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b69c6-431d-4669-bfbe-e471bf7beb71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:15.834844 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b69c6-431d-4669-bfbe-e471bf7beb71 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:15.835197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 120/246] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:15 2022] GET /identity/v3/users/5692c434d49241f5bbc6e2ce8ff20e99 => generated 297 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:15.840562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d686d8-61f4-4ef9-990c-8f9bdd764706 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:15.850905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 127/247] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:15.860491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b69c6-431d-4669-bfbe-e471bf7beb71 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:15.866649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:15.968479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d686d8-61f4-4ef9-990c-8f9bdd764706 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:16.012113 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b69c6-431d-4669-bfbe-e471bf7beb71 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:16.014643 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884db79-6801-4dac-ac61-6a4315cf4bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:16.016918 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884db79-6801-4dac-ac61-6a4315cf4bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:16.017429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884db79-6801-4dac-ac61-6a4315cf4bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:16.017987 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884db79-6801-4dac-ac61-6a4315cf4bf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:16.035885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:16.062142 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45554a28-d783-463f-b06a-d71058a9c825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:16.063925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45554a28-d783-463f-b06a-d71058a9c825 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:16.064285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45554a28-d783-463f-b06a-d71058a9c825 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:16.064636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45554a28-d783-463f-b06a-d71058a9c825 None admin] PATH_INFO: `/v3/users/918e420b623a4bf2ab035d8a137f7c1b` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:16.065982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45554a28-d783-463f-b06a-d71058a9c825 None admin] RBAC: Authorizing `identity:get_user(user_id=918e420b623a4bf2ab035d8a137f7c1b)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:16.067795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45554a28-d783-463f-b06a-d71058a9c825 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:16.070487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 128/248] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:15 2022] GET /identity/v3/users/918e420b623a4bf2ab035d8a137f7c1b => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:16.079019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45554a28-d783-463f-b06a-d71058a9c825 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:16.116579 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884db79-6801-4dac-ac61-6a4315cf4bf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:16.118293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884db79-6801-4dac-ac61-6a4315cf4bf9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:16.134097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:16.205707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45554a28-d783-463f-b06a-d71058a9c825 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:16.231564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 121/249] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:16.237468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884db79-6801-4dac-ac61-6a4315cf4bf9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:16.249467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93608b3-43c3-426c-b2a4-248ee1d737e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:16.250470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93608b3-43c3-426c-b2a4-248ee1d737e7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:16.253431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93608b3-43c3-426c-b2a4-248ee1d737e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:16.253996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93608b3-43c3-426c-b2a4-248ee1d737e7 None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:16.255562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93608b3-43c3-426c-b2a4-248ee1d737e7 None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:16.257821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93608b3-43c3-426c-b2a4-248ee1d737e7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:16.259867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 129/250] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:16 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:16.265766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93608b3-43c3-426c-b2a4-248ee1d737e7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:16.331580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:16.350914 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884db79-6801-4dac-ac61-6a4315cf4bf9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:16.366362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:16.380779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93608b3-43c3-426c-b2a4-248ee1d737e7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:16.393339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4e743-c5fb-46cc-a1fd-e92eca82c4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:16.394260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4e743-c5fb-46cc-a1fd-e92eca82c4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:16.394399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4e743-c5fb-46cc-a1fd-e92eca82c4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:16.394625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4e743-c5fb-46cc-a1fd-e92eca82c4f6 None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:16.395831 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4e743-c5fb-46cc-a1fd-e92eca82c4f6 None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:16.397604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4e743-c5fb-46cc-a1fd-e92eca82c4f6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:16.399411 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 122/251] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:16 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:16.401470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537f030-0e9f-44b4-8014-b7d0d649b6dd None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:16.401581 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537f030-0e9f-44b4-8014-b7d0d649b6dd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:16.402294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537f030-0e9f-44b4-8014-b7d0d649b6dd None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:16.403463 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 123/252] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:16.404594 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002032-c12d-4d1b-bce3-4115e5fc749b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:16.404878 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002032-c12d-4d1b-bce3-4115e5fc749b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:16.405149 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002032-c12d-4d1b-bce3-4115e5fc749b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:16.406360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 124/253] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:16.407052 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80002032-c12d-4d1b-bce3-4115e5fc749b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:16.434854 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14024c84-9d69-4fff-ac29-e99ffde0f54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:16.435601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14024c84-9d69-4fff-ac29-e99ffde0f54c None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:16.435874 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14024c84-9d69-4fff-ac29-e99ffde0f54c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:16.436150 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14024c84-9d69-4fff-ac29-e99ffde0f54c None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e/users/918e420b623a4bf2ab035d8a137f7c1b/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:16.438933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14024c84-9d69-4fff-ac29-e99ffde0f54c None admin] RBAC: Authorizing `identity:create_grant(project_id=c380370c2d3b42b9a44e5b6771f49f7e, user_id=918e420b623a4bf2ab035d8a137f7c1b, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:16.441415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14024c84-9d69-4fff-ac29-e99ffde0f54c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:16.460437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 130/254] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:05:16 2022] PUT /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e/users/918e420b623a4bf2ab035d8a137f7c1b/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:05:16.462352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e0af7-4b47-40bd-8160-59da8002ddc6 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:16.462696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e0af7-4b47-40bd-8160-59da8002ddc6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:16.462977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e0af7-4b47-40bd-8160-59da8002ddc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:16.489875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8c1e0af7-4b47-40bd-8160-59da8002ddc6 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:16.491430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8c1e0af7-4b47-40bd-8160-59da8002ddc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:16.530402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80002032-c12d-4d1b-bce3-4115e5fc749b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:16.587481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 131/255] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:16.589053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4653999-c3db-4752-94bc-ddf34894681f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:16.589348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4653999-c3db-4752-94bc-ddf34894681f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:16.589624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4653999-c3db-4752-94bc-ddf34894681f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:16.619637 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f4653999-c3db-4752-94bc-ddf34894681f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:16.620877 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f4653999-c3db-4752-94bc-ddf34894681f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:16.652384 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85690a95-793c-41b8-bb22-b868cbd9baef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:16.653019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85690a95-793c-41b8-bb22-b868cbd9baef None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:16.653299 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85690a95-793c-41b8-bb22-b868cbd9baef None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:16.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85690a95-793c-41b8-bb22-b868cbd9baef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:16.654329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85690a95-793c-41b8-bb22-b868cbd9baef None admin] RBAC: Adding query filter params (role.id=0a3b51ca53dc4d88b4be340e21144870, scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e, user.id=5692c434d49241f5bbc6e2ce8ff20e99) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:16.654639 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85690a95-793c-41b8-bb22-b868cbd9baef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:16.656197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85690a95-793c-41b8-bb22-b868cbd9baef None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:16.671609 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 125/256] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:16 2022] GET /identity/v3/role_assignments?user.id=5692c434d49241f5bbc6e2ce8ff20e99&scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e&role.id=0a3b51ca53dc4d88b4be340e21144870 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:16.698073 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:16.738910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 132/257] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:16.969254 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85690a95-793c-41b8-bb22-b868cbd9baef None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:17.024925 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:17.083059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85690a95-793c-41b8-bb22-b868cbd9baef None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:17.119109 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa56ace-0a12-460c-86d9-361d6493fca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:17.119758 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa56ace-0a12-460c-86d9-361d6493fca4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:17.120038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa56ace-0a12-460c-86d9-361d6493fca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:17.120311 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa56ace-0a12-460c-86d9-361d6493fca4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:17.135983 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa56ace-0a12-460c-86d9-361d6493fca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-5fa56ace-0a12-460c-86d9-361d6493fca4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:17.140931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:17.141810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:17.142587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:17.142587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:17.142587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:17.142587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:17.142587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:17.142587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:17.142587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:17.142587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:17.142587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:17.142587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:17.142587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:05:17.142587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:17.142587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 126/258] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:05:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:17.149982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4653999-c3db-4752-94bc-ddf34894681f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:17.250952 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa56ace-0a12-460c-86d9-361d6493fca4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:17.299733 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4653999-c3db-4752-94bc-ddf34894681f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:17.343797 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae6005-aa99-4e72-9e0d-3ab59be8276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:17.344503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae6005-aa99-4e72-9e0d-3ab59be8276e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:17.345066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae6005-aa99-4e72-9e0d-3ab59be8276e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:17.345346 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae6005-aa99-4e72-9e0d-3ab59be8276e None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:17.346026 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae6005-aa99-4e72-9e0d-3ab59be8276e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:17.346331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae6005-aa99-4e72-9e0d-3ab59be8276e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:17.347750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae6005-aa99-4e72-9e0d-3ab59be8276e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:17.358890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 133/259] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:17.364375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae6005-aa99-4e72-9e0d-3ab59be8276e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:17.408279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:17.485528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae6005-aa99-4e72-9e0d-3ab59be8276e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:17.521091 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507a5ea-18ff-4ab8-854c-a67ca99a867a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:17.521738 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507a5ea-18ff-4ab8-854c-a67ca99a867a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:17.522586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507a5ea-18ff-4ab8-854c-a67ca99a867a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:17.522866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507a5ea-18ff-4ab8-854c-a67ca99a867a None admin] PATH_INFO: `/v3/users/84fb532a82544cca8684c76f3a50f71a` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:17.524059 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507a5ea-18ff-4ab8-854c-a67ca99a867a None admin] RBAC: Authorizing `identity:get_user(user_id=84fb532a82544cca8684c76f3a50f71a)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:17.525835 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507a5ea-18ff-4ab8-854c-a67ca99a867a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:17.527536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 134/260] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:17 2022] GET /identity/v3/users/84fb532a82544cca8684c76f3a50f71a => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:17.536199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507a5ea-18ff-4ab8-854c-a67ca99a867a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:17.542650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa56ace-0a12-460c-86d9-361d6493fca4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:17.558524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:17.617091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79fb26-440a-48b7-b3e6-7a32c9feab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:17.617741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79fb26-440a-48b7-b3e6-7a32c9feab35 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:17.618023 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79fb26-440a-48b7-b3e6-7a32c9feab35 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:17.618296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79fb26-440a-48b7-b3e6-7a32c9feab35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:17.640487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79fb26-440a-48b7-b3e6-7a32c9feab35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-fe79fb26-440a-48b7-b3e6-7a32c9feab35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:17.650648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:17.651656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:17.652458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:17.652458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:17.652458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:17.652458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:17.652458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:17.652458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:17.652458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:17.652458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:17.652458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:17.652458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:17.652458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:17.652458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:17.654778 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 127/261] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:05:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:17.661321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79fb26-440a-48b7-b3e6-7a32c9feab35 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:17.741579 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507a5ea-18ff-4ab8-854c-a67ca99a867a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:17.747206 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:17.810107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79fb26-440a-48b7-b3e6-7a32c9feab35 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:17.819695 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c66fc5-2d16-4566-a936-54614d4a81ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:17.820650 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c66fc5-2d16-4566-a936-54614d4a81ed None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:17.821132 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c66fc5-2d16-4566-a936-54614d4a81ed None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:17.821629 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c66fc5-2d16-4566-a936-54614d4a81ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:17.860604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988c21d-5f59-4889-9d48-01fbe9f48f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:17.861572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988c21d-5f59-4889-9d48-01fbe9f48f89 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:17.862075 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988c21d-5f59-4889-9d48-01fbe9f48f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:17.862549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988c21d-5f59-4889-9d48-01fbe9f48f89 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:17.863865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988c21d-5f59-4889-9d48-01fbe9f48f89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:17.864569 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988c21d-5f59-4889-9d48-01fbe9f48f89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:17.867683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988c21d-5f59-4889-9d48-01fbe9f48f89 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:17.882754 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 128/262] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:05:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:17.892236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988c21d-5f59-4889-9d48-01fbe9f48f89 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:17.967434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:17.967727 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c66fc5-2d16-4566-a936-54614d4a81ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:17.970667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c66fc5-2d16-4566-a936-54614d4a81ed None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:18.094875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988c21d-5f59-4889-9d48-01fbe9f48f89 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:18.152741 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 135/263] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:18.158153 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c66fc5-2d16-4566-a936-54614d4a81ed None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:18.162300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2619c7-a0dc-4c72-9ab0-5f030c807564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:18.162999 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:18.164610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2619c7-a0dc-4c72-9ab0-5f030c807564 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:18.165104 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2619c7-a0dc-4c72-9ab0-5f030c807564 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:18.169772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2619c7-a0dc-4c72-9ab0-5f030c807564 None admin] PATH_INFO: `/v3/users/84fb532a82544cca8684c76f3a50f71a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:18.171826 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2619c7-a0dc-4c72-9ab0-5f030c807564 None admin] RBAC: Authorizing `identity:get_user(user_id=84fb532a82544cca8684c76f3a50f71a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:18.173293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2619c7-a0dc-4c72-9ab0-5f030c807564 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:18.175092 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 129/264] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:17 2022] GET /identity/v3/users/84fb532a82544cca8684c76f3a50f71a => generated 283 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:18.183124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2619c7-a0dc-4c72-9ab0-5f030c807564 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:18.336945 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c66fc5-2d16-4566-a936-54614d4a81ed None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:18.344027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:18.357027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2619c7-a0dc-4c72-9ab0-5f030c807564 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:18.373716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b011b0-5871-4b5b-a29b-d11312b84f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:18.374358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b011b0-5871-4b5b-a29b-d11312b84f5a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:18.374634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b011b0-5871-4b5b-a29b-d11312b84f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:18.374911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b011b0-5871-4b5b-a29b-d11312b84f5a None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:18.376050 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b011b0-5871-4b5b-a29b-d11312b84f5a None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:18.377490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b011b0-5871-4b5b-a29b-d11312b84f5a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:18.379481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 136/265] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:18 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:18.385027 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b011b0-5871-4b5b-a29b-d11312b84f5a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:18.449695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ed326-3b37-44a3-ad76-4da69e3ab764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:18.450333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ed326-3b37-44a3-ad76-4da69e3ab764 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:18.450619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ed326-3b37-44a3-ad76-4da69e3ab764 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:18.450898 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ed326-3b37-44a3-ad76-4da69e3ab764 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:18.467697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:18.510782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b011b0-5871-4b5b-a29b-d11312b84f5a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:18.539527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ed326-3b37-44a3-ad76-4da69e3ab764 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:18.541090 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ed326-3b37-44a3-ad76-4da69e3ab764 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:18.560621 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7da229-4718-49cd-89df-fdd8deecf8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:18.561599 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7da229-4718-49cd-89df-fdd8deecf8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:18.561881 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7da229-4718-49cd-89df-fdd8deecf8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:18.562153 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7da229-4718-49cd-89df-fdd8deecf8f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:18.562886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7da229-4718-49cd-89df-fdd8deecf8f3 None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e, user.id=84fb532a82544cca8684c76f3a50f71a) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:18.563219 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7da229-4718-49cd-89df-fdd8deecf8f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:18.565211 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7da229-4718-49cd-89df-fdd8deecf8f3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:18.575293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 137/266] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:18 2022] GET /identity/v3/role_assignments?user.id=84fb532a82544cca8684c76f3a50f71a&scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e&role.id=3799feb4caa64e568971222375957f54 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:18.651476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:18.660142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 130/267] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 01:05:18.666576 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7da229-4718-49cd-89df-fdd8deecf8f3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:18.812276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7da229-4718-49cd-89df-fdd8deecf8f3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:18.860093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd61326-168f-457d-93d9-9a0fe160571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:18.860765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd61326-168f-457d-93d9-9a0fe160571a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:18.861042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd61326-168f-457d-93d9-9a0fe160571a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:18.861314 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd61326-168f-457d-93d9-9a0fe160571a None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:18.862535 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd61326-168f-457d-93d9-9a0fe160571a None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:18.864035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd61326-168f-457d-93d9-9a0fe160571a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:18.866716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 138/268] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:18 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:18.872289 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ed326-3b37-44a3-ad76-4da69e3ab764 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:18.978957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ed326-3b37-44a3-ad76-4da69e3ab764 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:19.014171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b9036-fe58-4b31-9064-7bf6c22e8b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:19.014787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9036-fe58-4b31-9064-7bf6c22e8b08 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:19.015078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9036-fe58-4b31-9064-7bf6c22e8b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:19.015357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9036-fe58-4b31-9064-7bf6c22e8b08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:19.016170 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b9036-fe58-4b31-9064-7bf6c22e8b08 None admin] RBAC: Adding query filter params (role.id=6f1196f44c2040ee86de4a614692041d, scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e, user.id=84fb532a82544cca8684c76f3a50f71a) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:19.016518 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b9036-fe58-4b31-9064-7bf6c22e8b08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:19.018128 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b9036-fe58-4b31-9064-7bf6c22e8b08 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:19.025957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 131/269] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:18 2022] GET /identity/v3/role_assignments?user.id=84fb532a82544cca8684c76f3a50f71a&scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e&role.id=6f1196f44c2040ee86de4a614692041d => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:19.166404 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22562bff-1616-45dc-967b-f5469085cc7a None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:19.167179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22562bff-1616-45dc-967b-f5469085cc7a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:19.167694 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22562bff-1616-45dc-967b-f5469085cc7a None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:19.169658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 139/270] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:19.175645 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8545f-4679-4452-8652-3bfa0aa65d8c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:19.175920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8545f-4679-4452-8652-3bfa0aa65d8c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:19.176202 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8545f-4679-4452-8652-3bfa0aa65d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:19.200065 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7ea8545f-4679-4452-8652-3bfa0aa65d8c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:19.201536 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7ea8545f-4679-4452-8652-3bfa0aa65d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:19.267155 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:19.284433 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 132/271] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:19.413499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59892b64-0d3c-4044-9dfa-040f57cf1180 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:19.423649 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59892b64-0d3c-4044-9dfa-040f57cf1180 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:19.423952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59892b64-0d3c-4044-9dfa-040f57cf1180 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:19.425575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 140/272] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:19 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:19.431793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35cfa7-958b-4666-b7e2-578f2425573a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:19.432075 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35cfa7-958b-4666-b7e2-578f2425573a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:19.432354 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35cfa7-958b-4666-b7e2-578f2425573a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:19.455198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3a35cfa7-958b-4666-b7e2-578f2425573a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:19.456395 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3a35cfa7-958b-4666-b7e2-578f2425573a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:19.534788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 133/273] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:19.587378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59892b64-0d3c-4044-9dfa-040f57cf1180 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:19.592371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:19.701033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59892b64-0d3c-4044-9dfa-040f57cf1180 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:19.736235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b407c3-b400-4d25-8fe5-1839827dc891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:19.736863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b407c3-b400-4d25-8fe5-1839827dc891 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:19.737140 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b407c3-b400-4d25-8fe5-1839827dc891 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:19.737414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b407c3-b400-4d25-8fe5-1839827dc891 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:19.748581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b407c3-b400-4d25-8fe5-1839827dc891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a0b407c3-b400-4d25-8fe5-1839827dc891 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:19.754040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:19.754878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:19.755720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:19.755720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:19.755720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:19.755720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:19.755720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:19.755720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:19.755720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:19.755720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:19.755720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:19.755720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:19.755720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:19.755720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:19.755720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 141/274] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:19.761387 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35cfa7-958b-4666-b7e2-578f2425573a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:19.836483 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b407c3-b400-4d25-8fe5-1839827dc891 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:19.878700 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35cfa7-958b-4666-b7e2-578f2425573a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:19.900285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:19.908916 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:19.920384 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475718cc-4c70-479d-87c7-aff8dfe1206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:19.921158 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475718cc-4c70-479d-87c7-aff8dfe1206b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:19.921441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475718cc-4c70-479d-87c7-aff8dfe1206b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:19.921711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475718cc-4c70-479d-87c7-aff8dfe1206b None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:19.922387 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475718cc-4c70-479d-87c7-aff8dfe1206b None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:19.922689 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475718cc-4c70-479d-87c7-aff8dfe1206b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:19.924108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475718cc-4c70-479d-87c7-aff8dfe1206b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:19.933045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 134/275] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:19.934208 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f31d-3aed-41a5-b62d-5bc4ec256331 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:19.934500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f31d-3aed-41a5-b62d-5bc4ec256331 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:19.934776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f31d-3aed-41a5-b62d-5bc4ec256331 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:19.936022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 135/276] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:19.940443 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c016b04-5a45-415b-99b3-b1c279527d5d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:19.940729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c016b04-5a45-415b-99b3-b1c279527d5d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:19.941002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c016b04-5a45-415b-99b3-b1c279527d5d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:19.942362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 136/277] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:19.943053 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c016b04-5a45-415b-99b3-b1c279527d5d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:19.954754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b407c3-b400-4d25-8fe5-1839827dc891 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:19.988484 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e6ccb-917d-45d7-88bc-efac3e5f514e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:19.989106 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e6ccb-917d-45d7-88bc-efac3e5f514e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:19.989385 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e6ccb-917d-45d7-88bc-efac3e5f514e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:19.989659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e6ccb-917d-45d7-88bc-efac3e5f514e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:19.990780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e6ccb-917d-45d7-88bc-efac3e5f514e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:19.992274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e6ccb-917d-45d7-88bc-efac3e5f514e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:19.993823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 142/278] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:19.994917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eeb5a-7078-40a5-b479-e20e6ecfd777 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:19.995225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eeb5a-7078-40a5-b479-e20e6ecfd777 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:19.995496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eeb5a-7078-40a5-b479-e20e6ecfd777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:20.013336 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-292eeb5a-7078-40a5-b479-e20e6ecfd777 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:20.014521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-292eeb5a-7078-40a5-b479-e20e6ecfd777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:20.047497 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c016b04-5a45-415b-99b3-b1c279527d5d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:20.080695 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 143/279] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:20.081141 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1562ec-f343-4c32-87d5-c0f8c0187188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:20.081773 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1562ec-f343-4c32-87d5-c0f8c0187188 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:20.081966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329e981-4484-4949-95f5-04e15bbcacd4 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:20.082069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1562ec-f343-4c32-87d5-c0f8c0187188 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:20.082251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329e981-4484-4949-95f5-04e15bbcacd4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:20.082342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1562ec-f343-4c32-87d5-c0f8c0187188 None admin] PATH_INFO: `/v3/users/39e84b3c318c477385b1bcb352d9b4e5` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:20.082526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329e981-4484-4949-95f5-04e15bbcacd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:20.096134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1562ec-f343-4c32-87d5-c0f8c0187188 None admin] RBAC: Authorizing `identity:get_user(user_id=39e84b3c318c477385b1bcb352d9b4e5)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:20.097525 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1562ec-f343-4c32-87d5-c0f8c0187188 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:20.099191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 137/280] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:19 2022] GET /identity/v3/users/39e84b3c318c477385b1bcb352d9b4e5 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:20.103481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1562ec-f343-4c32-87d5-c0f8c0187188 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:20.108468 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0329e981-4484-4949-95f5-04e15bbcacd4 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:20.109718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0329e981-4484-4949-95f5-04e15bbcacd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:20.154120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:20.167630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:20.179056 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 144/281] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:20.180411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329e981-4484-4949-95f5-04e15bbcacd4 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:20.230210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1562ec-f343-4c32-87d5-c0f8c0187188 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:20.273557 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cca3a-3dec-478e-8693-752567bc7c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:20.274194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cca3a-3dec-478e-8693-752567bc7c3d None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:20.274473 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cca3a-3dec-478e-8693-752567bc7c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:20.274745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cca3a-3dec-478e-8693-752567bc7c3d None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:20.277099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cca3a-3dec-478e-8693-752567bc7c3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:20.278749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cca3a-3dec-478e-8693-752567bc7c3d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:20.289645 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329e981-4484-4949-95f5-04e15bbcacd4 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:20.315108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 138/282] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:05:20 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:05:20.330599 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84ad93-cef9-447d-b40f-f3d4cca6beb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:20.331256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ad93-cef9-447d-b40f-f3d4cca6beb8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:20.331538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ad93-cef9-447d-b40f-f3d4cca6beb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:20.331821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ad93-cef9-447d-b40f-f3d4cca6beb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:20.332556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84ad93-cef9-447d-b40f-f3d4cca6beb8 None admin] RBAC: Adding query filter params (role.id=6ce9c4ba7196458380036520a04c9404, user.id=39e84b3c318c477385b1bcb352d9b4e5, scope.system=all) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:20.332864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84ad93-cef9-447d-b40f-f3d4cca6beb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:20.334902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84ad93-cef9-447d-b40f-f3d4cca6beb8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:20.341194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 145/283] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Sep 13 01:05:20 2022] GET /identity/v3/role_assignments?user.id=39e84b3c318c477385b1bcb352d9b4e5&scope.system=all&role.id=6ce9c4ba7196458380036520a04c9404 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:20.360352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cca3a-3dec-478e-8693-752567bc7c3d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:20.482269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84ad93-cef9-447d-b40f-f3d4cca6beb8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:20.492676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:20.501731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cca3a-3dec-478e-8693-752567bc7c3d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:20.552804 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5346c-2f44-4595-961e-c5d67d7257bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:20.553846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5346c-2f44-4595-961e-c5d67d7257bf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:20.554262 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5346c-2f44-4595-961e-c5d67d7257bf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:20.554606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5346c-2f44-4595-961e-c5d67d7257bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:20.566733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5346c-2f44-4595-961e-c5d67d7257bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:20.568411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-37d5346c-2f44-4595-961e-c5d67d7257bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:20.573408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:20.574316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:20.576236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:20.576236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:20.576236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:20.576236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:20.576236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:20.576236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:20.576236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:20.576236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:20.576236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:20.576236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:20.576236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:20.576236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:20.579295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 139/284] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:20.582197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5346c-2f44-4595-961e-c5d67d7257bf None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:20.627791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84ad93-cef9-447d-b40f-f3d4cca6beb8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:20.671469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8c726-7731-41b5-b50e-3ea2254b7439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:20.672741 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c726-7731-41b5-b50e-3ea2254b7439 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:20.673513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c726-7731-41b5-b50e-3ea2254b7439 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:20.673968 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c726-7731-41b5-b50e-3ea2254b7439 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:20.688766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8c726-7731-41b5-b50e-3ea2254b7439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-d7b8c726-7731-41b5-b50e-3ea2254b7439 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:20.696248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:20.697162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:20.697941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:20.697941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:20.697941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:20.697941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:20.697941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:20.697941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:20.697941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:20.697941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:20.697941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:20.697941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:20.697941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:20.697941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:20.700678 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 146/285] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:20.702733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5346c-2f44-4595-961e-c5d67d7257bf None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:20.709875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8c726-7731-41b5-b50e-3ea2254b7439 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:20.760048 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9e1f4-4e1c-4b26-acce-e39ab01d5b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:20.760717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9e1f4-4e1c-4b26-acce-e39ab01d5b9b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:20.761000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9e1f4-4e1c-4b26-acce-e39ab01d5b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:20.761278 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9e1f4-4e1c-4b26-acce-e39ab01d5b9b None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:20.762484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9e1f4-4e1c-4b26-acce-e39ab01d5b9b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:20.762484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9e1f4-4e1c-4b26-acce-e39ab01d5b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:20.763743 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9e1f4-4e1c-4b26-acce-e39ab01d5b9b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:20.773674 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 140/286] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:20.779663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9e1f4-4e1c-4b26-acce-e39ab01d5b9b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:20.815839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:20.855899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8c726-7731-41b5-b50e-3ea2254b7439 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:20.898146 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:20.905852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9e1f4-4e1c-4b26-acce-e39ab01d5b9b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:20.942181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f0487-4d3c-4ef9-8bef-d920c355650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:20.942820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f0487-4d3c-4ef9-8bef-d920c355650e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:20.943120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f0487-4d3c-4ef9-8bef-d920c355650e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:20.943400 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f0487-4d3c-4ef9-8bef-d920c355650e None admin] PATH_INFO: `/v3/users/5692c434d49241f5bbc6e2ce8ff20e99` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:20.945170 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f0487-4d3c-4ef9-8bef-d920c355650e None admin] RBAC: Authorizing `identity:get_user(user_id=5692c434d49241f5bbc6e2ce8ff20e99)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:20.946629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f0487-4d3c-4ef9-8bef-d920c355650e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:20.948641 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 141/287] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:20 2022] GET /identity/v3/users/5692c434d49241f5bbc6e2ce8ff20e99 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:20.955455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f0487-4d3c-4ef9-8bef-d920c355650e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:20.959238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c35bb-b457-4e12-a82c-b650a76d8e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:20.960418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c35bb-b457-4e12-a82c-b650a76d8e65 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:20.960694 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c35bb-b457-4e12-a82c-b650a76d8e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:20.960955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c35bb-b457-4e12-a82c-b650a76d8e65 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:20.961682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c35bb-b457-4e12-a82c-b650a76d8e65 None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:20.961988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c35bb-b457-4e12-a82c-b650a76d8e65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:20.964331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c35bb-b457-4e12-a82c-b650a76d8e65 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:20.982425 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 147/288] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:20.987984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c35bb-b457-4e12-a82c-b650a76d8e65 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:21.099776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:21.119449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f0487-4d3c-4ef9-8bef-d920c355650e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:21.190294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c35bb-b457-4e12-a82c-b650a76d8e65 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:21.195199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287fe10-1538-4825-83b1-3e697fabfa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:21.196122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287fe10-1538-4825-83b1-3e697fabfa9f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:21.196596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287fe10-1538-4825-83b1-3e697fabfa9f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:21.197062 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287fe10-1538-4825-83b1-3e697fabfa9f None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:21.198410 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287fe10-1538-4825-83b1-3e697fabfa9f None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:21.202894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287fe10-1538-4825-83b1-3e697fabfa9f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:21.202894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 142/289] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:20 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:21.212211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287fe10-1538-4825-83b1-3e697fabfa9f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:21.244639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42d5c8-2325-44ae-ad2e-d6059c9d1eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:21.245329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42d5c8-2325-44ae-ad2e-d6059c9d1eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:21.245613 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42d5c8-2325-44ae-ad2e-d6059c9d1eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:21.245920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42d5c8-2325-44ae-ad2e-d6059c9d1eb1 None admin] PATH_INFO: `/v3/users/918e420b623a4bf2ab035d8a137f7c1b` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:21.247348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42d5c8-2325-44ae-ad2e-d6059c9d1eb1 None admin] RBAC: Authorizing `identity:get_user(user_id=918e420b623a4bf2ab035d8a137f7c1b)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:21.249307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42d5c8-2325-44ae-ad2e-d6059c9d1eb1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:21.251329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 148/290] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:20 2022] GET /identity/v3/users/918e420b623a4bf2ab035d8a137f7c1b => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:21.257438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42d5c8-2325-44ae-ad2e-d6059c9d1eb1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:21.314464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:21.383723 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287fe10-1538-4825-83b1-3e697fabfa9f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:21.432025 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69932f64-9146-44c7-8582-97915ddf5467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:21.432702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69932f64-9146-44c7-8582-97915ddf5467 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:21.432977 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69932f64-9146-44c7-8582-97915ddf5467 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:21.433248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69932f64-9146-44c7-8582-97915ddf5467 None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e/users/5692c434d49241f5bbc6e2ce8ff20e99/roles/0a3b51ca53dc4d88b4be340e21144870` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:21.436063 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69932f64-9146-44c7-8582-97915ddf5467 None admin] RBAC: Authorizing `identity:create_grant(project_id=c380370c2d3b42b9a44e5b6771f49f7e, user_id=5692c434d49241f5bbc6e2ce8ff20e99, role_id=0a3b51ca53dc4d88b4be340e21144870)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:21.437492 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69932f64-9146-44c7-8582-97915ddf5467 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:21.461489 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 143/291] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:05:21 2022] PUT /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e/users/5692c434d49241f5bbc6e2ce8ff20e99/roles/0a3b51ca53dc4d88b4be340e21144870 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:05:21.466781 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42d5c8-2325-44ae-ad2e-d6059c9d1eb1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:21.507765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff9bab-9bf7-4b41-a6a9-1758617e17e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:21.508390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff9bab-9bf7-4b41-a6a9-1758617e17e9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:21.508672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff9bab-9bf7-4b41-a6a9-1758617e17e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:21.508945 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff9bab-9bf7-4b41-a6a9-1758617e17e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:21.588087 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff9bab-9bf7-4b41-a6a9-1758617e17e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:21.589585 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff9bab-9bf7-4b41-a6a9-1758617e17e9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:21.644591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:21.717845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 149/292] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 01:05:21.723829 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69932f64-9146-44c7-8582-97915ddf5467 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:21.743668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:21.857953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69932f64-9146-44c7-8582-97915ddf5467 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:21.904670 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ae28f-3d1b-4489-bfba-2ba87a18fe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:21.905317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ae28f-3d1b-4489-bfba-2ba87a18fe62 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:21.905595 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ae28f-3d1b-4489-bfba-2ba87a18fe62 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:21.905869 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ae28f-3d1b-4489-bfba-2ba87a18fe62 None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:21.906995 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ae28f-3d1b-4489-bfba-2ba87a18fe62 None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:21.908450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ae28f-3d1b-4489-bfba-2ba87a18fe62 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:21.910300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 144/293] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:21 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:21.916525 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff9bab-9bf7-4b41-a6a9-1758617e17e9 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:22.063409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff9bab-9bf7-4b41-a6a9-1758617e17e9 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:22.109107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b05cd-14b1-4f55-8ff8-d9acdc23d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:22.109716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b05cd-14b1-4f55-8ff8-d9acdc23d9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:22.109993 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b05cd-14b1-4f55-8ff8-d9acdc23d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:22.110261 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b05cd-14b1-4f55-8ff8-d9acdc23d9a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:22.110985 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b05cd-14b1-4f55-8ff8-d9acdc23d9a3 None admin] RBAC: Adding query filter params (role.id=6ce9c4ba7196458380036520a04c9404, scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e, user.id=918e420b623a4bf2ab035d8a137f7c1b) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:22.111319 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b05cd-14b1-4f55-8ff8-d9acdc23d9a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:22.112899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b05cd-14b1-4f55-8ff8-d9acdc23d9a3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:22.119812 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 150/294] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:21 2022] GET /identity/v3/role_assignments?user.id=918e420b623a4bf2ab035d8a137f7c1b&scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e&role.id=6ce9c4ba7196458380036520a04c9404 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:22.869780 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8dacd-c310-484e-9721-d13ed4fec64c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:22.870784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8dacd-c310-484e-9721-d13ed4fec64c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:22.871302 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8dacd-c310-484e-9721-d13ed4fec64c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:22.872842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 145/295] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:22.878174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba10549-d913-48b3-9d35-0866d87a1ba2 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:22.878698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba10549-d913-48b3-9d35-0866d87a1ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:22.879196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba10549-d913-48b3-9d35-0866d87a1ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:22.902866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-fba10549-d913-48b3-9d35-0866d87a1ba2 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:22.904418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fba10549-d913-48b3-9d35-0866d87a1ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:22.908978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:22.986402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 151/296] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:23.063045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3b881-7a89-4cdf-9741-a1bb67fd7960 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:23.063045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3b881-7a89-4cdf-9741-a1bb67fd7960 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:23.063045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3b881-7a89-4cdf-9741-a1bb67fd7960 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:23.063721 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 146/297] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:23.069583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7120eb8-d667-4c84-b731-a8f3a02e2ead None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:23.069858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7120eb8-d667-4c84-b731-a8f3a02e2ead None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:23.070351 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7120eb8-d667-4c84-b731-a8f3a02e2ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:23.089708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e7120eb8-d667-4c84-b731-a8f3a02e2ead None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:23.091319 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e7120eb8-d667-4c84-b731-a8f3a02e2ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:23.162630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 152/298] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:23.281312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3b881-7a89-4cdf-9741-a1bb67fd7960 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:23.295264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6d57-dc62-44a4-bf0b-f8e91b47e23b None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:23.295862 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6d57-dc62-44a4-bf0b-f8e91b47e23b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:23.296334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6d57-dc62-44a4-bf0b-f8e91b47e23b None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:23.298137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 153/299] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:23.303429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc93eb3-bae9-4544-9669-2e3ef03e269a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:23.304123 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc93eb3-bae9-4544-9669-2e3ef03e269a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:23.304597 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc93eb3-bae9-4544-9669-2e3ef03e269a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:23.324392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-9bc93eb3-bae9-4544-9669-2e3ef03e269a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:23.325611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9bc93eb3-bae9-4544-9669-2e3ef03e269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:23.382805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:23.408877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3b881-7a89-4cdf-9741-a1bb67fd7960 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:23.410919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:23.419953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 154/300] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:05:23.445966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc93eb3-bae9-4544-9669-2e3ef03e269a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:23.456973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a02b0-69f0-4674-b078-ad344a475925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:23.458067 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a02b0-69f0-4674-b078-ad344a475925 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:23.458353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a02b0-69f0-4674-b078-ad344a475925 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:23.458627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a02b0-69f0-4674-b078-ad344a475925 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:23.473174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a02b0-69f0-4674-b078-ad344a475925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-069a02b0-69f0-4674-b078-ad344a475925 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:23.480589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:23.481469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:23.482266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:23.482266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:23.482266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:23.482266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:23.482266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:23.482266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:23.482266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:23.482266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:23.482266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:23.482266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:23.482266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:23.482266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:23.482266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 147/301] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:23.487790 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a02b0-69f0-4674-b078-ad344a475925 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:23.581644 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc93eb3-bae9-4544-9669-2e3ef03e269a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:23.604295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a02b0-69f0-4674-b078-ad344a475925 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:23.621844 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85443e2f-8d5e-42d1-a8bb-a28fbe33bb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:23.622788 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443e2f-8d5e-42d1-a8bb-a28fbe33bb4b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:23.623289 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443e2f-8d5e-42d1-a8bb-a28fbe33bb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:23.623752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443e2f-8d5e-42d1-a8bb-a28fbe33bb4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:23.635406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85443e2f-8d5e-42d1-a8bb-a28fbe33bb4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:23.638933 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b14de-1df9-45c0-bcf1-7fde7b3b806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:23.639588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b14de-1df9-45c0-bcf1-7fde7b3b806a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:23.639870 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b14de-1df9-45c0-bcf1-7fde7b3b806a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:23.640146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b14de-1df9-45c0-bcf1-7fde7b3b806a None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:23.640815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b14de-1df9-45c0-bcf1-7fde7b3b806a None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:23.641121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b14de-1df9-45c0-bcf1-7fde7b3b806a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-85443e2f-8d5e-42d1-a8bb-a28fbe33bb4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:23.642127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:23.643014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:23.643829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:23.643829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:23.643829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:23.643829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:23.643829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:23.643829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:23.643829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:23.643829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:23.643829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:23.643829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:23.643829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:23.643829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:23.644416 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b14de-1df9-45c0-bcf1-7fde7b3b806a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:23.647013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 155/302] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:05:23.655503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85443e2f-8d5e-42d1-a8bb-a28fbe33bb4b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:23.656856 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 148/303] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:23.662481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b14de-1df9-45c0-bcf1-7fde7b3b806a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:23.668131 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:23.730186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:23.775995 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85443e2f-8d5e-42d1-a8bb-a28fbe33bb4b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:23.778840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b14de-1df9-45c0-bcf1-7fde7b3b806a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:23.813501 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b395e-8479-4f6c-81be-e4d0017586ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:23.814134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b395e-8479-4f6c-81be-e4d0017586ff None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:23.814414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b395e-8479-4f6c-81be-e4d0017586ff None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:23.814686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b395e-8479-4f6c-81be-e4d0017586ff None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:23.815415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b395e-8479-4f6c-81be-e4d0017586ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:23.815721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b395e-8479-4f6c-81be-e4d0017586ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:23.816826 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f1eaf-905e-462a-8497-3fa7b3b2d5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:23.817141 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b395e-8479-4f6c-81be-e4d0017586ff None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:23.817947 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1eaf-905e-462a-8497-3fa7b3b2d5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:23.818468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1eaf-905e-462a-8497-3fa7b3b2d5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:23.818935 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1eaf-905e-462a-8497-3fa7b3b2d5f5 None admin] PATH_INFO: `/v3/users/39e84b3c318c477385b1bcb352d9b4e5` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:23.820458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f1eaf-905e-462a-8497-3fa7b3b2d5f5 None admin] RBAC: Authorizing `identity:get_user(user_id=39e84b3c318c477385b1bcb352d9b4e5)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:23.822179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f1eaf-905e-462a-8497-3fa7b3b2d5f5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:23.824175 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 149/304] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:23 2022] GET /identity/v3/users/39e84b3c318c477385b1bcb352d9b4e5 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:23.829501 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 156/305] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:23.832249 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f1eaf-905e-462a-8497-3fa7b3b2d5f5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:23.832416 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b395e-8479-4f6c-81be-e4d0017586ff None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:23.909616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:23.940066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b395e-8479-4f6c-81be-e4d0017586ff None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:23.944260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f1eaf-905e-462a-8497-3fa7b3b2d5f5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:23.963283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:23.974901 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72654146-6f11-48ec-ba18-bd600a81e8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:23.975564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72654146-6f11-48ec-ba18-bd600a81e8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:23.975843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72654146-6f11-48ec-ba18-bd600a81e8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:23.976120 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72654146-6f11-48ec-ba18-bd600a81e8c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:23.977248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72654146-6f11-48ec-ba18-bd600a81e8c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:23.978703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72654146-6f11-48ec-ba18-bd600a81e8c5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:23.979775 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be7850-3ad9-4ba9-846c-00ceeb36ea56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:23.980343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 157/306] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:23.980446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be7850-3ad9-4ba9-846c-00ceeb36ea56 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:23.980691 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be7850-3ad9-4ba9-846c-00ceeb36ea56 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:23.980964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be7850-3ad9-4ba9-846c-00ceeb36ea56 None admin] PATH_INFO: `/v3/system/users/39e84b3c318c477385b1bcb352d9b4e5/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:23.981051 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72654146-6f11-48ec-ba18-bd600a81e8c5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:23.982400 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be7850-3ad9-4ba9-846c-00ceeb36ea56 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=39e84b3c318c477385b1bcb352d9b4e5, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:23.983881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be7850-3ad9-4ba9-846c-00ceeb36ea56 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:23.992387 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 150/307] 10.222.0.20 () {58 vars in 1334 bytes} [Tue Sep 13 01:05:23 2022] PUT /identity/v3/system/users/39e84b3c318c477385b1bcb352d9b4e5/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:05:24.000644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2d0b4-0f3c-4fcc-ac4f-21297d363629 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:24.000966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2d0b4-0f3c-4fcc-ac4f-21297d363629 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:24.001259 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2d0b4-0f3c-4fcc-ac4f-21297d363629 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:24.002741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 151/308] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:24.003598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2d0b4-0f3c-4fcc-ac4f-21297d363629 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:24.096152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72654146-6f11-48ec-ba18-bd600a81e8c5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:24.126174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2d0b4-0f3c-4fcc-ac4f-21297d363629 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:24.137701 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ec75b-935e-4846-933b-b073430d0874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:24.138356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ec75b-935e-4846-933b-b073430d0874 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:24.138634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ec75b-935e-4846-933b-b073430d0874 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:24.138911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ec75b-935e-4846-933b-b073430d0874 None admin] PATH_INFO: `/v3/users/d5900bc5f2f54cd7a5e227f3980b222e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:24.154286 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ec75b-935e-4846-933b-b073430d0874 None admin] RBAC: Authorizing `identity:get_user(user_id=d5900bc5f2f54cd7a5e227f3980b222e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:24.155807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ec75b-935e-4846-933b-b073430d0874 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:24.162341 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 158/309] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:23 2022] GET /identity/v3/users/d5900bc5f2f54cd7a5e227f3980b222e => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:24.162341 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8631cae-415a-4154-b0ef-99b993467a22 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:24.162341 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8631cae-415a-4154-b0ef-99b993467a22 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:24.162341 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8631cae-415a-4154-b0ef-99b993467a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:24.175577 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff3d76-991e-4d0c-9c5d-8aef081ae649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:24.176196 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff3d76-991e-4d0c-9c5d-8aef081ae649 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:24.176479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff3d76-991e-4d0c-9c5d-8aef081ae649 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:24.176751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff3d76-991e-4d0c-9c5d-8aef081ae649 None admin] PATH_INFO: `/v3/groups` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:24.177391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff3d76-991e-4d0c-9c5d-8aef081ae649 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:24.179534 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff3d76-991e-4d0c-9c5d-8aef081ae649 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:24.180774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c8631cae-415a-4154-b0ef-99b993467a22 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:24.181964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c8631cae-415a-4154-b0ef-99b993467a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:24.185517 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:24.197799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 152/310] 10.222.0.20 () {60 vars in 1134 bytes} [Tue Sep 13 01:05:24 2022] POST /identity/v3/groups => generated 229 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:05:24.198797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff3d76-991e-4d0c-9c5d-8aef081ae649 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:24.232345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:24.263528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 159/311] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:24.337064 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff3d76-991e-4d0c-9c5d-8aef081ae649 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:24.376714 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e6ae6-bcdb-4bf9-8c25-0f39ec5fc1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:24.377344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e6ae6-bcdb-4bf9-8c25-0f39ec5fc1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:24.377622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e6ae6-bcdb-4bf9-8c25-0f39ec5fc1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:24.377896 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e6ae6-bcdb-4bf9-8c25-0f39ec5fc1d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:24.378641 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e6ae6-bcdb-4bf9-8c25-0f39ec5fc1d4 None admin] RBAC: Adding query filter params (role.id=0a3b51ca53dc4d88b4be340e21144870, user.id=d5900bc5f2f54cd7a5e227f3980b222e, scope.system=all) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:24.378997 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e6ae6-bcdb-4bf9-8c25-0f39ec5fc1d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:24.380624 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e6ae6-bcdb-4bf9-8c25-0f39ec5fc1d4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:24.386872 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 153/312] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Sep 13 01:05:24 2022] GET /identity/v3/role_assignments?user.id=d5900bc5f2f54cd7a5e227f3980b222e&scope.system=all&role.id=0a3b51ca53dc4d88b4be340e21144870 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:24.546359 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8631cae-415a-4154-b0ef-99b993467a22 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:24.651619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8631cae-415a-4154-b0ef-99b993467a22 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:24.687499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d5b39-7038-4e0e-9a15-6d8f9ee7fb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:24.688508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d5b39-7038-4e0e-9a15-6d8f9ee7fb13 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:24.689005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d5b39-7038-4e0e-9a15-6d8f9ee7fb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:24.689480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d5b39-7038-4e0e-9a15-6d8f9ee7fb13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:24.701112 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d5b39-7038-4e0e-9a15-6d8f9ee7fb13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-c54d5b39-7038-4e0e-9a15-6d8f9ee7fb13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:24.706563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:24.707486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:24.708283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:24.708283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:24.708283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:24.708283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:24.708283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:24.708283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:24.708283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:24.708283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:24.708283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:24.708283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:24.708283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:24.708283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:24.710650 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 160/313] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:24.716592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e6ae6-bcdb-4bf9-8c25-0f39ec5fc1d4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:24.781294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:24.825811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e6ae6-bcdb-4bf9-8c25-0f39ec5fc1d4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:24.860813 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94452b17-7a09-4a87-b07b-76ff7e6be4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:24.861428 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94452b17-7a09-4a87-b07b-76ff7e6be4ef None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:24.861708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94452b17-7a09-4a87-b07b-76ff7e6be4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:24.861981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94452b17-7a09-4a87-b07b-76ff7e6be4ef None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:24.862654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94452b17-7a09-4a87-b07b-76ff7e6be4ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:24.862956 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94452b17-7a09-4a87-b07b-76ff7e6be4ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:24.864371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94452b17-7a09-4a87-b07b-76ff7e6be4ef None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:24.873783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 154/314] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:24.879312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d5b39-7038-4e0e-9a15-6d8f9ee7fb13 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:24.921589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:24.989125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d5b39-7038-4e0e-9a15-6d8f9ee7fb13 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:25.025806 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545b40c-1820-48bf-a1fa-fc8d951ad812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:25.026443 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545b40c-1820-48bf-a1fa-fc8d951ad812 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:25.026720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545b40c-1820-48bf-a1fa-fc8d951ad812 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:25.026993 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545b40c-1820-48bf-a1fa-fc8d951ad812 None admin] PATH_INFO: `/v3/users/5692c434d49241f5bbc6e2ce8ff20e99` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:25.028174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545b40c-1820-48bf-a1fa-fc8d951ad812 None admin] RBAC: Authorizing `identity:get_user(user_id=5692c434d49241f5bbc6e2ce8ff20e99)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:25.029627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545b40c-1820-48bf-a1fa-fc8d951ad812 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:25.031543 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 161/315] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:24 2022] GET /identity/v3/users/5692c434d49241f5bbc6e2ce8ff20e99 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:25.037168 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94452b17-7a09-4a87-b07b-76ff7e6be4ef None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:25.140574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94452b17-7a09-4a87-b07b-76ff7e6be4ef None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:25.170572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:25.182883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c9d37-b93b-46f4-888d-460bede1b1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:25.183531 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c9d37-b93b-46f4-888d-460bede1b1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:25.183804 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c9d37-b93b-46f4-888d-460bede1b1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:25.184086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c9d37-b93b-46f4-888d-460bede1b1c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:25.253794 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c9d37-b93b-46f4-888d-460bede1b1c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:25.255282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c9d37-b93b-46f4-888d-460bede1b1c8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:25.359939 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 155/316] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:25.365278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545b40c-1820-48bf-a1fa-fc8d951ad812 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:25.471335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545b40c-1820-48bf-a1fa-fc8d951ad812 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:25.479459 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:25.507697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f16b79-6861-4c22-97bf-b49ec999832e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:25.508332 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f16b79-6861-4c22-97bf-b49ec999832e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:25.508610 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f16b79-6861-4c22-97bf-b49ec999832e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:25.508886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f16b79-6861-4c22-97bf-b49ec999832e None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:25.510031 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f16b79-6861-4c22-97bf-b49ec999832e None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:25.511482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f16b79-6861-4c22-97bf-b49ec999832e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:25.513409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 162/317] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:25 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:25.519267 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c9d37-b93b-46f4-888d-460bede1b1c8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:25.544467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:25.623953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c9d37-b93b-46f4-888d-460bede1b1c8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:25.658706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043b144-82f3-4165-b93d-b79a7c3fcf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:25.659344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043b144-82f3-4165-b93d-b79a7c3fcf18 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:25.659620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043b144-82f3-4165-b93d-b79a7c3fcf18 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:25.659891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043b144-82f3-4165-b93d-b79a7c3fcf18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:25.660610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043b144-82f3-4165-b93d-b79a7c3fcf18 None admin] RBAC: Adding query filter params (role.id=0a3b51ca53dc4d88b4be340e21144870, scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e, user.id=5692c434d49241f5bbc6e2ce8ff20e99) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:25.660912 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043b144-82f3-4165-b93d-b79a7c3fcf18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:25.662672 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043b144-82f3-4165-b93d-b79a7c3fcf18 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:25.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 156/318] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:25 2022] GET /identity/v3/role_assignments?user.id=5692c434d49241f5bbc6e2ce8ff20e99&scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e&role.id=0a3b51ca53dc4d88b4be340e21144870 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:26.309661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2faa78f-d376-4689-954f-8a80a19f16e6 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:26.310066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2faa78f-d376-4689-954f-8a80a19f16e6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:26.310338 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2faa78f-d376-4689-954f-8a80a19f16e6 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:26.311756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 163/319] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:26.317187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8900937-1efd-48d9-bdb4-d346774ccda0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:26.317692 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8900937-1efd-48d9-bdb4-d346774ccda0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:26.317764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8900937-1efd-48d9-bdb4-d346774ccda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:26.338447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a8900937-1efd-48d9-bdb4-d346774ccda0 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:26.339730 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a8900937-1efd-48d9-bdb4-d346774ccda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:26.410387 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 157/320] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:26.448075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec02093-4645-4b83-9515-6fa3feb2ba18 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:26.448548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec02093-4645-4b83-9515-6fa3feb2ba18 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:26.448650 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec02093-4645-4b83-9515-6fa3feb2ba18 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:26.449946 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 164/321] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:26.455726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a4bdb-92c9-44ea-9b43-ea52b2f290d6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:26.456019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a4bdb-92c9-44ea-9b43-ea52b2f290d6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:26.456295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a4bdb-92c9-44ea-9b43-ea52b2f290d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:26.475696 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-091a4bdb-92c9-44ea-9b43-ea52b2f290d6 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:26.476891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-091a4bdb-92c9-44ea-9b43-ea52b2f290d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:26.488244 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:26.550255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 158/322] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:26.635873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25b7e1-8dee-4fbe-a830-94a0d849adc2 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:26.636148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25b7e1-8dee-4fbe-a830-94a0d849adc2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:26.636343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25b7e1-8dee-4fbe-a830-94a0d849adc2 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:26.637799 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 165/323] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:26.642681 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126bada-200e-4682-86f0-a2a491ec5348 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:26.642972 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126bada-200e-4682-86f0-a2a491ec5348 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:26.643275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126bada-200e-4682-86f0-a2a491ec5348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:26.662591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a126bada-200e-4682-86f0-a2a491ec5348 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:26.663824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a126bada-200e-4682-86f0-a2a491ec5348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:26.682310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25b7e1-8dee-4fbe-a830-94a0d849adc2 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:26.734054 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 159/324] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:26.792504 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25b7e1-8dee-4fbe-a830-94a0d849adc2 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:26.833726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab55d4c-5ca3-48f4-b924-1fe946dd160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:26.835375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab55d4c-5ca3-48f4-b924-1fe946dd160e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:26.835941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab55d4c-5ca3-48f4-b924-1fe946dd160e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:26.836428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab55d4c-5ca3-48f4-b924-1fe946dd160e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:26.841496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126bada-200e-4682-86f0-a2a491ec5348 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:26.848996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab55d4c-5ca3-48f4-b924-1fe946dd160e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-8ab55d4c-5ca3-48f4-b924-1fe946dd160e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:26.855415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:26.856303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:26.857564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:26.857564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:26.857564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:26.857564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:26.857564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:26.857564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:26.857564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:26.857564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:26.857564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:26.857564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:26.857564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:26.857564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:26.857564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 166/325] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:05:26.862044 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab55d4c-5ca3-48f4-b924-1fe946dd160e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:26.899460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:26.926282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:26.951658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126bada-200e-4682-86f0-a2a491ec5348 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:26.971724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab55d4c-5ca3-48f4-b924-1fe946dd160e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:26.989206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704b8a0-c5a9-48bb-9cd2-4b8c57d90152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:26.989921 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704b8a0-c5a9-48bb-9cd2-4b8c57d90152 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:26.990269 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704b8a0-c5a9-48bb-9cd2-4b8c57d90152 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:26.990764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704b8a0-c5a9-48bb-9cd2-4b8c57d90152 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:26.991931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704b8a0-c5a9-48bb-9cd2-4b8c57d90152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:26.993347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704b8a0-c5a9-48bb-9cd2-4b8c57d90152 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:26.994933 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 160/326] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:27.000255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704b8a0-c5a9-48bb-9cd2-4b8c57d90152 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:27.009060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a5583-c518-433e-a85c-ae0f87e553e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:27.009670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5583-c518-433e-a85c-ae0f87e553e7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:27.009948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5583-c518-433e-a85c-ae0f87e553e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:27.010222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5583-c518-433e-a85c-ae0f87e553e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:27.010885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a5583-c518-433e-a85c-ae0f87e553e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:27.011229 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a5583-c518-433e-a85c-ae0f87e553e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:27.012604 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a5583-c518-433e-a85c-ae0f87e553e7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:27.020652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 167/327] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:27.020652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a5583-c518-433e-a85c-ae0f87e553e7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:27.103772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704b8a0-c5a9-48bb-9cd2-4b8c57d90152 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:27.114121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:27.121803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a5583-c518-433e-a85c-ae0f87e553e7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:27.139117 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1ac6b-cd31-453a-a28c-eb08cf036d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:27.139785 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1ac6b-cd31-453a-a28c-eb08cf036d1a None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:27.140067 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1ac6b-cd31-453a-a28c-eb08cf036d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:27.140342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1ac6b-cd31-453a-a28c-eb08cf036d1a None admin] PATH_INFO: `/v3/groups` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:27.140988 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1ac6b-cd31-453a-a28c-eb08cf036d1a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:27.142432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1ac6b-cd31-453a-a28c-eb08cf036d1a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:27.155851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1a0d8-0732-47f5-8090-ba9b011ea077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:27.156416 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1a0d8-0732-47f5-8090-ba9b011ea077 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:27.156535 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 161/328] 10.222.0.20 () {60 vars in 1134 bytes} [Tue Sep 13 01:05:26 2022] POST /identity/v3/groups => generated 226 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:05:27.156695 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1a0d8-0732-47f5-8090-ba9b011ea077 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:27.156965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1a0d8-0732-47f5-8090-ba9b011ea077 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:27.157213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1ac6b-cd31-453a-a28c-eb08cf036d1a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:27.168675 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1a0d8-0732-47f5-8090-ba9b011ea077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:27.173575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-49c1a0d8-0732-47f5-8090-ba9b011ea077 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:27.174982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:27.176348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:27.177137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:27.177137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:27.177137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:27.177137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:27.177137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:27.177137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:27.177137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:27.177137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:27.177137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:27.177137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:27.177137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:27.177137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:27.177137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 168/329] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:27.184917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1a0d8-0732-47f5-8090-ba9b011ea077 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:27.292812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1ac6b-cd31-453a-a28c-eb08cf036d1a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:27.295189 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1a0d8-0732-47f5-8090-ba9b011ea077 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:27.332944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0cbe5-55ab-4d10-933d-9ab6a6259a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:27.333589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0cbe5-55ab-4d10-933d-9ab6a6259a02 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:27.333903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0cbe5-55ab-4d10-933d-9ab6a6259a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:27.334181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0cbe5-55ab-4d10-933d-9ab6a6259a02 None admin] PATH_INFO: `/v3/users/39e84b3c318c477385b1bcb352d9b4e5` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:27.334659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82c01e-d520-45b5-8f9d-d02318515111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:27.335422 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82c01e-d520-45b5-8f9d-d02318515111 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:27.335607 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0cbe5-55ab-4d10-933d-9ab6a6259a02 None admin] RBAC: Authorizing `identity:get_user(user_id=39e84b3c318c477385b1bcb352d9b4e5)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:27.335766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82c01e-d520-45b5-8f9d-d02318515111 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:27.336011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82c01e-d520-45b5-8f9d-d02318515111 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:27.337216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82c01e-d520-45b5-8f9d-d02318515111 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:27.337216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82c01e-d520-45b5-8f9d-d02318515111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:27.337372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0cbe5-55ab-4d10-933d-9ab6a6259a02 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:27.339060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82c01e-d520-45b5-8f9d-d02318515111 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:27.339203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 162/330] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:27 2022] GET /identity/v3/users/39e84b3c318c477385b1bcb352d9b4e5 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:27.344211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0cbe5-55ab-4d10-933d-9ab6a6259a02 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:27.347537 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 169/331] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:27.353271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82c01e-d520-45b5-8f9d-d02318515111 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:27.375584 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:27.428131 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:27.472533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0cbe5-55ab-4d10-933d-9ab6a6259a02 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:27.477817 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82c01e-d520-45b5-8f9d-d02318515111 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:27.519591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d27cf5-b59b-4d7b-8371-e3e8ebde1855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:27.520511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d27cf5-b59b-4d7b-8371-e3e8ebde1855 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:27.520944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d27cf5-b59b-4d7b-8371-e3e8ebde1855 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:27.521256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d27cf5-b59b-4d7b-8371-e3e8ebde1855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:27.522019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d27cf5-b59b-4d7b-8371-e3e8ebde1855 None admin] RBAC: Adding query filter params (role.id=6ce9c4ba7196458380036520a04c9404, user.id=39e84b3c318c477385b1bcb352d9b4e5, scope.system=all) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:27.522323 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d27cf5-b59b-4d7b-8371-e3e8ebde1855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:27.523924 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d27cf5-b59b-4d7b-8371-e3e8ebde1855 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:27.528764 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd2106-705c-4487-b66d-397d86e4745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:27.529108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd2106-705c-4487-b66d-397d86e4745b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:27.529397 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd2106-705c-4487-b66d-397d86e4745b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:27.529678 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd2106-705c-4487-b66d-397d86e4745b None admin] PATH_INFO: `/v3/users/d5900bc5f2f54cd7a5e227f3980b222e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:27.530826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd2106-705c-4487-b66d-397d86e4745b None admin] RBAC: Authorizing `identity:get_user(user_id=d5900bc5f2f54cd7a5e227f3980b222e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:27.532523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd2106-705c-4487-b66d-397d86e4745b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:27.534192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 170/332] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:27 2022] GET /identity/v3/users/d5900bc5f2f54cd7a5e227f3980b222e => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:27.541564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 163/333] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Sep 13 01:05:27 2022] GET /identity/v3/role_assignments?user.id=39e84b3c318c477385b1bcb352d9b4e5&scope.system=all&role.id=6ce9c4ba7196458380036520a04c9404 => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:27.541900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd2106-705c-4487-b66d-397d86e4745b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:27.644514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:27.665315 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd2106-705c-4487-b66d-397d86e4745b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:27.705545 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a495c-3ad7-4e72-8738-d310270997f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:27.706208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a495c-3ad7-4e72-8738-d310270997f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:27.706490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a495c-3ad7-4e72-8738-d310270997f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:27.706762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a495c-3ad7-4e72-8738-d310270997f8 None admin] PATH_INFO: `/v3/system/users/d5900bc5f2f54cd7a5e227f3980b222e/roles/0a3b51ca53dc4d88b4be340e21144870` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:27.708264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a495c-3ad7-4e72-8738-d310270997f8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d5900bc5f2f54cd7a5e227f3980b222e, role_id=0a3b51ca53dc4d88b4be340e21144870)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:27.710279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a495c-3ad7-4e72-8738-d310270997f8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:27.723905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 171/334] 10.222.0.20 () {58 vars in 1334 bytes} [Tue Sep 13 01:05:27 2022] PUT /identity/v3/system/users/d5900bc5f2f54cd7a5e227f3980b222e/roles/0a3b51ca53dc4d88b4be340e21144870 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:05:29.791826 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a34b53-b4f6-4965-b56d-333d9c4dca30 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:29.792322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a34b53-b4f6-4965-b56d-333d9c4dca30 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:29.792397 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a34b53-b4f6-4965-b56d-333d9c4dca30 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:29.793992 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 164/335] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:29.800784 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f59b8-dfa9-4a64-81cf-815e92ec0a49 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:29.801696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f59b8-dfa9-4a64-81cf-815e92ec0a49 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:29.802186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f59b8-dfa9-4a64-81cf-815e92ec0a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:29.830974 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ea3f59b8-dfa9-4a64-81cf-815e92ec0a49 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:29.832221 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ea3f59b8-dfa9-4a64-81cf-815e92ec0a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:29.915646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 172/336] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:30.459518 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a34b53-b4f6-4965-b56d-333d9c4dca30 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:30.601136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a34b53-b4f6-4965-b56d-333d9c4dca30 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:30.638754 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:30.644760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a15dd-9c29-427b-af30-69d9c9890ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:30.645739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a15dd-9c29-427b-af30-69d9c9890ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:30.646844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a15dd-9c29-427b-af30-69d9c9890ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:30.647144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a15dd-9c29-427b-af30-69d9c9890ee6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:30.658766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd6d83-59c5-41db-a745-a011cd128654 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:30.659088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd6d83-59c5-41db-a745-a011cd128654 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:30.659334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd6d83-59c5-41db-a745-a011cd128654 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:30.661003 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 173/337] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:30.663367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a15dd-9c29-427b-af30-69d9c9890ee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:30.666861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb92645-2e61-4d9e-a34d-9196e4b6ee77 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:30.667371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb92645-2e61-4d9e-a34d-9196e4b6ee77 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:30.667855 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb92645-2e61-4d9e-a34d-9196e4b6ee77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-044a15dd-9c29-427b-af30-69d9c9890ee6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:30.668325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:30.669203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:30.670009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:30.670009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:30.670009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:30.670009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:30.670009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:30.670009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:30.670009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:30.670009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:30.670009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:30.670009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:30.670009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:30.670009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:30.670009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 165/338] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:30.679102 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a15dd-9c29-427b-af30-69d9c9890ee6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:30.705786 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8fb92645-2e61-4d9e-a34d-9196e4b6ee77 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:30.710522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8fb92645-2e61-4d9e-a34d-9196e4b6ee77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:30.827430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 174/339] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:05:30.829447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19073cb2-7148-4cde-84fe-3e48991d98d9 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:30.829965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19073cb2-7148-4cde-84fe-3e48991d98d9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:30.830440 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19073cb2-7148-4cde-84fe-3e48991d98d9 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:30.831916 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 175/340] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:30.833128 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8738f4-9a3c-4da3-8ee8-8e5e67f93232 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:30.834040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8738f4-9a3c-4da3-8ee8-8e5e67f93232 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:30.834527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8738f4-9a3c-4da3-8ee8-8e5e67f93232 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:30.835977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 176/341] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:30.838260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a18a31-175c-41ee-9847-7e8fdd45acdb None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:30.838781 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a18a31-175c-41ee-9847-7e8fdd45acdb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:30.839290 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a18a31-175c-41ee-9847-7e8fdd45acdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:30.843924 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a15dd-9c29-427b-af30-69d9c9890ee6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:30.867445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-07a18a31-175c-41ee-9847-7e8fdd45acdb None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:30.869093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-07a18a31-175c-41ee-9847-7e8fdd45acdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:30.875445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:30.912336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29909e15-4813-43e6-bd1f-483f97207f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:30.913598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29909e15-4813-43e6-bd1f-483f97207f7d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:30.914214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29909e15-4813-43e6-bd1f-483f97207f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:30.915369 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29909e15-4813-43e6-bd1f-483f97207f7d None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:30.916448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29909e15-4813-43e6-bd1f-483f97207f7d None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:30.917665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29909e15-4813-43e6-bd1f-483f97207f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:30.920524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29909e15-4813-43e6-bd1f-483f97207f7d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:30.937598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 166/342] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:30.943017 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6da5c0-bf32-48f8-a2cc-24dd2dae133d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:30.945750 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6da5c0-bf32-48f8-a2cc-24dd2dae133d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:30.946251 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6da5c0-bf32-48f8-a2cc-24dd2dae133d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:30.982223 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3d6da5c0-bf32-48f8-a2cc-24dd2dae133d None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:30.983941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3d6da5c0-bf32-48f8-a2cc-24dd2dae133d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:31.008577 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 177/343] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:31.009824 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a18a31-175c-41ee-9847-7e8fdd45acdb None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:31.081943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:31.124813 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 167/344] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:31.179974 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a18a31-175c-41ee-9847-7e8fdd45acdb None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:31.217335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558a13b-c69e-44b7-9a64-fa8f7490bc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:31.217944 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558a13b-c69e-44b7-9a64-fa8f7490bc39 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:31.218223 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558a13b-c69e-44b7-9a64-fa8f7490bc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:31.218492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558a13b-c69e-44b7-9a64-fa8f7490bc39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:31.231553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:31.237322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6da5c0-bf32-48f8-a2cc-24dd2dae133d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:31.301393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558a13b-c69e-44b7-9a64-fa8f7490bc39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:31.303735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558a13b-c69e-44b7-9a64-fa8f7490bc39 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:31.441414 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6da5c0-bf32-48f8-a2cc-24dd2dae133d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:31.479802 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773176bb-93a0-4e00-bf98-5185be45c4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:31.480433 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773176bb-93a0-4e00-bf98-5185be45c4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:31.480713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773176bb-93a0-4e00-bf98-5185be45c4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:31.480985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773176bb-93a0-4e00-bf98-5185be45c4b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:31.490500 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 178/345] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:31.491723 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558a13b-c69e-44b7-9a64-fa8f7490bc39 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:31.492002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773176bb-93a0-4e00-bf98-5185be45c4b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-773176bb-93a0-4e00-bf98-5185be45c4b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:31.496922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:31.497838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:31.498660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:31.498660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:31.498660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:31.498660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:31.498660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:31.498660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:31.498660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:31.498660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:31.498660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:31.498660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:31.498660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 01:05:31.498660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:31.498660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 168/346] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:05:31.499377 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773176bb-93a0-4e00-bf98-5185be45c4b6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:31.550482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:31.564525 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:31.636508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773176bb-93a0-4e00-bf98-5185be45c4b6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:31.644139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558a13b-c69e-44b7-9a64-fa8f7490bc39 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:31.674893 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f54cff-157b-46f1-802e-18e740ecd1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:31.675577 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f54cff-157b-46f1-802e-18e740ecd1de None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:31.675857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f54cff-157b-46f1-802e-18e740ecd1de None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:31.676130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f54cff-157b-46f1-802e-18e740ecd1de None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:31.678216 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f54cff-157b-46f1-802e-18e740ecd1de None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:31.679807 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f54cff-157b-46f1-802e-18e740ecd1de None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:31.681719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 169/347] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:31 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:31.682316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f54cff-157b-46f1-802e-18e740ecd1de None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:31.686655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561de504-46f2-4608-a4db-c739faa1624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:31.687584 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561de504-46f2-4608-a4db-c739faa1624f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:31.687868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561de504-46f2-4608-a4db-c739faa1624f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:31.688147 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561de504-46f2-4608-a4db-c739faa1624f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:31.700219 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561de504-46f2-4608-a4db-c739faa1624f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-561de504-46f2-4608-a4db-c739faa1624f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:31.705384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:31.706354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:31.707185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:31.707185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:31.707185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:31.707185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:31.707185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:31.707185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:31.707185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:31.707185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:31.707185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:31.707185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:31.707185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:31.707185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:31.707185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 179/348] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:31.707894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561de504-46f2-4608-a4db-c739faa1624f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:31.818063 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f54cff-157b-46f1-802e-18e740ecd1de None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:31.831231 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:31.841961 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:31.846609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561de504-46f2-4608-a4db-c739faa1624f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:31.866716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcba433-6496-4e09-aff6-1f1166103b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:31.867416 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcba433-6496-4e09-aff6-1f1166103b14 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:31.867648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcba433-6496-4e09-aff6-1f1166103b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:31.868340 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcba433-6496-4e09-aff6-1f1166103b14 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:31.868623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcba433-6496-4e09-aff6-1f1166103b14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:31.868935 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcba433-6496-4e09-aff6-1f1166103b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:31.870290 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcba433-6496-4e09-aff6-1f1166103b14 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:31.882389 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 170/349] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:31.883795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5bb94-9d4e-435a-9572-a1644c937b70 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:31.884080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5bb94-9d4e-435a-9572-a1644c937b70 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:31.884350 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5bb94-9d4e-435a-9572-a1644c937b70 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:31.885560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 171/350] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:31.886243 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5bb94-9d4e-435a-9572-a1644c937b70 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:31.894678 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9759acf-ae93-403c-a8f0-b7e06c9f0246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:31.895349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9759acf-ae93-403c-a8f0-b7e06c9f0246 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:31.895627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9759acf-ae93-403c-a8f0-b7e06c9f0246 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:31.895901 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9759acf-ae93-403c-a8f0-b7e06c9f0246 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:31.910856 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9759acf-ae93-403c-a8f0-b7e06c9f0246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-c9759acf-ae93-403c-a8f0-b7e06c9f0246 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:31.915867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:31.916929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:31.917841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:31.917841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:31.917841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:31.917841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:31.917841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:31.917841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:31.917841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:31.917841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:31.917841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:31.917841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:31.917841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:31.917841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:31.920519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 180/351] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:05:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:31.921452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9759acf-ae93-403c-a8f0-b7e06c9f0246 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:32.035866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5bb94-9d4e-435a-9572-a1644c937b70 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:32.054709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9759acf-ae93-403c-a8f0-b7e06c9f0246 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:32.081703 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ebb6f-3dfd-44e0-8c09-334976c719df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:32.081703 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ebb6f-3dfd-44e0-8c09-334976c719df None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:32.082002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ebb6f-3dfd-44e0-8c09-334976c719df None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:32.082178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ebb6f-3dfd-44e0-8c09-334976c719df None admin] PATH_INFO: `/v3/groups/92a169f8676643e9847215512d353fa2` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:32.089333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ebb6f-3dfd-44e0-8c09-334976c719df None admin] RBAC: Authorizing `identity:get_group(group_id=92a169f8676643e9847215512d353fa2)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:32.090771 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ebb6f-3dfd-44e0-8c09-334976c719df None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:32.092756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 172/352] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 13 01:05:31 2022] GET /identity/v3/groups/92a169f8676643e9847215512d353fa2 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:32.093423 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ebb6f-3dfd-44e0-8c09-334976c719df None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:32.098162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6c2f4-1d8d-4217-971b-44f7fb0c3d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:32.098777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6c2f4-1d8d-4217-971b-44f7fb0c3d97 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:32.099580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6c2f4-1d8d-4217-971b-44f7fb0c3d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:32.099869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6c2f4-1d8d-4217-971b-44f7fb0c3d97 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:32.100566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6c2f4-1d8d-4217-971b-44f7fb0c3d97 None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:32.100863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6c2f4-1d8d-4217-971b-44f7fb0c3d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:32.102252 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6c2f4-1d8d-4217-971b-44f7fb0c3d97 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:32.112158 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 181/353] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:32.113479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e573f-3581-4b67-966b-bb0fcbf6c17a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:32.113764 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e573f-3581-4b67-966b-bb0fcbf6c17a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:32.114065 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e573f-3581-4b67-966b-bb0fcbf6c17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:32.134177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b79e573f-3581-4b67-966b-bb0fcbf6c17a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:32.135550 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b79e573f-3581-4b67-966b-bb0fcbf6c17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:32.137196 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:32.157812 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:32.212478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ebb6f-3dfd-44e0-8c09-334976c719df None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:32.225522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 182/354] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:32.226646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e573f-3581-4b67-966b-bb0fcbf6c17a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:32.258306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c98d6a-49dd-406e-aab2-02d348dc3194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:32.259234 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c98d6a-49dd-406e-aab2-02d348dc3194 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:32.259674 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c98d6a-49dd-406e-aab2-02d348dc3194 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:32.260097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c98d6a-49dd-406e-aab2-02d348dc3194 None admin] PATH_INFO: `/v3/users/d5900bc5f2f54cd7a5e227f3980b222e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:32.261403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c98d6a-49dd-406e-aab2-02d348dc3194 None admin] RBAC: Authorizing `identity:get_user(user_id=d5900bc5f2f54cd7a5e227f3980b222e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:32.263009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c98d6a-49dd-406e-aab2-02d348dc3194 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:32.264779 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 173/355] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:05:32 2022] GET /identity/v3/users/d5900bc5f2f54cd7a5e227f3980b222e => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:32.265827 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637c29-b0e3-4d0c-a398-558a9bb575fa None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:32.266111 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637c29-b0e3-4d0c-a398-558a9bb575fa None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:32.266381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637c29-b0e3-4d0c-a398-558a9bb575fa None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:32.267664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 174/356] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:32.272728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc637c29-b0e3-4d0c-a398-558a9bb575fa None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:32.361430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e573f-3581-4b67-966b-bb0fcbf6c17a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:32.407668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7682f-a3d6-44b2-a0f9-b199927e01c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:32.408279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7682f-a3d6-44b2-a0f9-b199927e01c1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:32.408560 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7682f-a3d6-44b2-a0f9-b199927e01c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:32.408664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc637c29-b0e3-4d0c-a398-558a9bb575fa None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:32.408836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7682f-a3d6-44b2-a0f9-b199927e01c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:32.409496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7682f-a3d6-44b2-a0f9-b199927e01c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:32.409797 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7682f-a3d6-44b2-a0f9-b199927e01c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:32.411593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7682f-a3d6-44b2-a0f9-b199927e01c1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:32.412353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:32.430814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 183/357] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:05:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:32.430814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7682f-a3d6-44b2-a0f9-b199927e01c1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:32.453772 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:32.457813 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b593e3a-a117-4924-b71d-17da30c95ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:32.458930 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b593e3a-a117-4924-b71d-17da30c95ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:32.459402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b593e3a-a117-4924-b71d-17da30c95ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:32.459554 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b593e3a-a117-4924-b71d-17da30c95ec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:32.460442 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b593e3a-a117-4924-b71d-17da30c95ec0 None admin] RBAC: Adding query filter params (group.id=92a169f8676643e9847215512d353fa2, role.id=6ce9c4ba7196458380036520a04c9404, scope.project.id=22ce08feb9bd450698aac43ae261b3c3) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:32.460556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b593e3a-a117-4924-b71d-17da30c95ec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:32.462479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b593e3a-a117-4924-b71d-17da30c95ec0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:32.469975 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 175/358] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 13 01:05:32 2022] GET /identity/v3/role_assignments?group.id=92a169f8676643e9847215512d353fa2&scope.project.id=22ce08feb9bd450698aac43ae261b3c3&role.id=6ce9c4ba7196458380036520a04c9404 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:32.471088 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b593e3a-a117-4924-b71d-17da30c95ec0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:32.566507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7682f-a3d6-44b2-a0f9-b199927e01c1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:32.606546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b593e3a-a117-4924-b71d-17da30c95ec0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:32.621960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb4e07-469c-4c04-ad59-f46e96d89ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:32.622629 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4e07-469c-4c04-ad59-f46e96d89ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:32.622910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4e07-469c-4c04-ad59-f46e96d89ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:32.623220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4e07-469c-4c04-ad59-f46e96d89ac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:32.658096 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb53afa-9390-4abd-af4a-b86ff1ef993b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:32.658891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb53afa-9390-4abd-af4a-b86ff1ef993b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:32.659202 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb53afa-9390-4abd-af4a-b86ff1ef993b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:32.659480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb53afa-9390-4abd-af4a-b86ff1ef993b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:32.660213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb53afa-9390-4abd-af4a-b86ff1ef993b None admin] RBAC: Adding query filter params (role.id=0a3b51ca53dc4d88b4be340e21144870, user.id=d5900bc5f2f54cd7a5e227f3980b222e, scope.system=all) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:32.660524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb53afa-9390-4abd-af4a-b86ff1ef993b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:32.662310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb53afa-9390-4abd-af4a-b86ff1ef993b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:32.678240 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 176/359] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Sep 13 01:05:32 2022] GET /identity/v3/role_assignments?user.id=d5900bc5f2f54cd7a5e227f3980b222e&scope.system=all&role.id=0a3b51ca53dc4d88b4be340e21144870 => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:32.679532 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd81d5-c4ce-4f30-a895-98f3bd048c5a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:32.679818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd81d5-c4ce-4f30-a895-98f3bd048c5a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:32.680090 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd81d5-c4ce-4f30-a895-98f3bd048c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:32.703634 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-12dd81d5-c4ce-4f30-a895-98f3bd048c5a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:32.705297 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-12dd81d5-c4ce-4f30-a895-98f3bd048c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:32.722988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb4e07-469c-4c04-ad59-f46e96d89ac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:32.725487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb4e07-469c-4c04-ad59-f46e96d89ac3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:32.731927 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:32.747472 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:32.801627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 177/360] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:32.803288 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd81d5-c4ce-4f30-a895-98f3bd048c5a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:32.869333 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 184/361] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:32.870036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb4e07-469c-4c04-ad59-f46e96d89ac3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:32.971270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd81d5-c4ce-4f30-a895-98f3bd048c5a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:33.016216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb4e07-469c-4c04-ad59-f46e96d89ac3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:33.022172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298d8f0-2a67-4f85-96a8-6f5171ed832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:33.022795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298d8f0-2a67-4f85-96a8-6f5171ed832a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:33.023089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298d8f0-2a67-4f85-96a8-6f5171ed832a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:33.023409 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298d8f0-2a67-4f85-96a8-6f5171ed832a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:33.032977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:33.053326 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:33.058881 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3daee-37f4-42ba-9823-c82f758cae0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:33.059862 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3daee-37f4-42ba-9823-c82f758cae0c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:33.060357 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3daee-37f4-42ba-9823-c82f758cae0c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:33.060844 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3daee-37f4-42ba-9823-c82f758cae0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:33.072785 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3daee-37f4-42ba-9823-c82f758cae0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-90f3daee-37f4-42ba-9823-c82f758cae0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:33.078329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:33.079434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:33.080256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:33.080256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:33.080256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:33.080256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:33.080256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:33.080256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:33.080256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:33.080256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:33.080256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:33.080256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:33.080256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:33.080256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:33.082571 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 185/362] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:05:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:33.084729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3daee-37f4-42ba-9823-c82f758cae0c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:33.103478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298d8f0-2a67-4f85-96a8-6f5171ed832a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:33.105015 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298d8f0-2a67-4f85-96a8-6f5171ed832a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:33.197832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3daee-37f4-42ba-9823-c82f758cae0c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:33.226371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 178/363] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:33.227345 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298d8f0-2a67-4f85-96a8-6f5171ed832a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:33.251502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40cb75-c099-4b9f-b491-d1e4c592c95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:33.252480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40cb75-c099-4b9f-b491-d1e4c592c95a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:33.252762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40cb75-c099-4b9f-b491-d1e4c592c95a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:33.253038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40cb75-c099-4b9f-b491-d1e4c592c95a None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:33.254699 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40cb75-c099-4b9f-b491-d1e4c592c95a None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:33.256799 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40cb75-c099-4b9f-b491-d1e4c592c95a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:33.258278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 186/364] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:33 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:33.260231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40cb75-c099-4b9f-b491-d1e4c592c95a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:33.299838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:33.319229 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:33.355633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298d8f0-2a67-4f85-96a8-6f5171ed832a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:33.395366 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba764ecf-0071-4e3c-8b33-e5e83f47cef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:33.396613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba764ecf-0071-4e3c-8b33-e5e83f47cef9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:33.396971 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba764ecf-0071-4e3c-8b33-e5e83f47cef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:33.397255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba764ecf-0071-4e3c-8b33-e5e83f47cef9 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:33.398151 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba764ecf-0071-4e3c-8b33-e5e83f47cef9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:33.398269 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba764ecf-0071-4e3c-8b33-e5e83f47cef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:33.399625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba764ecf-0071-4e3c-8b33-e5e83f47cef9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:33.401088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40cb75-c099-4b9f-b491-d1e4c592c95a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:33.408530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 179/365] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:05:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:33.409588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba764ecf-0071-4e3c-8b33-e5e83f47cef9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:33.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9b78c-92f9-4a32-a13e-202cc96b8447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:33.464366 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9b78c-92f9-4a32-a13e-202cc96b8447 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:33.464760 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9b78c-92f9-4a32-a13e-202cc96b8447 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:33.465130 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9b78c-92f9-4a32-a13e-202cc96b8447 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:33.480390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9b78c-92f9-4a32-a13e-202cc96b8447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-88a9b78c-92f9-4a32-a13e-202cc96b8447 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:33.485149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:33.486013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:33.486832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:33.486832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:33.486832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:33.486832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:33.486832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:33.486832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:33.486832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:33.486832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:33.486832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:33.486832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:33.486832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:05:33.486832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:33.486832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 187/366] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:05:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:33.487589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9b78c-92f9-4a32-a13e-202cc96b8447 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:33.539862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba764ecf-0071-4e3c-8b33-e5e83f47cef9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:33.565663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:33.594127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e759c41-0228-46a6-86c1-4cdea1a3ac8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:33.594751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e759c41-0228-46a6-86c1-4cdea1a3ac8b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:33.597018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e759c41-0228-46a6-86c1-4cdea1a3ac8b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:33.597018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e759c41-0228-46a6-86c1-4cdea1a3ac8b None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:33.597220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e759c41-0228-46a6-86c1-4cdea1a3ac8b None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:33.598625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e759c41-0228-46a6-86c1-4cdea1a3ac8b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:33.602100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 180/367] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:33 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:33.602564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e759c41-0228-46a6-86c1-4cdea1a3ac8b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:33.622987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9b78c-92f9-4a32-a13e-202cc96b8447 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:33.624632 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:33.673860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f0268-6264-4d22-85a6-33a397e2fa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:33.674885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f0268-6264-4d22-85a6-33a397e2fa00 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:33.675254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f0268-6264-4d22-85a6-33a397e2fa00 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:33.675592 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f0268-6264-4d22-85a6-33a397e2fa00 None admin] PATH_INFO: `/v3/groups/92a169f8676643e9847215512d353fa2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:33.677309 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f0268-6264-4d22-85a6-33a397e2fa00 None admin] RBAC: Authorizing `identity:get_group(group_id=92a169f8676643e9847215512d353fa2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:33.679909 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f0268-6264-4d22-85a6-33a397e2fa00 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:33.682127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 188/368] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 13 01:05:33 2022] GET /identity/v3/groups/92a169f8676643e9847215512d353fa2 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:33.683022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f0268-6264-4d22-85a6-33a397e2fa00 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:33.729133 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e759c41-0228-46a6-86c1-4cdea1a3ac8b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:33.776458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26dabd-245c-43ad-a8f4-502987230f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:33.777935 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26dabd-245c-43ad-a8f4-502987230f6f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:33.778215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26dabd-245c-43ad-a8f4-502987230f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:33.778485 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26dabd-245c-43ad-a8f4-502987230f6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:33.809870 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f0268-6264-4d22-85a6-33a397e2fa00 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:33.847344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:33.859106 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a151b6-7332-420a-a72a-97f597749791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:33.859420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a151b6-7332-420a-a72a-97f597749791 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:33.859659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a151b6-7332-420a-a72a-97f597749791 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:33.859932 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a151b6-7332-420a-a72a-97f597749791 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:33.860602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a151b6-7332-420a-a72a-97f597749791 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:33.860908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a151b6-7332-420a-a72a-97f597749791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:33.862285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a151b6-7332-420a-a72a-97f597749791 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:33.874972 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 189/369] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:33.875852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a151b6-7332-420a-a72a-97f597749791 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:33.876794 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26dabd-245c-43ad-a8f4-502987230f6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:33.878965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26dabd-245c-43ad-a8f4-502987230f6f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:33.918356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:34.002575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 181/370] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:34.003509 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26dabd-245c-43ad-a8f4-502987230f6f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:34.015211 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a151b6-7332-420a-a72a-97f597749791 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:34.057660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86324c91-235c-4ebf-9e5d-a27e240e99a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:34.058588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86324c91-235c-4ebf-9e5d-a27e240e99a6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:34.058965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86324c91-235c-4ebf-9e5d-a27e240e99a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:34.059524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86324c91-235c-4ebf-9e5d-a27e240e99a6 None admin] PATH_INFO: `/v3/groups/92a169f8676643e9847215512d353fa2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:34.061171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86324c91-235c-4ebf-9e5d-a27e240e99a6 None admin] RBAC: Authorizing `identity:get_group(group_id=92a169f8676643e9847215512d353fa2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:34.062900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86324c91-235c-4ebf-9e5d-a27e240e99a6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:34.065154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 190/371] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 13 01:05:33 2022] GET /identity/v3/groups/92a169f8676643e9847215512d353fa2 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:34.065951 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86324c91-235c-4ebf-9e5d-a27e240e99a6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:34.109813 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:34.136084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26dabd-245c-43ad-a8f4-502987230f6f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:34.178157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695e144-60ae-4faa-b83e-a313f0c7b4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:34.179363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695e144-60ae-4faa-b83e-a313f0c7b4ad None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:34.179794 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695e144-60ae-4faa-b83e-a313f0c7b4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:34.180488 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695e144-60ae-4faa-b83e-a313f0c7b4ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:34.181424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695e144-60ae-4faa-b83e-a313f0c7b4ad None admin] RBAC: Adding query filter params (group.id=92a169f8676643e9847215512d353fa2, role.id=6ce9c4ba7196458380036520a04c9404, scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:34.182114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695e144-60ae-4faa-b83e-a313f0c7b4ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:34.184042 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695e144-60ae-4faa-b83e-a313f0c7b4ad None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:34.188798 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:34.189439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 182/372] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 13 01:05:34 2022] GET /identity/v3/role_assignments?group.id=92a169f8676643e9847215512d353fa2&scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e&role.id=6ce9c4ba7196458380036520a04c9404 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:34.191144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695e144-60ae-4faa-b83e-a313f0c7b4ad None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:34.194280 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86324c91-235c-4ebf-9e5d-a27e240e99a6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:34.240068 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5451f5e-1ed1-40a7-8fc3-e0553bd6d942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:34.241096 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5451f5e-1ed1-40a7-8fc3-e0553bd6d942 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:34.241544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5451f5e-1ed1-40a7-8fc3-e0553bd6d942 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:34.242159 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5451f5e-1ed1-40a7-8fc3-e0553bd6d942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:34.333686 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695e144-60ae-4faa-b83e-a313f0c7b4ad None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:34.338408 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5451f5e-1ed1-40a7-8fc3-e0553bd6d942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:34.340131 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5451f5e-1ed1-40a7-8fc3-e0553bd6d942 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:34.378881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd2004-2ef9-4af0-bc6f-a413e9510c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:34.379943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd2004-2ef9-4af0-bc6f-a413e9510c66 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:34.381067 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd2004-2ef9-4af0-bc6f-a413e9510c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:34.381593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd2004-2ef9-4af0-bc6f-a413e9510c66 None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:34.382920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd2004-2ef9-4af0-bc6f-a413e9510c66 None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:34.384553 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd2004-2ef9-4af0-bc6f-a413e9510c66 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:34.390610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 183/373] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:34 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:34.391823 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd2004-2ef9-4af0-bc6f-a413e9510c66 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:34.434229 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:34.491751 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:34.499545 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 191/374] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:34.501503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5451f5e-1ed1-40a7-8fc3-e0553bd6d942 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:34.534044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd2004-2ef9-4af0-bc6f-a413e9510c66 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:34.582583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a761ae-b96e-46bd-8ea3-04c99934b284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:34.583944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a761ae-b96e-46bd-8ea3-04c99934b284 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:34.584171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a761ae-b96e-46bd-8ea3-04c99934b284 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:34.584568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a761ae-b96e-46bd-8ea3-04c99934b284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:34.585309 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a761ae-b96e-46bd-8ea3-04c99934b284 None admin] RBAC: Adding query filter params (group.id=92a169f8676643e9847215512d353fa2, role.id=6f1196f44c2040ee86de4a614692041d, scope.project.id=22ce08feb9bd450698aac43ae261b3c3) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:34.585643 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a761ae-b96e-46bd-8ea3-04c99934b284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:34.587108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a761ae-b96e-46bd-8ea3-04c99934b284 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:34.593105 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 184/375] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 13 01:05:34 2022] GET /identity/v3/role_assignments?group.id=92a169f8676643e9847215512d353fa2&scope.project.id=22ce08feb9bd450698aac43ae261b3c3&role.id=6f1196f44c2040ee86de4a614692041d => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:34.593954 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a761ae-b96e-46bd-8ea3-04c99934b284 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:34.629593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5451f5e-1ed1-40a7-8fc3-e0553bd6d942 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:34.679383 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbf6b4-b09e-4d26-a61b-fba28d11e70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:34.680267 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbf6b4-b09e-4d26-a61b-fba28d11e70f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:34.680695 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbf6b4-b09e-4d26-a61b-fba28d11e70f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:34.681151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbf6b4-b09e-4d26-a61b-fba28d11e70f None admin] PATH_INFO: `/v3/groups/92a169f8676643e9847215512d353fa2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:34.683115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbf6b4-b09e-4d26-a61b-fba28d11e70f None admin] RBAC: Authorizing `identity:get_group(group_id=92a169f8676643e9847215512d353fa2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:34.685211 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbf6b4-b09e-4d26-a61b-fba28d11e70f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:34.688186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 192/376] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 13 01:05:34 2022] GET /identity/v3/groups/92a169f8676643e9847215512d353fa2 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:34.689625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:34.697689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbf6b4-b09e-4d26-a61b-fba28d11e70f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:34.718127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a761ae-b96e-46bd-8ea3-04c99934b284 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:34.765220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6813d-e795-4aa9-9a7e-395068dabc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:34.765220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6813d-e795-4aa9-9a7e-395068dabc73 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:34.765220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6813d-e795-4aa9-9a7e-395068dabc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:34.765220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6813d-e795-4aa9-9a7e-395068dabc73 None admin] PATH_INFO: `/v3/projects/fd4174dd77554b79ab1278edaa747365` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:34.765627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6813d-e795-4aa9-9a7e-395068dabc73 None admin] RBAC: Authorizing `identity:get_project(project_id=fd4174dd77554b79ab1278edaa747365)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:34.765627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6813d-e795-4aa9-9a7e-395068dabc73 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:34.765627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 185/377] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:34 2022] GET /identity/v3/projects/fd4174dd77554b79ab1278edaa747365 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:34.772653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6813d-e795-4aa9-9a7e-395068dabc73 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:34.822267 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:34.887974 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbf6b4-b09e-4d26-a61b-fba28d11e70f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:34.911916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6813d-e795-4aa9-9a7e-395068dabc73 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:34.932030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824560c-6c4a-43f2-99cc-041a3e825d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:34.932904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824560c-6c4a-43f2-99cc-041a3e825d6c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:34.933242 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824560c-6c4a-43f2-99cc-041a3e825d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:34.933580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824560c-6c4a-43f2-99cc-041a3e825d6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:34.934315 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824560c-6c4a-43f2-99cc-041a3e825d6c None admin] RBAC: Adding query filter params (group.id=92a169f8676643e9847215512d353fa2, role.id=6f1196f44c2040ee86de4a614692041d, scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:34.934672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824560c-6c4a-43f2-99cc-041a3e825d6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:34.936575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824560c-6c4a-43f2-99cc-041a3e825d6c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:34.945871 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 193/378] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 13 01:05:34 2022] GET /identity/v3/role_assignments?group.id=92a169f8676643e9847215512d353fa2&scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e&role.id=6f1196f44c2040ee86de4a614692041d => generated 260 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:34.947787 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e729585-d535-4190-9e44-6962fb6d4c0a None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:34.948093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e729585-d535-4190-9e44-6962fb6d4c0a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:34.948626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e729585-d535-4190-9e44-6962fb6d4c0a None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:34.954940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 194/379] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:34.956643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e2bba-fc83-4aa7-98ec-d9d4233f716c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:34.956936 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e2bba-fc83-4aa7-98ec-d9d4233f716c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:34.957284 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e2bba-fc83-4aa7-98ec-d9d4233f716c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:34.958081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa3f76-1265-485c-a4d3-c69fb309ac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:34.958988 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa3f76-1265-485c-a4d3-c69fb309ac55 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:34.959509 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa3f76-1265-485c-a4d3-c69fb309ac55 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:34.959982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa3f76-1265-485c-a4d3-c69fb309ac55 None admin] PATH_INFO: `/v3/groups/e7e4545fe1af4eaa8fd2b8e5a042a3e3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:34.966325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa3f76-1265-485c-a4d3-c69fb309ac55 None admin] RBAC: Authorizing `identity:get_group(group_id=e7e4545fe1af4eaa8fd2b8e5a042a3e3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:34.968171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa3f76-1265-485c-a4d3-c69fb309ac55 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:34.970600 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 186/380] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 13 01:05:34 2022] GET /identity/v3/groups/e7e4545fe1af4eaa8fd2b8e5a042a3e3 => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:34.979954 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa3f76-1265-485c-a4d3-c69fb309ac55 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:34.983673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-759e2bba-fc83-4aa7-98ec-d9d4233f716c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:34.985325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-759e2bba-fc83-4aa7-98ec-d9d4233f716c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:35.011490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:35.127713 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 195/381] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:35.156615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa3f76-1265-485c-a4d3-c69fb309ac55 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:35.197579 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28058ded-73a6-4825-b1db-d2991e058d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:35.198250 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28058ded-73a6-4825-b1db-d2991e058d53 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:35.198528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28058ded-73a6-4825-b1db-d2991e058d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:35.198800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28058ded-73a6-4825-b1db-d2991e058d53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:35.199559 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28058ded-73a6-4825-b1db-d2991e058d53 None admin] RBAC: Adding query filter params (group.id=e7e4545fe1af4eaa8fd2b8e5a042a3e3, role.id=3799feb4caa64e568971222375957f54, scope.project.id=fd4174dd77554b79ab1278edaa747365) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:35.199863 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28058ded-73a6-4825-b1db-d2991e058d53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:35.201535 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28058ded-73a6-4825-b1db-d2991e058d53 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:35.207937 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 187/382] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 13 01:05:34 2022] GET /identity/v3/role_assignments?group.id=e7e4545fe1af4eaa8fd2b8e5a042a3e3&scope.project.id=fd4174dd77554b79ab1278edaa747365&role.id=3799feb4caa64e568971222375957f54 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:35.473459 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e2bba-fc83-4aa7-98ec-d9d4233f716c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:35.548735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:35.611812 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e2bba-fc83-4aa7-98ec-d9d4233f716c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:35.660875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d0d02-3864-42d3-8719-023cfc8c0bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:35.661567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d0d02-3864-42d3-8719-023cfc8c0bac None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:35.661908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d0d02-3864-42d3-8719-023cfc8c0bac None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:35.662376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d0d02-3864-42d3-8719-023cfc8c0bac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:35.680002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d0d02-3864-42d3-8719-023cfc8c0bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-df9d0d02-3864-42d3-8719-023cfc8c0bac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:35.684714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:35.685590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:35.686403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:35.686403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:35.686403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:35.686403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:35.686403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:35.686403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:35.686403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:35.686403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:35.686403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:35.686403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:35.686403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:35.686403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:35.686403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 196/383] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:35.693467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28058ded-73a6-4825-b1db-d2991e058d53 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:35.835100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:35.862007 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28058ded-73a6-4825-b1db-d2991e058d53 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:35.904787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a1361-f171-4b88-b63e-cf1be8760389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:35.905398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a1361-f171-4b88-b63e-cf1be8760389 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:35.905676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a1361-f171-4b88-b63e-cf1be8760389 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:35.905945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a1361-f171-4b88-b63e-cf1be8760389 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:35.906606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a1361-f171-4b88-b63e-cf1be8760389 None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:35.906904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a1361-f171-4b88-b63e-cf1be8760389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:35.908315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a1361-f171-4b88-b63e-cf1be8760389 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:35.922199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 188/384] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:35.928456 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d0d02-3864-42d3-8719-023cfc8c0bac None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:36.053116 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d0d02-3864-42d3-8719-023cfc8c0bac None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:36.078553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:36.091609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152b14c-b9fd-45f2-b37c-cccea24fa9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:36.092243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152b14c-b9fd-45f2-b37c-cccea24fa9fd None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:36.092522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152b14c-b9fd-45f2-b37c-cccea24fa9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:36.092856 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152b14c-b9fd-45f2-b37c-cccea24fa9fd None admin] PATH_INFO: `/v3/groups/92a169f8676643e9847215512d353fa2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:36.094024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152b14c-b9fd-45f2-b37c-cccea24fa9fd None admin] RBAC: Authorizing `identity:get_group(group_id=92a169f8676643e9847215512d353fa2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:36.095566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152b14c-b9fd-45f2-b37c-cccea24fa9fd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:36.097433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 197/385] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 13 01:05:35 2022] GET /identity/v3/groups/92a169f8676643e9847215512d353fa2 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:36.103249 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a1361-f171-4b88-b63e-cf1be8760389 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:36.245088 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a1361-f171-4b88-b63e-cf1be8760389 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:36.279572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc008e-0730-4f99-a2e1-71aea3dc525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:36.280203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc008e-0730-4f99-a2e1-71aea3dc525f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:36.280477 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc008e-0730-4f99-a2e1-71aea3dc525f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:36.280745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc008e-0730-4f99-a2e1-71aea3dc525f None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:36.281856 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc008e-0730-4f99-a2e1-71aea3dc525f None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:36.283319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc008e-0730-4f99-a2e1-71aea3dc525f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:36.285247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 189/386] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:36 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:36.290880 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152b14c-b9fd-45f2-b37c-cccea24fa9fd None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:36.413943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152b14c-b9fd-45f2-b37c-cccea24fa9fd None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:36.472994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae18831-7ad1-4921-bcb5-d664eaa8ff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:36.473655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae18831-7ad1-4921-bcb5-d664eaa8ff5c None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:36.473968 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae18831-7ad1-4921-bcb5-d664eaa8ff5c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:36.474245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae18831-7ad1-4921-bcb5-d664eaa8ff5c None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3/groups/92a169f8676643e9847215512d353fa2/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:36.480321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae18831-7ad1-4921-bcb5-d664eaa8ff5c None admin] RBAC: Authorizing `identity:create_grant(project_id=22ce08feb9bd450698aac43ae261b3c3, group_id=92a169f8676643e9847215512d353fa2, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:36.481849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae18831-7ad1-4921-bcb5-d664eaa8ff5c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:36.497236 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 198/387] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Sep 13 01:05:36 2022] PUT /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3/groups/92a169f8676643e9847215512d353fa2/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:05:36.893430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5219e5-6c1d-4ba9-87b3-95df63063405 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:36.893936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5219e5-6c1d-4ba9-87b3-95df63063405 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:36.894445 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5219e5-6c1d-4ba9-87b3-95df63063405 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:36.897575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 190/388] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:36.903224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbf73d-08d2-4835-82b0-96d4812da51a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:36.903810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbf73d-08d2-4835-82b0-96d4812da51a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:36.904284 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbf73d-08d2-4835-82b0-96d4812da51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:36.925418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-fdcbf73d-08d2-4835-82b0-96d4812da51a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:36.926623 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fdcbf73d-08d2-4835-82b0-96d4812da51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:36.978042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:37.015151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 199/389] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:37.332479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c38a8-663c-46a1-98a8-1b0bd7accc43 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:37.332989 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c38a8-663c-46a1-98a8-1b0bd7accc43 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:37.333099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c38a8-663c-46a1-98a8-1b0bd7accc43 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:37.334710 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 191/390] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:37.339759 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc7a86-d8aa-47a8-b32e-5c8847a1ac30 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:37.340265 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc7a86-d8aa-47a8-b32e-5c8847a1ac30 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:37.340738 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc7a86-d8aa-47a8-b32e-5c8847a1ac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:37.365372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-94bc7a86-d8aa-47a8-b32e-5c8847a1ac30 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:37.366871 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-94bc7a86-d8aa-47a8-b32e-5c8847a1ac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:37.381724 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c38a8-663c-46a1-98a8-1b0bd7accc43 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:37.394493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:37.495046 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 200/391] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:37.515530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c38a8-663c-46a1-98a8-1b0bd7accc43 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:37.550125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1348e3b-09ac-4b14-8395-0dbd6cc08102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:37.551285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1348e3b-09ac-4b14-8395-0dbd6cc08102 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:37.551784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1348e3b-09ac-4b14-8395-0dbd6cc08102 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:37.552405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1348e3b-09ac-4b14-8395-0dbd6cc08102 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:37.563327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1348e3b-09ac-4b14-8395-0dbd6cc08102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-d1348e3b-09ac-4b14-8395-0dbd6cc08102 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:37.569840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:37.570753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:37.571603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:37.571603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:37.571603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:37.571603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:37.571603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:37.571603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:37.571603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:37.571603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:37.571603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:37.571603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:37.571603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:37.571603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:37.574268 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 192/392] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:37.580566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc7a86-d8aa-47a8-b32e-5c8847a1ac30 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:37.606935 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6404294-11c3-4286-82d5-6d9cef757a62 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:37.607239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6404294-11c3-4286-82d5-6d9cef757a62 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:37.607459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6404294-11c3-4286-82d5-6d9cef757a62 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:37.609062 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 193/393] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:05:37.614020 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4872e3-dcb5-4e3f-a880-947ba363e855 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:37.614305 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4872e3-dcb5-4e3f-a880-947ba363e855 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:37.615198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4872e3-dcb5-4e3f-a880-947ba363e855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:37.634197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-dc4872e3-dcb5-4e3f-a880-947ba363e855 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:37.635565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dc4872e3-dcb5-4e3f-a880-947ba363e855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:37.692538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc7a86-d8aa-47a8-b32e-5c8847a1ac30 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:37.704390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:37.729192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1031517-010b-457d-9301-e0d4094be476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:37.730144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1031517-010b-457d-9301-e0d4094be476 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:37.730622 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1031517-010b-457d-9301-e0d4094be476 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:37.731161 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1031517-010b-457d-9301-e0d4094be476 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:37.732060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1031517-010b-457d-9301-e0d4094be476 None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:37.732558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1031517-010b-457d-9301-e0d4094be476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:37.734151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1031517-010b-457d-9301-e0d4094be476 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:37.743869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 201/394] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:37.749639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1031517-010b-457d-9301-e0d4094be476 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:37.792527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:37.803450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 194/395] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:05:37.858041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1031517-010b-457d-9301-e0d4094be476 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:37.893416 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac1d82-6ee1-49b6-aa6a-9ba060905190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:37.894375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac1d82-6ee1-49b6-aa6a-9ba060905190 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:37.894871 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac1d82-6ee1-49b6-aa6a-9ba060905190 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:37.895410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac1d82-6ee1-49b6-aa6a-9ba060905190 None admin] PATH_INFO: `/v3/groups/92a169f8676643e9847215512d353fa2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:37.897323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac1d82-6ee1-49b6-aa6a-9ba060905190 None admin] RBAC: Authorizing `identity:get_group(group_id=92a169f8676643e9847215512d353fa2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:37.898953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac1d82-6ee1-49b6-aa6a-9ba060905190 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:37.901012 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 202/396] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 13 01:05:37 2022] GET /identity/v3/groups/92a169f8676643e9847215512d353fa2 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:37.908140 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4872e3-dcb5-4e3f-a880-947ba363e855 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:38.021657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4872e3-dcb5-4e3f-a880-947ba363e855 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:38.022696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac1d82-6ee1-49b6-aa6a-9ba060905190 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:38.079488 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:38.088269 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff51b93-dcaa-481a-bbc4-6f5d27b26149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:38.088940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff51b93-dcaa-481a-bbc4-6f5d27b26149 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:38.089215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff51b93-dcaa-481a-bbc4-6f5d27b26149 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:38.089491 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff51b93-dcaa-481a-bbc4-6f5d27b26149 None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:38.090718 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff51b93-dcaa-481a-bbc4-6f5d27b26149 None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:38.092652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff51b93-dcaa-481a-bbc4-6f5d27b26149 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:38.094253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 195/397] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:37 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:38.101789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff51b93-dcaa-481a-bbc4-6f5d27b26149 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:38.180944 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac1d82-6ee1-49b6-aa6a-9ba060905190 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:38.184528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:38.220670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006aedd-6626-48c9-801b-8640cdde4a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:38.221094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff51b93-dcaa-481a-bbc4-6f5d27b26149 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:38.221360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006aedd-6626-48c9-801b-8640cdde4a77 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:38.221640 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006aedd-6626-48c9-801b-8640cdde4a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:38.221911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006aedd-6626-48c9-801b-8640cdde4a77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:38.233281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006aedd-6626-48c9-801b-8640cdde4a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-e006aedd-6626-48c9-801b-8640cdde4a77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:38.238540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:38.240115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:38.241382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:38.241382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:38.241382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:38.241382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:38.241382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:38.241382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:38.241382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:38.241382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:38.241382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:38.241382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:38.241382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:38.241382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:38.241382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 203/398] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:05:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:38.242037 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006aedd-6626-48c9-801b-8640cdde4a77 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:38.267113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a6ff2-1394-4d68-b612-186885e1772c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:38.267113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a6ff2-1394-4d68-b612-186885e1772c None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:38.267113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a6ff2-1394-4d68-b612-186885e1772c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:38.267113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a6ff2-1394-4d68-b612-186885e1772c None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e/groups/92a169f8676643e9847215512d353fa2/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:38.268749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a6ff2-1394-4d68-b612-186885e1772c None admin] RBAC: Authorizing `identity:create_grant(project_id=c380370c2d3b42b9a44e5b6771f49f7e, group_id=92a169f8676643e9847215512d353fa2, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:38.270770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a6ff2-1394-4d68-b612-186885e1772c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:38.284298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 196/399] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Sep 13 01:05:38 2022] PUT /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e/groups/92a169f8676643e9847215512d353fa2/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:05:38.291973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca7070-daca-4e44-9984-c5892731e5b6 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:38.291973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca7070-daca-4e44-9984-c5892731e5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:38.291973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca7070-daca-4e44-9984-c5892731e5b6 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:38.291973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 197/400] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:38.291973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca7070-daca-4e44-9984-c5892731e5b6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:38.381428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:38.385580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006aedd-6626-48c9-801b-8640cdde4a77 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:38.417287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca7070-daca-4e44-9984-c5892731e5b6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:38.445706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc02a6-3bf3-4985-b2d9-d2fc198ec9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:38.447448 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc02a6-3bf3-4985-b2d9-d2fc198ec9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:38.447981 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc02a6-3bf3-4985-b2d9-d2fc198ec9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:38.448410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc02a6-3bf3-4985-b2d9-d2fc198ec9e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:38.450567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:38.464283 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189fc06-0de2-4a28-bc0a-fe068d501d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:38.465060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189fc06-0de2-4a28-bc0a-fe068d501d72 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:38.465449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189fc06-0de2-4a28-bc0a-fe068d501d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:38.465856 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189fc06-0de2-4a28-bc0a-fe068d501d72 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:38.466643 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189fc06-0de2-4a28-bc0a-fe068d501d72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:38.467121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189fc06-0de2-4a28-bc0a-fe068d501d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:38.467742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc02a6-3bf3-4985-b2d9-d2fc198ec9e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:38.468806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189fc06-0de2-4a28-bc0a-fe068d501d72 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-52bc02a6-3bf3-4985-b2d9-d2fc198ec9e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:38.474704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:38.475919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:38.476746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:38.476746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:38.476746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:38.476746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:38.476746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:38.476746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:38.476746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:38.476746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:38.476746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:38.476746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:38.476746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:38.476746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:38.479607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 204/401] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:05:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:38.480907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21bbf8-f366-4ccb-ab95-d92c89e47a45 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:38.481193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21bbf8-f366-4ccb-ab95-d92c89e47a45 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:38.481469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21bbf8-f366-4ccb-ab95-d92c89e47a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:38.491280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 198/402] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:05:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:38.492286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189fc06-0de2-4a28-bc0a-fe068d501d72 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:38.504671 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5a21bbf8-f366-4ccb-ab95-d92c89e47a45 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:38.506495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5a21bbf8-f366-4ccb-ab95-d92c89e47a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:38.599467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 205/403] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:38.600890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21bbf8-f366-4ccb-ab95-d92c89e47a45 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:38.616772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189fc06-0de2-4a28-bc0a-fe068d501d72 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:38.657912 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd0e7a-aebc-4a46-b6d3-829c4060a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:38.659089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0e7a-aebc-4a46-b6d3-829c4060a57a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:38.659377 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0e7a-aebc-4a46-b6d3-829c4060a57a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:38.659650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0e7a-aebc-4a46-b6d3-829c4060a57a None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:38.661642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd0e7a-aebc-4a46-b6d3-829c4060a57a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:38.661642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd0e7a-aebc-4a46-b6d3-829c4060a57a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:38.665976 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd0e7a-aebc-4a46-b6d3-829c4060a57a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:38.680958 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 199/404] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:05:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:38.686821 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd0e7a-aebc-4a46-b6d3-829c4060a57a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:38.783483 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:38.796803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:38.832984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21bbf8-f366-4ccb-ab95-d92c89e47a45 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:38.837872 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd0e7a-aebc-4a46-b6d3-829c4060a57a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:38.876320 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4361a4-f414-44a3-886e-7dacda696f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:38.876950 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4361a4-f414-44a3-886e-7dacda696f28 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:38.877272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4361a4-f414-44a3-886e-7dacda696f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:38.877548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4361a4-f414-44a3-886e-7dacda696f28 None admin] PATH_INFO: `/v3/groups/92a169f8676643e9847215512d353fa2` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:38.878657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4361a4-f414-44a3-886e-7dacda696f28 None admin] RBAC: Authorizing `identity:get_group(group_id=92a169f8676643e9847215512d353fa2)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:38.880752 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4361a4-f414-44a3-886e-7dacda696f28 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:38.883201 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 200/405] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 13 01:05:38 2022] GET /identity/v3/groups/92a169f8676643e9847215512d353fa2 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:38.888450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4361a4-f414-44a3-886e-7dacda696f28 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:38.928422 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89db4f-7243-43ac-9e83-b56727b4c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:38.929063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89db4f-7243-43ac-9e83-b56727b4c4ce None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:38.929345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89db4f-7243-43ac-9e83-b56727b4c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:38.929621 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89db4f-7243-43ac-9e83-b56727b4c4ce None admin] PATH_INFO: `/v3/groups/92a169f8676643e9847215512d353fa2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:38.931663 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89db4f-7243-43ac-9e83-b56727b4c4ce None admin] RBAC: Authorizing `identity:get_group(group_id=92a169f8676643e9847215512d353fa2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:38.933186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89db4f-7243-43ac-9e83-b56727b4c4ce None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:38.935006 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 206/406] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 13 01:05:38 2022] GET /identity/v3/groups/92a169f8676643e9847215512d353fa2 => generated 226 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:38.939986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89db4f-7243-43ac-9e83-b56727b4c4ce None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:39.037015 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4361a4-f414-44a3-886e-7dacda696f28 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:39.050866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89db4f-7243-43ac-9e83-b56727b4c4ce None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:39.060030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:39.080622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d66aa-a915-4373-b4ce-f2a22aaee48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:39.081298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d66aa-a915-4373-b4ce-f2a22aaee48e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:39.081579 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d66aa-a915-4373-b4ce-f2a22aaee48e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:39.081848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d66aa-a915-4373-b4ce-f2a22aaee48e None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:39.082978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d66aa-a915-4373-b4ce-f2a22aaee48e None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:39.085463 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d66aa-a915-4373-b4ce-f2a22aaee48e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:39.087285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 201/407] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:38 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:39.088047 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d66aa-a915-4373-b4ce-f2a22aaee48e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:39.102082 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6645fb-1bc6-43db-95c6-e48549c2ef1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:39.102724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6645fb-1bc6-43db-95c6-e48549c2ef1a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:39.103031 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6645fb-1bc6-43db-95c6-e48549c2ef1a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:39.103735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6645fb-1bc6-43db-95c6-e48549c2ef1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:39.118681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6645fb-1bc6-43db-95c6-e48549c2ef1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-9f6645fb-1bc6-43db-95c6-e48549c2ef1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:39.123825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:39.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:39.125510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:39.125510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:39.125510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:39.125510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:39.125510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:39.125510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:39.125510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:39.125510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:39.125510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:39.125510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:39.125510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:05:39.125510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:39.125510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 207/408] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:05:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:39.126184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6645fb-1bc6-43db-95c6-e48549c2ef1a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:39.157618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:39.228321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d66aa-a915-4373-b4ce-f2a22aaee48e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:39.268632 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6645fb-1bc6-43db-95c6-e48549c2ef1a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:39.272496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae186d3-f848-4a34-9e6a-775196b19f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:39.273152 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae186d3-f848-4a34-9e6a-775196b19f01 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:39.273436 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae186d3-f848-4a34-9e6a-775196b19f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:39.273717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae186d3-f848-4a34-9e6a-775196b19f01 None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:39.274899 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae186d3-f848-4a34-9e6a-775196b19f01 None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:39.276392 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae186d3-f848-4a34-9e6a-775196b19f01 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:39.278650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 202/409] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:39 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:39.279832 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae186d3-f848-4a34-9e6a-775196b19f01 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:39.309584 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a35ecf-c07a-460b-a2fa-edda7d687354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:39.310162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a35ecf-c07a-460b-a2fa-edda7d687354 None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:39.310444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a35ecf-c07a-460b-a2fa-edda7d687354 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:39.310720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a35ecf-c07a-460b-a2fa-edda7d687354 None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e/groups/92a169f8676643e9847215512d353fa2/roles/6f1196f44c2040ee86de4a614692041d` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:39.312916 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a35ecf-c07a-460b-a2fa-edda7d687354 None admin] RBAC: Authorizing `identity:create_grant(project_id=c380370c2d3b42b9a44e5b6771f49f7e, group_id=92a169f8676643e9847215512d353fa2, role_id=6f1196f44c2040ee86de4a614692041d)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:39.314480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a35ecf-c07a-460b-a2fa-edda7d687354 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:39.330386 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 208/410] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Sep 13 01:05:39 2022] PUT /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e/groups/92a169f8676643e9847215512d353fa2/roles/6f1196f44c2040ee86de4a614692041d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:05:39.332623 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daca61a-6839-4310-a381-86d821578a1e None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:39.333182 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daca61a-6839-4310-a381-86d821578a1e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:39.334381 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daca61a-6839-4310-a381-86d821578a1e None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:39.336408 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 209/411] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:39.340217 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daca61a-6839-4310-a381-86d821578a1e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:39.349956 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:39.407049 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae186d3-f848-4a34-9e6a-775196b19f01 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:39.458699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270bf8c-fb70-4302-b5b2-46cfc9c70d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:39.459389 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270bf8c-fb70-4302-b5b2-46cfc9c70d52 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:39.459666 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270bf8c-fb70-4302-b5b2-46cfc9c70d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:39.460272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270bf8c-fb70-4302-b5b2-46cfc9c70d52 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:39.460572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270bf8c-fb70-4302-b5b2-46cfc9c70d52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:39.460868 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270bf8c-fb70-4302-b5b2-46cfc9c70d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:39.462323 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270bf8c-fb70-4302-b5b2-46cfc9c70d52 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:39.467948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:39.478165 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 203/412] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:39.480217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7c8a7-f21e-46e6-ab89-6ed206864196 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:39.481325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7c8a7-f21e-46e6-ab89-6ed206864196 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:39.481694 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7c8a7-f21e-46e6-ab89-6ed206864196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:39.502600 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-82a7c8a7-f21e-46e6-ab89-6ed206864196 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:39.503958 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-82a7c8a7-f21e-46e6-ab89-6ed206864196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:39.505436 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daca61a-6839-4310-a381-86d821578a1e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:39.555856 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97c2ac-71a3-4b4f-a5bc-f804dd91e2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:39.556953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97c2ac-71a3-4b4f-a5bc-f804dd91e2a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:39.557404 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97c2ac-71a3-4b4f-a5bc-f804dd91e2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:39.558000 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97c2ac-71a3-4b4f-a5bc-f804dd91e2a2 None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3/groups/92a169f8676643e9847215512d353fa2/roles/6f1196f44c2040ee86de4a614692041d` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:39.560862 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97c2ac-71a3-4b4f-a5bc-f804dd91e2a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=22ce08feb9bd450698aac43ae261b3c3, group_id=92a169f8676643e9847215512d353fa2, role_id=6f1196f44c2040ee86de4a614692041d)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:39.562644 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97c2ac-71a3-4b4f-a5bc-f804dd91e2a2 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:39.578971 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 210/413] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Sep 13 01:05:39 2022] PUT /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3/groups/92a169f8676643e9847215512d353fa2/roles/6f1196f44c2040ee86de4a614692041d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:05:39.580304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97c2ac-71a3-4b4f-a5bc-f804dd91e2a2 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:39.584669 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 204/414] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:39.728306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97c2ac-71a3-4b4f-a5bc-f804dd91e2a2 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:39.777698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68044f81-ce19-458c-b60a-427260cbe84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:39.778652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68044f81-ce19-458c-b60a-427260cbe84c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:39.779119 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68044f81-ce19-458c-b60a-427260cbe84c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:39.779593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68044f81-ce19-458c-b60a-427260cbe84c None admin] PATH_INFO: `/v3/groups/e7e4545fe1af4eaa8fd2b8e5a042a3e3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:39.782839 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68044f81-ce19-458c-b60a-427260cbe84c None admin] RBAC: Authorizing `identity:get_group(group_id=e7e4545fe1af4eaa8fd2b8e5a042a3e3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:39.784540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68044f81-ce19-458c-b60a-427260cbe84c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:39.786894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 211/415] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 13 01:05:39 2022] GET /identity/v3/groups/e7e4545fe1af4eaa8fd2b8e5a042a3e3 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:39.792709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7c8a7-f21e-46e6-ab89-6ed206864196 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:39.863647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:39.924044 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68044f81-ce19-458c-b60a-427260cbe84c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:39.938012 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7c8a7-f21e-46e6-ab89-6ed206864196 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:39.938637 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:39.991412 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eebf11-f815-46fa-bbbb-8c58e29bf9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:39.992447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eebf11-f815-46fa-bbbb-8c58e29bf9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:39.993088 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eebf11-f815-46fa-bbbb-8c58e29bf9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:39.993561 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eebf11-f815-46fa-bbbb-8c58e29bf9e7 None admin] PATH_INFO: `/v3/projects/fd4174dd77554b79ab1278edaa747365` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:39.994911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eebf11-f815-46fa-bbbb-8c58e29bf9e7 None admin] RBAC: Authorizing `identity:get_project(project_id=fd4174dd77554b79ab1278edaa747365)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:39.996688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eebf11-f815-46fa-bbbb-8c58e29bf9e7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:39.998876 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 205/416] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:39 2022] GET /identity/v3/projects/fd4174dd77554b79ab1278edaa747365 => generated 344 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:40.004826 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eebf11-f815-46fa-bbbb-8c58e29bf9e7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:40.129322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68044f81-ce19-458c-b60a-427260cbe84c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:40.154143 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eebf11-f815-46fa-bbbb-8c58e29bf9e7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:40.190361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a5ab0-0f0c-46c7-aee6-5a823a99f53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:40.191443 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a5ab0-0f0c-46c7-aee6-5a823a99f53d None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:40.192108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a5ab0-0f0c-46c7-aee6-5a823a99f53d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:40.192685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a5ab0-0f0c-46c7-aee6-5a823a99f53d None admin] PATH_INFO: `/v3/projects/fd4174dd77554b79ab1278edaa747365/groups/e7e4545fe1af4eaa8fd2b8e5a042a3e3/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:40.194875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a5ab0-0f0c-46c7-aee6-5a823a99f53d None admin] RBAC: Authorizing `identity:create_grant(project_id=fd4174dd77554b79ab1278edaa747365, group_id=e7e4545fe1af4eaa8fd2b8e5a042a3e3, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:40.196548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a5ab0-0f0c-46c7-aee6-5a823a99f53d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:40.201430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:40.213096 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde18f2-6860-452c-ad3c-d4c655f1ca5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:40.213791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde18f2-6860-452c-ad3c-d4c655f1ca5c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:40.214119 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde18f2-6860-452c-ad3c-d4c655f1ca5c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:40.214398 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde18f2-6860-452c-ad3c-d4c655f1ca5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:40.227420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde18f2-6860-452c-ad3c-d4c655f1ca5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:40.230207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 206/417] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Sep 13 01:05:40 2022] PUT /identity/v3/projects/fd4174dd77554b79ab1278edaa747365/groups/e7e4545fe1af4eaa8fd2b8e5a042a3e3/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-6cde18f2-6860-452c-ad3c-d4c655f1ca5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:40.232978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:40.233959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:40.235194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:40.235194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:40.235194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:40.235194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:40.235194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:40.235194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:40.235194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:40.235194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:40.235194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:40.235194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:40.235194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:40.235194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:40.235194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 212/418] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:40.242493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a5ab0-0f0c-46c7-aee6-5a823a99f53d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:40.375722 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a5ab0-0f0c-46c7-aee6-5a823a99f53d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:40.429981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a8df8-7e3a-4911-a4e9-281e8930d84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:40.430616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8df8-7e3a-4911-a4e9-281e8930d84f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:40.430948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8df8-7e3a-4911-a4e9-281e8930d84f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:40.431259 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8df8-7e3a-4911-a4e9-281e8930d84f None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:40.431989 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a8df8-7e3a-4911-a4e9-281e8930d84f None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:40.432301 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a8df8-7e3a-4911-a4e9-281e8930d84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:40.433680 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a8df8-7e3a-4911-a4e9-281e8930d84f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:40.446596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 207/419] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:40.456172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde18f2-6860-452c-ad3c-d4c655f1ca5c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:40.556991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:40.599237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde18f2-6860-452c-ad3c-d4c655f1ca5c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:40.637727 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a3bb6-c5ad-4259-8f12-396df21dc419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:40.638339 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a3bb6-c5ad-4259-8f12-396df21dc419 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:40.638616 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a3bb6-c5ad-4259-8f12-396df21dc419 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:40.638887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a3bb6-c5ad-4259-8f12-396df21dc419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:40.695781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87e07-2415-45c3-8a3b-812290a1bb96 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:40.696284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87e07-2415-45c3-8a3b-812290a1bb96 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:40.696284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87e07-2415-45c3-8a3b-812290a1bb96 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:40.697800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 208/420] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:05:40.702968 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723b18e-c599-42e7-a510-09aca7815311 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:40.703283 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723b18e-c599-42e7-a510-09aca7815311 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:40.703556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723b18e-c599-42e7-a510-09aca7815311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:40.723267 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a723b18e-c599-42e7-a510-09aca7815311 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:40.724625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a723b18e-c599-42e7-a510-09aca7815311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:40.725714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a3bb6-c5ad-4259-8f12-396df21dc419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:40.728631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a3bb6-c5ad-4259-8f12-396df21dc419 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:40.768031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:40.812400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:40.847826 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 209/421] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:05:40.882672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 213/422] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:40.888569 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723b18e-c599-42e7-a510-09aca7815311 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:41.041769 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723b18e-c599-42e7-a510-09aca7815311 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:41.088664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24558692-2db3-47e2-a026-7c7d287cbf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:41.089306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24558692-2db3-47e2-a026-7c7d287cbf43 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:41.089592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24558692-2db3-47e2-a026-7c7d287cbf43 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:41.089873 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24558692-2db3-47e2-a026-7c7d287cbf43 None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:41.091056 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24558692-2db3-47e2-a026-7c7d287cbf43 None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:41.092555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24558692-2db3-47e2-a026-7c7d287cbf43 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:41.094524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 210/423] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:40 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:41.100229 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a3bb6-c5ad-4259-8f12-396df21dc419 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:41.153781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24558692-2db3-47e2-a026-7c7d287cbf43 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:41.201438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:41.276639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a3bb6-c5ad-4259-8f12-396df21dc419 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:41.321977 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24558692-2db3-47e2-a026-7c7d287cbf43 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:41.346526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8067ad-0b13-4384-912c-2c81fd5f4021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:41.347180 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8067ad-0b13-4384-912c-2c81fd5f4021 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:41.347454 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8067ad-0b13-4384-912c-2c81fd5f4021 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:41.347724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8067ad-0b13-4384-912c-2c81fd5f4021 None admin] PATH_INFO: `/v3/groups/92a169f8676643e9847215512d353fa2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:41.349772 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8067ad-0b13-4384-912c-2c81fd5f4021 None admin] RBAC: Authorizing `identity:get_group(group_id=92a169f8676643e9847215512d353fa2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:41.352922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8067ad-0b13-4384-912c-2c81fd5f4021 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:41.354497 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 214/424] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 13 01:05:41 2022] GET /identity/v3/groups/92a169f8676643e9847215512d353fa2 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:41.360432 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8067ad-0b13-4384-912c-2c81fd5f4021 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:41.389312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a250835-9ab7-4c96-83c9-7e3ccb1192f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:41.389954 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a250835-9ab7-4c96-83c9-7e3ccb1192f8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:41.390285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a250835-9ab7-4c96-83c9-7e3ccb1192f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:41.390556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a250835-9ab7-4c96-83c9-7e3ccb1192f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:41.412237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a250835-9ab7-4c96-83c9-7e3ccb1192f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-8a250835-9ab7-4c96-83c9-7e3ccb1192f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:41.423214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:41.424097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:41.424877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:41.424877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:41.424877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:41.424877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:41.424877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:41.424877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:41.424877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:41.424877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:41.424877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:41.424877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:41.424877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 01:05:41.424877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:41.425493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 211/425] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:05:41.426494 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:41.431618 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a250835-9ab7-4c96-83c9-7e3ccb1192f8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:41.546914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8067ad-0b13-4384-912c-2c81fd5f4021 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:41.618094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748412e3-edbf-44b2-87cf-51dc5564a4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:41.618636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748412e3-edbf-44b2-87cf-51dc5564a4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:41.618913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748412e3-edbf-44b2-87cf-51dc5564a4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:41.619216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748412e3-edbf-44b2-87cf-51dc5564a4f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:41.619956 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748412e3-edbf-44b2-87cf-51dc5564a4f6 None admin] RBAC: Adding query filter params (group.id=92a169f8676643e9847215512d353fa2, role.id=6ce9c4ba7196458380036520a04c9404, scope.project.id=22ce08feb9bd450698aac43ae261b3c3) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:41.620264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748412e3-edbf-44b2-87cf-51dc5564a4f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:41.621732 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748412e3-edbf-44b2-87cf-51dc5564a4f6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:41.622779 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:41.633427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a250835-9ab7-4c96-83c9-7e3ccb1192f8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:41.638048 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 215/426] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 13 01:05:41 2022] GET /identity/v3/role_assignments?group.id=92a169f8676643e9847215512d353fa2&scope.project.id=22ce08feb9bd450698aac43ae261b3c3&role.id=6ce9c4ba7196458380036520a04c9404 => generated 611 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:41.673169 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f00a3f-b08f-48c0-803c-1eca5634fa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:41.673923 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00a3f-b08f-48c0-803c-1eca5634fa4d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:41.674201 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00a3f-b08f-48c0-803c-1eca5634fa4d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:41.674479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00a3f-b08f-48c0-803c-1eca5634fa4d None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:41.675254 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f00a3f-b08f-48c0-803c-1eca5634fa4d None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:41.675556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f00a3f-b08f-48c0-803c-1eca5634fa4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:41.677492 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f00a3f-b08f-48c0-803c-1eca5634fa4d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:41.686818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 212/427] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:05:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:41.693064 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748412e3-edbf-44b2-87cf-51dc5564a4f6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:41.827492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:41.830603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748412e3-edbf-44b2-87cf-51dc5564a4f6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:41.878418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43333386-0238-4a15-b9c1-3b7755ab0723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:41.879006 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43333386-0238-4a15-b9c1-3b7755ab0723 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:41.879350 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43333386-0238-4a15-b9c1-3b7755ab0723 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:41.879684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43333386-0238-4a15-b9c1-3b7755ab0723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:41.958686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43333386-0238-4a15-b9c1-3b7755ab0723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:41.960267 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43333386-0238-4a15-b9c1-3b7755ab0723 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:42.049940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b657fe-ae72-49ef-8455-f0334b7f570b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:42.050436 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b657fe-ae72-49ef-8455-f0334b7f570b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:42.050509 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b657fe-ae72-49ef-8455-f0334b7f570b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:42.052277 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 213/428] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:05:42.057650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40e6f4-11eb-4695-a7d7-0c3abf6f7859 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:42.057921 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40e6f4-11eb-4695-a7d7-0c3abf6f7859 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:42.058200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40e6f4-11eb-4695-a7d7-0c3abf6f7859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:42.074066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:42.077545 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1c40e6f4-11eb-4695-a7d7-0c3abf6f7859 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:42.084560 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 216/429] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:42.084560 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43333386-0238-4a15-b9c1-3b7755ab0723 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:42.085559 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1c40e6f4-11eb-4695-a7d7-0c3abf6f7859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:42.171505 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 214/430] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:42.206438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43333386-0238-4a15-b9c1-3b7755ab0723 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:42.254225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c98578-0b64-423c-b403-29cce3b85cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:42.255516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c98578-0b64-423c-b403-29cce3b85cad None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:42.255805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c98578-0b64-423c-b403-29cce3b85cad None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:42.256082 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c98578-0b64-423c-b403-29cce3b85cad None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:42.257310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c98578-0b64-423c-b403-29cce3b85cad None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:42.258885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c98578-0b64-423c-b403-29cce3b85cad None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:42.260980 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 217/431] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:42 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:42.266524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40e6f4-11eb-4695-a7d7-0c3abf6f7859 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:42.360004 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca5877-3250-4de4-958c-e6a4748b6435 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:42.360507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca5877-3250-4de4-958c-e6a4748b6435 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:42.360583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca5877-3250-4de4-958c-e6a4748b6435 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:42.363297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 218/432] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:42.368233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cafec3-899d-4658-96e6-84b7d623df4f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:42.368726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cafec3-899d-4658-96e6-84b7d623df4f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:42.369182 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cafec3-899d-4658-96e6-84b7d623df4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:42.374312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:42.389833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40e6f4-11eb-4695-a7d7-0c3abf6f7859 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:42.392711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-67cafec3-899d-4658-96e6-84b7d623df4f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:42.394199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-67cafec3-899d-4658-96e6-84b7d623df4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:42.436887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162df2a3-8b99-4316-83b8-ad74db29b038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:42.437456 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162df2a3-8b99-4316-83b8-ad74db29b038 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:42.437736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162df2a3-8b99-4316-83b8-ad74db29b038 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:42.438011 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162df2a3-8b99-4316-83b8-ad74db29b038 None admin] PATH_INFO: `/v3/groups/92a169f8676643e9847215512d353fa2` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:42.439435 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162df2a3-8b99-4316-83b8-ad74db29b038 None admin] RBAC: Authorizing `identity:get_group(group_id=92a169f8676643e9847215512d353fa2)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:42.441699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162df2a3-8b99-4316-83b8-ad74db29b038 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:42.444051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 215/433] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 13 01:05:42 2022] GET /identity/v3/groups/92a169f8676643e9847215512d353fa2 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:42.449302 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162df2a3-8b99-4316-83b8-ad74db29b038 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:42.485748 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:42.508197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 219/434] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:42.509146 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cafec3-899d-4658-96e6-84b7d623df4f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:42.578440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162df2a3-8b99-4316-83b8-ad74db29b038 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:42.631977 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fadffb-5b2b-451e-9d5e-5a90f4fa7fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:42.632573 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fadffb-5b2b-451e-9d5e-5a90f4fa7fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:42.632850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fadffb-5b2b-451e-9d5e-5a90f4fa7fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:42.633121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fadffb-5b2b-451e-9d5e-5a90f4fa7fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:42.633860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fadffb-5b2b-451e-9d5e-5a90f4fa7fd6 None admin] RBAC: Adding query filter params (group.id=92a169f8676643e9847215512d353fa2, role.id=6ce9c4ba7196458380036520a04c9404, scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:42.634164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fadffb-5b2b-451e-9d5e-5a90f4fa7fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:42.635628 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fadffb-5b2b-451e-9d5e-5a90f4fa7fd6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:42.642344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 216/435] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 13 01:05:42 2022] GET /identity/v3/role_assignments?group.id=92a169f8676643e9847215512d353fa2&scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e&role.id=6ce9c4ba7196458380036520a04c9404 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:42.644272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cafec3-899d-4658-96e6-84b7d623df4f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:42.686725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02598df-aa0b-4f42-8127-edec78a24a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:42.687484 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02598df-aa0b-4f42-8127-edec78a24a86 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:42.687707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02598df-aa0b-4f42-8127-edec78a24a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:42.687982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02598df-aa0b-4f42-8127-edec78a24a86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:42.701116 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02598df-aa0b-4f42-8127-edec78a24a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a02598df-aa0b-4f42-8127-edec78a24a86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:42.706230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:42.707310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:42.708250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:42.708250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:42.708250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:42.708250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:42.708250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:42.708250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:42.708250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:42.708250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:42.708250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:42.708250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:42.708250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:42.708250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:42.708250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 220/436] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:05:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:42.713743 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fadffb-5b2b-451e-9d5e-5a90f4fa7fd6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:42.737090 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:42.812424 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02598df-aa0b-4f42-8127-edec78a24a86 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:42.831941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fadffb-5b2b-451e-9d5e-5a90f4fa7fd6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:42.872745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87f434-275f-4619-a18d-4efdf1136409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:42.873711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87f434-275f-4619-a18d-4efdf1136409 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:42.874138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87f434-275f-4619-a18d-4efdf1136409 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:42.874553 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87f434-275f-4619-a18d-4efdf1136409 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:42.875412 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87f434-275f-4619-a18d-4efdf1136409 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:42.875901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87f434-275f-4619-a18d-4efdf1136409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:42.877304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87f434-275f-4619-a18d-4efdf1136409 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:42.887777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 217/437] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:05:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:42.893297 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87f434-275f-4619-a18d-4efdf1136409 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:42.894192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:42.948390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02598df-aa0b-4f42-8127-edec78a24a86 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:42.987058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e07d5-30ab-47e0-9cf5-7c09bba287d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:42.987739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e07d5-30ab-47e0-9cf5-7c09bba287d5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:42.988021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e07d5-30ab-47e0-9cf5-7c09bba287d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:42.988296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e07d5-30ab-47e0-9cf5-7c09bba287d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:42.999037 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:43.000801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e07d5-30ab-47e0-9cf5-7c09bba287d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a65e07d5-30ab-47e0-9cf5-7c09bba287d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:43.006036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:43.007038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:43.008179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:43.008179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:43.008179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:43.008179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:43.008179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:43.008179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:43.008179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:43.008179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:43.008179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:43.008179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:43.008179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:43.008179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:43.012159 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 221/438] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:05:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:05:43.012986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e07d5-30ab-47e0-9cf5-7c09bba287d5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:43.022569 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87f434-275f-4619-a18d-4efdf1136409 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:43.059019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c980079-18e8-4dba-801a-e4783653f9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:43.059764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980079-18e8-4dba-801a-e4783653f9dc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:43.060134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980079-18e8-4dba-801a-e4783653f9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:43.060412 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980079-18e8-4dba-801a-e4783653f9dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:43.117445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e07d5-30ab-47e0-9cf5-7c09bba287d5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:43.130278 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c980079-18e8-4dba-801a-e4783653f9dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:43.131964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c980079-18e8-4dba-801a-e4783653f9dc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:43.133564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:43.151784 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78e030-7906-4d3d-b50d-043eb601ae7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:43.152385 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78e030-7906-4d3d-b50d-043eb601ae7f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:43.152662 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78e030-7906-4d3d-b50d-043eb601ae7f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:43.152932 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78e030-7906-4d3d-b50d-043eb601ae7f None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:43.153591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78e030-7906-4d3d-b50d-043eb601ae7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:43.153889 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78e030-7906-4d3d-b50d-043eb601ae7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:43.155302 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78e030-7906-4d3d-b50d-043eb601ae7f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:43.163691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 222/439] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:05:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:43.164832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349d4b-f99c-429d-b629-c87171402c91 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:43.165113 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349d4b-f99c-429d-b629-c87171402c91 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:43.165388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349d4b-f99c-429d-b629-c87171402c91 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:43.166577 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 223/440] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:43.169521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349d4b-f99c-429d-b629-c87171402c91 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:43.219042 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:43.238855 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 218/441] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 01:05:43.240264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c8560-d8bc-47ec-a1ad-84233fa95bfe None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:43.240549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c8560-d8bc-47ec-a1ad-84233fa95bfe None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:43.240825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c8560-d8bc-47ec-a1ad-84233fa95bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:43.259234 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-937c8560-d8bc-47ec-a1ad-84233fa95bfe None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:43.260435 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-937c8560-d8bc-47ec-a1ad-84233fa95bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:43.270665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349d4b-f99c-429d-b629-c87171402c91 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:43.304541 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd57fe3-fefd-40d3-8d0f-85e533c222a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:43.305134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd57fe3-fefd-40d3-8d0f-85e533c222a3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:43.305409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd57fe3-fefd-40d3-8d0f-85e533c222a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:43.305678 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd57fe3-fefd-40d3-8d0f-85e533c222a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:43.325735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 219/442] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:43.326967 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c8560-d8bc-47ec-a1ad-84233fa95bfe None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:43.366766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:43.390953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd57fe3-fefd-40d3-8d0f-85e533c222a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:43.392486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd57fe3-fefd-40d3-8d0f-85e533c222a3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:43.433155 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c8560-d8bc-47ec-a1ad-84233fa95bfe None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:43.444120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:43.467665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8c2b7-b24c-4dbe-b61e-d941d36d6bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:43.468301 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8c2b7-b24c-4dbe-b61e-d941d36d6bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:43.468583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8c2b7-b24c-4dbe-b61e-d941d36d6bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:43.468859 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8c2b7-b24c-4dbe-b61e-d941d36d6bb9 None admin] PATH_INFO: `/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:43.470047 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8c2b7-b24c-4dbe-b61e-d941d36d6bb9 None admin] RBAC: Authorizing `identity:get_project(project_id=c380370c2d3b42b9a44e5b6771f49f7e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:43.471451 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8c2b7-b24c-4dbe-b61e-d941d36d6bb9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:43.478860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 220/443] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:43 2022] GET /identity/v3/projects/c380370c2d3b42b9a44e5b6771f49f7e => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:43.478986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8c2b7-b24c-4dbe-b61e-d941d36d6bb9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:43.509891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 224/444] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 01:05:43.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd57fe3-fefd-40d3-8d0f-85e533c222a3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:43.583622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8c2b7-b24c-4dbe-b61e-d941d36d6bb9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:43.602778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:43.618214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d1140-fe5c-45e3-ba0e-473027ecb946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:43.618842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d1140-fe5c-45e3-ba0e-473027ecb946 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:43.619145 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d1140-fe5c-45e3-ba0e-473027ecb946 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:43.619422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d1140-fe5c-45e3-ba0e-473027ecb946 None admin] PATH_INFO: `/v3/groups/92a169f8676643e9847215512d353fa2` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:43.620531 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d1140-fe5c-45e3-ba0e-473027ecb946 None admin] RBAC: Authorizing `identity:get_group(group_id=92a169f8676643e9847215512d353fa2)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:43.621957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d1140-fe5c-45e3-ba0e-473027ecb946 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:43.623570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 221/445] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 13 01:05:43 2022] GET /identity/v3/groups/92a169f8676643e9847215512d353fa2 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:43.624320 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d1140-fe5c-45e3-ba0e-473027ecb946 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:43.625389 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd57fe3-fefd-40d3-8d0f-85e533c222a3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:43.660195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994998ad-2c30-4314-9f89-79669638b701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:43.660819 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994998ad-2c30-4314-9f89-79669638b701 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:43.661647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994998ad-2c30-4314-9f89-79669638b701 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:43.661922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994998ad-2c30-4314-9f89-79669638b701 None admin] PATH_INFO: `/v3/projects/22ce08feb9bd450698aac43ae261b3c3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:43.663092 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994998ad-2c30-4314-9f89-79669638b701 None admin] RBAC: Authorizing `identity:get_project(project_id=22ce08feb9bd450698aac43ae261b3c3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:43.664537 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994998ad-2c30-4314-9f89-79669638b701 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:43.666153 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 225/446] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:43 2022] GET /identity/v3/projects/22ce08feb9bd450698aac43ae261b3c3 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:43.666909 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994998ad-2c30-4314-9f89-79669638b701 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:43.671428 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:43.724272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d1140-fe5c-45e3-ba0e-473027ecb946 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:43.757374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493c3aa-3e6a-40cb-839e-4b97f2a23fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:43.758002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493c3aa-3e6a-40cb-839e-4b97f2a23fea None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:43.758283 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493c3aa-3e6a-40cb-839e-4b97f2a23fea None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:43.758558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493c3aa-3e6a-40cb-839e-4b97f2a23fea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:43.764497 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994998ad-2c30-4314-9f89-79669638b701 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:43.768669 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493c3aa-3e6a-40cb-839e-4b97f2a23fea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-7493c3aa-3e6a-40cb-839e-4b97f2a23fea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:43.774030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:43.775333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:43.776335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:43.776335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:43.776335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:43.776335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:43.776335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:43.776335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:43.776335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:43.776335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:43.776335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:43.776335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:43.776335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:05:43.776335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:43.776335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 222/447] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:05:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:43.776335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493c3aa-3e6a-40cb-839e-4b97f2a23fea None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:43.800053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608c01f-1fea-4321-959e-f0e196e7a88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:43.800653 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608c01f-1fea-4321-959e-f0e196e7a88e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:43.800932 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608c01f-1fea-4321-959e-f0e196e7a88e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:43.801204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608c01f-1fea-4321-959e-f0e196e7a88e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:43.802605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608c01f-1fea-4321-959e-f0e196e7a88e None admin] RBAC: Adding query filter params (group.id=92a169f8676643e9847215512d353fa2, role.id=6f1196f44c2040ee86de4a614692041d, scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:43.802914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608c01f-1fea-4321-959e-f0e196e7a88e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:43.804382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608c01f-1fea-4321-959e-f0e196e7a88e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:43.810018 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 226/448] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 13 01:05:43 2022] GET /identity/v3/role_assignments?group.id=92a169f8676643e9847215512d353fa2&scope.project.id=c380370c2d3b42b9a44e5b6771f49f7e&role.id=6f1196f44c2040ee86de4a614692041d => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:43.810788 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608c01f-1fea-4321-959e-f0e196e7a88e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:43.835693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:43.890708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493c3aa-3e6a-40cb-839e-4b97f2a23fea None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:43.899717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:43.930340 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247d055-175a-4b56-8629-055b24347914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:43.930992 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247d055-175a-4b56-8629-055b24347914 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:43.931382 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247d055-175a-4b56-8629-055b24347914 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:43.931668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247d055-175a-4b56-8629-055b24347914 None admin] PATH_INFO: `/v3/groups/92a169f8676643e9847215512d353fa2` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:43.932857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247d055-175a-4b56-8629-055b24347914 None admin] RBAC: Authorizing `identity:get_group(group_id=92a169f8676643e9847215512d353fa2)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:43.934362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247d055-175a-4b56-8629-055b24347914 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:43.936195 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 223/449] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 13 01:05:43 2022] GET /identity/v3/groups/92a169f8676643e9847215512d353fa2 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:43.939553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608c01f-1fea-4321-959e-f0e196e7a88e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:43.942690 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247d055-175a-4b56-8629-055b24347914 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:43.979937 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc8cb4-1347-4ce0-9547-18db3808eeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:43.980612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8cb4-1347-4ce0-9547-18db3808eeaf None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:43.980892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8cb4-1347-4ce0-9547-18db3808eeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:43.981169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8cb4-1347-4ce0-9547-18db3808eeaf None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:43.981839 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc8cb4-1347-4ce0-9547-18db3808eeaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:43.982143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc8cb4-1347-4ce0-9547-18db3808eeaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:43.983568 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc8cb4-1347-4ce0-9547-18db3808eeaf None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:43.994840 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 227/450] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:44.000093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc8cb4-1347-4ce0-9547-18db3808eeaf None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:44.053902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247d055-175a-4b56-8629-055b24347914 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:44.084095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:44.089714 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23c193-7a81-48e2-9d13-fb1298951f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:44.090328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23c193-7a81-48e2-9d13-fb1298951f5b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:44.090610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23c193-7a81-48e2-9d13-fb1298951f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:44.090883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23c193-7a81-48e2-9d13-fb1298951f5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:44.091659 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23c193-7a81-48e2-9d13-fb1298951f5b None admin] RBAC: Adding query filter params (group.id=92a169f8676643e9847215512d353fa2, role.id=6f1196f44c2040ee86de4a614692041d, scope.project.id=22ce08feb9bd450698aac43ae261b3c3) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:44.091954 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23c193-7a81-48e2-9d13-fb1298951f5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:44.093372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23c193-7a81-48e2-9d13-fb1298951f5b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:44.099817 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 224/451] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 13 01:05:43 2022] GET /identity/v3/role_assignments?group.id=92a169f8676643e9847215512d353fa2&scope.project.id=22ce08feb9bd450698aac43ae261b3c3&role.id=6f1196f44c2040ee86de4a614692041d => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:44.116950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc8cb4-1347-4ce0-9547-18db3808eeaf None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:44.152540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b2215-95a0-431b-b0d3-57d34a343f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:44.153176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b2215-95a0-431b-b0d3-57d34a343f59 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:44.153463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b2215-95a0-431b-b0d3-57d34a343f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:44.153736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b2215-95a0-431b-b0d3-57d34a343f59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:44.226573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b2215-95a0-431b-b0d3-57d34a343f59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:44.228100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b2215-95a0-431b-b0d3-57d34a343f59 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:44.300966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:44.333542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 228/452] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 01:05:44.339465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23c193-7a81-48e2-9d13-fb1298951f5b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:44.381404 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:44.443883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23c193-7a81-48e2-9d13-fb1298951f5b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:44.478190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578ceee-f7b8-4688-9649-da1fc4f65952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:44.478833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578ceee-f7b8-4688-9649-da1fc4f65952 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:44.479139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578ceee-f7b8-4688-9649-da1fc4f65952 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:44.479414 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578ceee-f7b8-4688-9649-da1fc4f65952 None admin] PATH_INFO: `/v3/projects/fd4174dd77554b79ab1278edaa747365` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:44.480548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578ceee-f7b8-4688-9649-da1fc4f65952 None admin] RBAC: Authorizing `identity:get_project(project_id=fd4174dd77554b79ab1278edaa747365)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:44.481978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578ceee-f7b8-4688-9649-da1fc4f65952 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:44.483665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 225/453] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:05:44 2022] GET /identity/v3/projects/fd4174dd77554b79ab1278edaa747365 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:44.490054 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b2215-95a0-431b-b0d3-57d34a343f59 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:44.613804 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b2215-95a0-431b-b0d3-57d34a343f59 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:44.653413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df00b65-ca41-4ba2-8c59-23e3d8f0c93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:44.654046 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00b65-ca41-4ba2-8c59-23e3d8f0c93d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:44.654322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00b65-ca41-4ba2-8c59-23e3d8f0c93d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:44.654598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00b65-ca41-4ba2-8c59-23e3d8f0c93d None admin] PATH_INFO: `/v3/groups/e7e4545fe1af4eaa8fd2b8e5a042a3e3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:44.655729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df00b65-ca41-4ba2-8c59-23e3d8f0c93d None admin] RBAC: Authorizing `identity:get_group(group_id=e7e4545fe1af4eaa8fd2b8e5a042a3e3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:44.657203 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df00b65-ca41-4ba2-8c59-23e3d8f0c93d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:44.658765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 229/454] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 13 01:05:44 2022] GET /identity/v3/groups/e7e4545fe1af4eaa8fd2b8e5a042a3e3 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:44.665534 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578ceee-f7b8-4688-9649-da1fc4f65952 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:44.769447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578ceee-f7b8-4688-9649-da1fc4f65952 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:44.777156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:44.803708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45857b7e-a403-4d1b-b14d-c885c20bcca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:44.804319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45857b7e-a403-4d1b-b14d-c885c20bcca7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:44.804601 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45857b7e-a403-4d1b-b14d-c885c20bcca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:44.804874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45857b7e-a403-4d1b-b14d-c885c20bcca7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:44.805600 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45857b7e-a403-4d1b-b14d-c885c20bcca7 None admin] RBAC: Adding query filter params (group.id=e7e4545fe1af4eaa8fd2b8e5a042a3e3, role.id=3799feb4caa64e568971222375957f54, scope.project.id=fd4174dd77554b79ab1278edaa747365) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:44.805909 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45857b7e-a403-4d1b-b14d-c885c20bcca7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:44.807366 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45857b7e-a403-4d1b-b14d-c885c20bcca7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:44.812904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 226/455] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 13 01:05:44 2022] GET /identity/v3/role_assignments?group.id=e7e4545fe1af4eaa8fd2b8e5a042a3e3&scope.project.id=fd4174dd77554b79ab1278edaa747365&role.id=3799feb4caa64e568971222375957f54 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:47.539570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c4d39-11f0-4f9d-8be6-8eb0e57fd77c None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:47.540631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c4d39-11f0-4f9d-8be6-8eb0e57fd77c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:47.541110 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c4d39-11f0-4f9d-8be6-8eb0e57fd77c None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:47.543004 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 230/456] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:47.548535 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339bef1-d02c-4c13-be8d-580d0d77546b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:47.549072 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339bef1-d02c-4c13-be8d-580d0d77546b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:47.549072 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339bef1-d02c-4c13-be8d-580d0d77546b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:47.576543 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0339bef1-d02c-4c13-be8d-580d0d77546b None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:47.577789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0339bef1-d02c-4c13-be8d-580d0d77546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:47.672719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 227/457] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:47.686463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe14e1-9a12-4f9a-84b5-9b79b431cba5 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:47.687018 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe14e1-9a12-4f9a-84b5-9b79b431cba5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:47.687521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe14e1-9a12-4f9a-84b5-9b79b431cba5 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:47.690300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 231/458] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:47.695497 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75784a84-125a-493b-9809-d7cbc456bf19 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:47.696008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75784a84-125a-493b-9809-d7cbc456bf19 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:47.696502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75784a84-125a-493b-9809-d7cbc456bf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:47.715957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-75784a84-125a-493b-9809-d7cbc456bf19 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:47.717471 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-75784a84-125a-493b-9809-d7cbc456bf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:47.786739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 228/459] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:48.058926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe14e1-9a12-4f9a-84b5-9b79b431cba5 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:48.075113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75784a84-125a-493b-9809-d7cbc456bf19 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:48.115603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:48.115798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:48.198194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75784a84-125a-493b-9809-d7cbc456bf19 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:48.201410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe14e1-9a12-4f9a-84b5-9b79b431cba5 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:48.234130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7892f-27fa-4d73-aed4-a4c70abe9d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:48.235046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7892f-27fa-4d73-aed4-a4c70abe9d17 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:48.235491 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7892f-27fa-4d73-aed4-a4c70abe9d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:48.235922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7892f-27fa-4d73-aed4-a4c70abe9d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:48.240472 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cbeff-9aac-4de4-b29c-c1da0c1530f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:48.241313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cbeff-9aac-4de4-b29c-c1da0c1530f5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:48.241817 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cbeff-9aac-4de4-b29c-c1da0c1530f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:48.242273 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cbeff-9aac-4de4-b29c-c1da0c1530f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:48.247298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7892f-27fa-4d73-aed4-a4c70abe9d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:48.248754 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7892f-27fa-4d73-aed4-a4c70abe9d17 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:48.253538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cbeff-9aac-4de4-b29c-c1da0c1530f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:48.255139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cbeff-9aac-4de4-b29c-c1da0c1530f5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-eef7892f-27fa-4d73-aed4-a4c70abe9d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:05:48.263687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:48.264627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:05:48.265465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:05:48.265465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:48.265465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:48.269856 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 229/460] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-1e7cbeff-9aac-4de4-b29c-c1da0c1530f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:05:48.270726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:48.271724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:05:48.272562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:05:48.272562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:48.272562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:48.272722 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcce019-dce3-4090-b575-91a98659e294 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:48.272722 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcce019-dce3-4090-b575-91a98659e294 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:48.272722 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcce019-dce3-4090-b575-91a98659e294 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:48.277519 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 230/461] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:48.277519 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4edc12-af33-4714-b8ea-1d6c5e24336a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:48.277519 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4edc12-af33-4714-b8ea-1d6c5e24336a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:48.277519 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4edc12-af33-4714-b8ea-1d6c5e24336a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:48.277519 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 231/462] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:48.278598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 232/463] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:48.278744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4edc12-af33-4714-b8ea-1d6c5e24336a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:48.278889 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cbeff-9aac-4de4-b29c-c1da0c1530f5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:48.367517 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:48.384566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:48.387616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4edc12-af33-4714-b8ea-1d6c5e24336a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:48.395737 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cbeff-9aac-4de4-b29c-c1da0c1530f5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:48.430408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcac6f-d391-4948-96b6-111d91f804fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:48.431031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcac6f-d391-4948-96b6-111d91f804fe None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:48.431380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcac6f-d391-4948-96b6-111d91f804fe None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:48.431657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcac6f-d391-4948-96b6-111d91f804fe None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:48.432367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcac6f-d391-4948-96b6-111d91f804fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:48.432615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcac6f-d391-4948-96b6-111d91f804fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:48.433986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcac6f-d391-4948-96b6-111d91f804fe None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:48.435840 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d8b19-7b3e-48f2-952c-28a57ad429ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:48.436887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d8b19-7b3e-48f2-952c-28a57ad429ca None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:48.437170 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d8b19-7b3e-48f2-952c-28a57ad429ca None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:48.437444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d8b19-7b3e-48f2-952c-28a57ad429ca None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:48.438088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d8b19-7b3e-48f2-952c-28a57ad429ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:48.438390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d8b19-7b3e-48f2-952c-28a57ad429ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:48.439771 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d8b19-7b3e-48f2-952c-28a57ad429ca None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:48.446923 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 232/464] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:48.447988 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5b57f-90c0-4447-bd5f-d48694c38137 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:48.448275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5b57f-90c0-4447-bd5f-d48694c38137 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:48.448548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5b57f-90c0-4447-bd5f-d48694c38137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:48.463745 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 233/465] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:48.463745 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139712b-6ecc-43f8-a90e-4bac675ac73e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:48.463745 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139712b-6ecc-43f8-a90e-4bac675ac73e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:48.463745 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139712b-6ecc-43f8-a90e-4bac675ac73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:48.472716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-26c5b57f-90c0-4447-bd5f-d48694c38137 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:48.474547 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-26c5b57f-90c0-4447-bd5f-d48694c38137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:48.484781 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-9139712b-6ecc-43f8-a90e-4bac675ac73e None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:48.485971 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9139712b-6ecc-43f8-a90e-4bac675ac73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:48.545971 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 233/466] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:48.546825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5b57f-90c0-4447-bd5f-d48694c38137 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:48.563151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 234/467] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:48.563151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139712b-6ecc-43f8-a90e-4bac675ac73e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:48.673351 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:48.719372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:48.733154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5b57f-90c0-4447-bd5f-d48694c38137 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:48.764992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139712b-6ecc-43f8-a90e-4bac675ac73e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:48.809389 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94b22d-df77-407d-ba79-6f8b74769ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:48.809968 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94b22d-df77-407d-ba79-6f8b74769ec3 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:48.810246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94b22d-df77-407d-ba79-6f8b74769ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:48.810520 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94b22d-df77-407d-ba79-6f8b74769ec3 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:48.811199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94b22d-df77-407d-ba79-6f8b74769ec3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:48.811778 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174f088-51cf-42fa-a79d-3c828226c708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:48.812605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174f088-51cf-42fa-a79d-3c828226c708 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:48.812730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94b22d-df77-407d-ba79-6f8b74769ec3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:48.813202 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174f088-51cf-42fa-a79d-3c828226c708 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:48.813678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174f088-51cf-42fa-a79d-3c828226c708 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:48.814520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174f088-51cf-42fa-a79d-3c828226c708 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:48.816277 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174f088-51cf-42fa-a79d-3c828226c708 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:48.842743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 235/468] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:05:48 2022] POST /identity/v3/users => generated 248 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:05:48.847201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94b22d-df77-407d-ba79-6f8b74769ec3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:48.851421 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 234/469] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:05:48 2022] POST /identity/v3/users => generated 246 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:05:48.890854 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959926c0-9c87-4b6b-ae68-9f75862081d5 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:48.891170 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959926c0-9c87-4b6b-ae68-9f75862081d5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:48.891448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959926c0-9c87-4b6b-ae68-9f75862081d5 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:48.893105 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 235/470] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:05:48.904964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2367-39bd-44aa-bdf4-61afeaff740f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:48.905253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2367-39bd-44aa-bdf4-61afeaff740f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:48.905514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2367-39bd-44aa-bdf4-61afeaff740f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:48.936933 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-625e2367-39bd-44aa-bdf4-61afeaff740f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:48.938737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-625e2367-39bd-44aa-bdf4-61afeaff740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:49.000053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94b22d-df77-407d-ba79-6f8b74769ec3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:49.042749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 236/471] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:05:49.042749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e2367-39bd-44aa-bdf4-61afeaff740f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:49.054385 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879363b-da89-4856-adcc-c15377b91c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:49.055110 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879363b-da89-4856-adcc-c15377b91c33 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:49.055454 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879363b-da89-4856-adcc-c15377b91c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:49.055735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879363b-da89-4856-adcc-c15377b91c33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:49.065888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:49.073615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879363b-da89-4856-adcc-c15377b91c33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:49.075130 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879363b-da89-4856-adcc-c15377b91c33 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-c879363b-da89-4856-adcc-c15377b91c33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:05:49.093940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:49.094886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:05:49.095761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:05:49.095761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:49.095761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:49.095761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 236/472] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:49.103125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879363b-da89-4856-adcc-c15377b91c33 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:49.111893 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:49.167678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e2367-39bd-44aa-bdf4-61afeaff740f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:49.214302 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f9173-058f-4cd5-a50e-f9f6e72acbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:49.215160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f9173-058f-4cd5-a50e-f9f6e72acbfe None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:49.215448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f9173-058f-4cd5-a50e-f9f6e72acbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:49.216129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f9173-058f-4cd5-a50e-f9f6e72acbfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:49.229172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f9173-058f-4cd5-a50e-f9f6e72acbfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:49.230835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f9173-058f-4cd5-a50e-f9f6e72acbfe None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:49.234075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879363b-da89-4856-adcc-c15377b91c33 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-218f9173-058f-4cd5-a50e-f9f6e72acbfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:05:49.249793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:49.250745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:05:49.252248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:05:49.252248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:49.252248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:49.252248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 237/473] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:49.258098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f9173-058f-4cd5-a50e-f9f6e72acbfe None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:49.275758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ddbb-db0b-4ca0-be52-afa3f66b7326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:49.276367 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ddbb-db0b-4ca0-be52-afa3f66b7326 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:49.276646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ddbb-db0b-4ca0-be52-afa3f66b7326 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:49.276915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ddbb-db0b-4ca0-be52-afa3f66b7326 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:49.277561 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5ddbb-db0b-4ca0-be52-afa3f66b7326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:49.277863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5ddbb-db0b-4ca0-be52-afa3f66b7326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:49.279261 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5ddbb-db0b-4ca0-be52-afa3f66b7326 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:49.308280 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 237/474] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:49.312989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ddbb-db0b-4ca0-be52-afa3f66b7326 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:49.399470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:49.422494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f9173-058f-4cd5-a50e-f9f6e72acbfe None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:49.436573 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:49.442493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ddbb-db0b-4ca0-be52-afa3f66b7326 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:49.464975 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f3509-d189-4a99-972c-a2556d60489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:49.465504 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f3509-d189-4a99-972c-a2556d60489f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:49.465784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f3509-d189-4a99-972c-a2556d60489f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:49.466058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f3509-d189-4a99-972c-a2556d60489f None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:49.466709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f3509-d189-4a99-972c-a2556d60489f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:49.467012 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f3509-d189-4a99-972c-a2556d60489f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:49.468597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f3509-d189-4a99-972c-a2556d60489f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:49.480687 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7208fd5-cac3-41f2-b7a7-8a7553599343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:49.481432 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7208fd5-cac3-41f2-b7a7-8a7553599343 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:49.481805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7208fd5-cac3-41f2-b7a7-8a7553599343 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:49.482174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7208fd5-cac3-41f2-b7a7-8a7553599343 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:49.482934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7208fd5-cac3-41f2-b7a7-8a7553599343 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:49.484571 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7208fd5-cac3-41f2-b7a7-8a7553599343 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:49.487335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 238/475] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:49.488199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f3509-d189-4a99-972c-a2556d60489f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:49.510834 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 238/476] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:05:49 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:05:49.511879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7208fd5-cac3-41f2-b7a7-8a7553599343 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:49.634088 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f3509-d189-4a99-972c-a2556d60489f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:49.710482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159993a-6d98-4fdb-ad73-5aa99866363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:49.712083 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159993a-6d98-4fdb-ad73-5aa99866363c None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:49.713877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159993a-6d98-4fdb-ad73-5aa99866363c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:49.714148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159993a-6d98-4fdb-ad73-5aa99866363c None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:49.714829 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159993a-6d98-4fdb-ad73-5aa99866363c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:49.716290 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159993a-6d98-4fdb-ad73-5aa99866363c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:49.720842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7208fd5-cac3-41f2-b7a7-8a7553599343 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:49.725576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.sql.core [None req-e159993a-6d98-4fdb-ad73-5aa99866363c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 01:05:49.725576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 01:05:49.725576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [parameters: {'id': 'f594b87aaf8d47dc94333c54850619c8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 01:05:49.725576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81466) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 01:05:49.729891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:49.742916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e159993a-6d98-4fdb-ad73-5aa99866363c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 01:05:49.742916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:49.742916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 01:05:49.742916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 01:05:49.742916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 01:05:49.742916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 01:05:49.742916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 01:05:49.742916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 01:05:49.742916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 01:05:49.742916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application conn.query(q) Sep 13 01:05:49.742916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 01:05:49.742916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 01:05:49.742916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 01:05:49.742916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result.read() Sep 13 01:05:49.742916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return ref.to_dict() Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 01:05:49.743881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application next(self.gen) Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application yield resource Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application next(self.gen) Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise self.value Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application session.commit() Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 01:05:49.745470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.session.flush() Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application compat.raise_( Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 01:05:49.746347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 01:05:49.747850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application conn.query(q) Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result.read() Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 01:05:49.750036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [parameters: {'id': 'f594b87aaf8d47dc94333c54850619c8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:49.752040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 01:05:49.755864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:49.758056 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 239/477] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Sep 13 01:05:49 2022] POST /identity/v3/roles => generated 144 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:49.758056 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159993a-6d98-4fdb-ad73-5aa99866363c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:49.778989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb621524-cf5b-4751-9bfd-2aaf9e64b892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:49.780108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb621524-cf5b-4751-9bfd-2aaf9e64b892 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:49.780663 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb621524-cf5b-4751-9bfd-2aaf9e64b892 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:49.782216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb621524-cf5b-4751-9bfd-2aaf9e64b892 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:49.783361 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb621524-cf5b-4751-9bfd-2aaf9e64b892 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:49.785056 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb621524-cf5b-4751-9bfd-2aaf9e64b892 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:49.789851 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:49.819415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 239/478] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:05:49 2022] POST /identity/v3/users => generated 249 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:05:49.887587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159993a-6d98-4fdb-ad73-5aa99866363c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:49.930750 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1640a75-48eb-4d91-b702-9a6961bb4e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:49.931871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1640a75-48eb-4d91-b702-9a6961bb4e0d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:49.932388 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1640a75-48eb-4d91-b702-9a6961bb4e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:49.932894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1640a75-48eb-4d91-b702-9a6961bb4e0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:49.945592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1640a75-48eb-4d91-b702-9a6961bb4e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-a1640a75-48eb-4d91-b702-9a6961bb4e0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:49.951556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:49.952484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:49.953298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:49.953298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:49.953298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:49.953298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:49.953298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:49.953298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:49.953298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:49.953298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:49.953298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:49.953298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:49.953298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 01:05:49.953298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:49.956114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 240/479] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:05:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:49.961878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb621524-cf5b-4751-9bfd-2aaf9e64b892 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:50.100685 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb621524-cf5b-4751-9bfd-2aaf9e64b892 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:50.141234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a241176-37af-4954-be3b-40122a7ba2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:50.141861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a241176-37af-4954-be3b-40122a7ba2ef None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:50.142132 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a241176-37af-4954-be3b-40122a7ba2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:50.142402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a241176-37af-4954-be3b-40122a7ba2ef None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:50.143094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a241176-37af-4954-be3b-40122a7ba2ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:50.143409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a241176-37af-4954-be3b-40122a7ba2ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:50.144758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a241176-37af-4954-be3b-40122a7ba2ef None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:50.154220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 240/480] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:05:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:51.389328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c31d7c-abde-4e75-b2b0-9a850e9a63dc None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:51.389841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c31d7c-abde-4e75-b2b0-9a850e9a63dc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:51.389916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c31d7c-abde-4e75-b2b0-9a850e9a63dc None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:51.391573 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 241/481] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:51.396738 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a628d-3d4a-4265-b329-cda386ad732e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:51.397149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a628d-3d4a-4265-b329-cda386ad732e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:51.397314 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a628d-3d4a-4265-b329-cda386ad732e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:51.425379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c65a628d-3d4a-4265-b329-cda386ad732e None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:51.427166 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c65a628d-3d4a-4265-b329-cda386ad732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:51.452822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:51.522160 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 241/482] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:05:51.654995 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eea45-02ec-49bf-9ccb-66c0da580f5f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:51.655330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eea45-02ec-49bf-9ccb-66c0da580f5f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:51.655505 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eea45-02ec-49bf-9ccb-66c0da580f5f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:51.657079 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 242/483] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:51.662694 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc1a11-936c-4058-8537-c6bc08e2e59a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:51.662982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc1a11-936c-4058-8537-c6bc08e2e59a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:51.663288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc1a11-936c-4058-8537-c6bc08e2e59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:51.685423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-d6bc1a11-936c-4058-8537-c6bc08e2e59a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:51.686614 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d6bc1a11-936c-4058-8537-c6bc08e2e59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:51.779053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 242/484] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:51.914472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7eea45-02ec-49bf-9ccb-66c0da580f5f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:52.034256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:52.043785 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7eea45-02ec-49bf-9ccb-66c0da580f5f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:52.097038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc282437-d936-4c85-91a3-ec1ceed646ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:52.097715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc282437-d936-4c85-91a3-ec1ceed646ea None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:52.098027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc282437-d936-4c85-91a3-ec1ceed646ea None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:52.098335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc282437-d936-4c85-91a3-ec1ceed646ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:52.117192 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc282437-d936-4c85-91a3-ec1ceed646ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-fc282437-d936-4c85-91a3-ec1ceed646ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:52.122136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:52.122996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:52.123825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:52.123825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:52.123825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:52.123825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:52.123825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:52.123825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:52.123825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:52.123825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:52.123825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:52.123825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:52.123825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:05:52.123825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:52.127194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 243/485] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:05:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:52.132198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc1a11-936c-4058-8537-c6bc08e2e59a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:52.176894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc282437-d936-4c85-91a3-ec1ceed646ea None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:52.251908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:52.266872 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc1a11-936c-4058-8537-c6bc08e2e59a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:52.301776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc282437-d936-4c85-91a3-ec1ceed646ea None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:52.314756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa72bae-5e6b-4741-8c2d-dced84df0081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:52.315926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa72bae-5e6b-4741-8c2d-dced84df0081 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:52.316420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa72bae-5e6b-4741-8c2d-dced84df0081 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:52.318242 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa72bae-5e6b-4741-8c2d-dced84df0081 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:52.319424 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa72bae-5e6b-4741-8c2d-dced84df0081 None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:52.319903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa72bae-5e6b-4741-8c2d-dced84df0081 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:52.322052 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa72bae-5e6b-4741-8c2d-dced84df0081 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:52.334829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 243/486] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:05:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:52.336393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7e726-cc3c-4652-9550-6229bc550fd2 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:52.336834 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7e726-cc3c-4652-9550-6229bc550fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:52.337275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7e726-cc3c-4652-9550-6229bc550fd2 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:52.338950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 244/487] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:52.339991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7e726-cc3c-4652-9550-6229bc550fd2 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:52.347758 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43607a4-be69-415c-bca4-9a6dbc1b804b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:52.349049 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43607a4-be69-415c-bca4-9a6dbc1b804b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:52.349398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43607a4-be69-415c-bca4-9a6dbc1b804b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:52.349731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43607a4-be69-415c-bca4-9a6dbc1b804b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:52.361424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43607a4-be69-415c-bca4-9a6dbc1b804b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-d43607a4-be69-415c-bca4-9a6dbc1b804b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:52.367179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:52.368050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:52.368837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:52.368837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:52.368837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:52.368837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:52.368837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:52.368837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:52.368837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:52.368837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:52.368837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:52.368837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:52.368837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:05:52.368837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:52.368837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 244/488] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:05:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:05:52.369624 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0d49a-5a17-40eb-9d83-5f2eb029eb9d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:52.370300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0d49a-5a17-40eb-9d83-5f2eb029eb9d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:52.370739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0d49a-5a17-40eb-9d83-5f2eb029eb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:52.390642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d4f0d49a-5a17-40eb-9d83-5f2eb029eb9d None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:52.392036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d4f0d49a-5a17-40eb-9d83-5f2eb029eb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:52.404465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:52.477257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7e726-cc3c-4652-9550-6229bc550fd2 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:52.477939 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 245/489] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:52.479313 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0d49a-5a17-40eb-9d83-5f2eb029eb9d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:52.529760 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45475b-4d53-411e-88c0-2c86175f0d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:52.530770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45475b-4d53-411e-88c0-2c86175f0d8f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:52.532401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45475b-4d53-411e-88c0-2c86175f0d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:52.532902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45475b-4d53-411e-88c0-2c86175f0d8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:52.553152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45475b-4d53-411e-88c0-2c86175f0d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:52.559625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45475b-4d53-411e-88c0-2c86175f0d8f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:52.569259 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-8d45475b-4d53-411e-88c0-2c86175f0d8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:05:52.590047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:52.591033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:05:52.591918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:05:52.591918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:52.591918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:52.594254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 245/490] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:52.600300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45475b-4d53-411e-88c0-2c86175f0d8f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:52.668366 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0d49a-5a17-40eb-9d83-5f2eb029eb9d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:52.708827 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da7602-77e0-4b75-a76a-c314ef3919be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:52.709839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da7602-77e0-4b75-a76a-c314ef3919be None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:52.710115 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da7602-77e0-4b75-a76a-c314ef3919be None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:52.710389 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da7602-77e0-4b75-a76a-c314ef3919be None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:52.711057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da7602-77e0-4b75-a76a-c314ef3919be None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:52.711391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da7602-77e0-4b75-a76a-c314ef3919be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:52.712751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da7602-77e0-4b75-a76a-c314ef3919be None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:52.721600 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 246/491] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:05:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:52.729427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da7602-77e0-4b75-a76a-c314ef3919be None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:52.751489 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:52.802038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45475b-4d53-411e-88c0-2c86175f0d8f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:52.839663 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a6e56-8ef8-419d-95cb-258f25c43895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:52.840267 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6e56-8ef8-419d-95cb-258f25c43895 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:52.840548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6e56-8ef8-419d-95cb-258f25c43895 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:52.840810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6e56-8ef8-419d-95cb-258f25c43895 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:52.841446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a6e56-8ef8-419d-95cb-258f25c43895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:52.841754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a6e56-8ef8-419d-95cb-258f25c43895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:52.843407 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a6e56-8ef8-419d-95cb-258f25c43895 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:52.856713 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 246/492] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:52.857936 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f7ccc-5b79-425a-9855-68e025b08add None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:52.858216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f7ccc-5b79-425a-9855-68e025b08add None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:52.858485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f7ccc-5b79-425a-9855-68e025b08add None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:52.864164 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 247/493] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:52.864164 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f7ccc-5b79-425a-9855-68e025b08add None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:52.882046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da7602-77e0-4b75-a76a-c314ef3919be None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:52.918338 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc23e5-4771-4b77-b97c-4101e4253b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:52.918968 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc23e5-4771-4b77-b97c-4101e4253b56 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:52.919270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc23e5-4771-4b77-b97c-4101e4253b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:52.919544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc23e5-4771-4b77-b97c-4101e4253b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:52.927489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:52.931631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc23e5-4771-4b77-b97c-4101e4253b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:52.933593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc23e5-4771-4b77-b97c-4101e4253b56 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-adcc23e5-4771-4b77-b97c-4101e4253b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:05:52.949352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:52.950560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:05:52.951746 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:05:52.951746 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:52.951746 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:52.954985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 247/494] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:52.955687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc23e5-4771-4b77-b97c-4101e4253b56 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:52.980594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f7ccc-5b79-425a-9855-68e025b08add None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:53.023934 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:53.032654 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4d941-e525-4659-8072-3c131b58f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:53.033867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d941-e525-4659-8072-3c131b58f494 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:53.034296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d941-e525-4659-8072-3c131b58f494 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:53.034694 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d941-e525-4659-8072-3c131b58f494 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:53.048615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4d941-e525-4659-8072-3c131b58f494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-e9f4d941-e525-4659-8072-3c131b58f494 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:53.054607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:53.055588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:53.056477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:53.056477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:53.056477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:53.056477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:53.056477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:53.056477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:53.056477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:53.056477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:53.056477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:53.056477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:53.056477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:05:53.056477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:53.056477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 248/495] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:05:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:53.057202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201a9ae-81bf-4252-8be5-370f562e7614 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:53.057451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201a9ae-81bf-4252-8be5-370f562e7614 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:53.057724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201a9ae-81bf-4252-8be5-370f562e7614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:53.075378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2201a9ae-81bf-4252-8be5-370f562e7614 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:53.075546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc23e5-4771-4b77-b97c-4101e4253b56 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:53.076905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2201a9ae-81bf-4252-8be5-370f562e7614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:53.116125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e8168-7ea3-4f38-afcd-cdd3f1450ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:53.116992 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e8168-7ea3-4f38-afcd-cdd3f1450ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:53.117411 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e8168-7ea3-4f38-afcd-cdd3f1450ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:53.117851 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e8168-7ea3-4f38-afcd-cdd3f1450ad4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:53.127594 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e8168-7ea3-4f38-afcd-cdd3f1450ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:53.129302 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e8168-7ea3-4f38-afcd-cdd3f1450ad4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-2a4e8168-7ea3-4f38-afcd-cdd3f1450ad4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:05:53.143000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:53.143965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:53.144948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:53.144948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:53.144948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:05:53.144948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:05:53.144948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:05:53.144948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:05:53.144948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:05:53.144948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:05:53.144948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:05:53.144948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:53.144948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 248/496] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 13 01:05:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:53.145745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e8168-7ea3-4f38-afcd-cdd3f1450ad4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:53.145813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 249/497] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:53.146280 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201a9ae-81bf-4252-8be5-370f562e7614 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:53.195030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:53.249356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201a9ae-81bf-4252-8be5-370f562e7614 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:53.265054 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e8168-7ea3-4f38-afcd-cdd3f1450ad4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:53.282615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:53.295288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a23e5d-267d-480a-aa14-034d394a8df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:53.296462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a23e5d-267d-480a-aa14-034d394a8df4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:53.297262 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a23e5d-267d-480a-aa14-034d394a8df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:53.297960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a23e5d-267d-480a-aa14-034d394a8df4 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:53.298936 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a23e5d-267d-480a-aa14-034d394a8df4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:53.299441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a23e5d-267d-480a-aa14-034d394a8df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:53.301037 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a23e5d-267d-480a-aa14-034d394a8df4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:53.301522 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721ea82-8e1f-4cc5-b33c-4cff5b1b53ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:53.302224 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721ea82-8e1f-4cc5-b33c-4cff5b1b53ee None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:53.302502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721ea82-8e1f-4cc5-b33c-4cff5b1b53ee None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:53.302774 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721ea82-8e1f-4cc5-b33c-4cff5b1b53ee None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:53.303440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721ea82-8e1f-4cc5-b33c-4cff5b1b53ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:53.303740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721ea82-8e1f-4cc5-b33c-4cff5b1b53ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:53.305099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721ea82-8e1f-4cc5-b33c-4cff5b1b53ee None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:53.312667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 250/498] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:05:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:53.318231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d7d7c-2377-4310-acd0-a06166dd8921 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:53.318231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d7d7c-2377-4310-acd0-a06166dd8921 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:53.318231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d7d7c-2377-4310-acd0-a06166dd8921 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:53.321197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 249/499] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:53.324556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721ea82-8e1f-4cc5-b33c-4cff5b1b53ee None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:53.324680 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 251/500] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:53.324680 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d7d7c-2377-4310-acd0-a06166dd8921 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:53.431389 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d7d7c-2377-4310-acd0-a06166dd8921 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:53.431757 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721ea82-8e1f-4cc5-b33c-4cff5b1b53ee None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:53.442634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:53.467125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a7621-bec8-4c12-b041-d1aa6fed0bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:53.467658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2d285-9137-4780-8fee-daa93c556cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:53.467765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a7621-bec8-4c12-b041-d1aa6fed0bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:53.467999 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a7621-bec8-4c12-b041-d1aa6fed0bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:53.468270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a7621-bec8-4c12-b041-d1aa6fed0bb6 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:53.468358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2d285-9137-4780-8fee-daa93c556cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:53.468545 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2d285-9137-4780-8fee-daa93c556cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:53.468814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2d285-9137-4780-8fee-daa93c556cb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:53.468997 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a7621-bec8-4c12-b041-d1aa6fed0bb6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:53.469314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a7621-bec8-4c12-b041-d1aa6fed0bb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:53.470740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a7621-bec8-4c12-b041-d1aa6fed0bb6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:53.478892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2d285-9137-4780-8fee-daa93c556cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:53.480360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2d285-9137-4780-8fee-daa93c556cb8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-daf2d285-9137-4780-8fee-daa93c556cb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:05:53.495276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:53.496372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:05:53.497305 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:05:53.497305 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:53.497305 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:53.497305 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 252/501] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:53.498647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0612e-335a-4a5b-a557-053f112a4454 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:53.498647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0612e-335a-4a5b-a557-053f112a4454 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:53.498647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0612e-335a-4a5b-a557-053f112a4454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:53.511549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 250/502] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 13 01:05:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:53.512325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a7621-bec8-4c12-b041-d1aa6fed0bb6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:53.516502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-16e0612e-335a-4a5b-a557-053f112a4454 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:53.517699 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-16e0612e-335a-4a5b-a557-053f112a4454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:53.547266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:53.587675 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 253/503] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:05:53.588736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0612e-335a-4a5b-a557-053f112a4454 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:53.612415 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a7621-bec8-4c12-b041-d1aa6fed0bb6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:53.651776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7ac4d-a086-404f-b927-50875afc10f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:53.652409 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7ac4d-a086-404f-b927-50875afc10f7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:53.652691 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7ac4d-a086-404f-b927-50875afc10f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:53.652964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7ac4d-a086-404f-b927-50875afc10f7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:53.660584 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7ac4d-a086-404f-b927-50875afc10f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:53.662213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7ac4d-a086-404f-b927-50875afc10f7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-47c7ac4d-a086-404f-b927-50875afc10f7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:05:53.673768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:53.674865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:53.675824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:53.675824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:53.675824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:05:53.675824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:05:53.675824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:05:53.675824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:05:53.675824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:05:53.675824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:05:53.675824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 01:05:53.675824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:53.675824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 251/504] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:53.675824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7ac4d-a086-404f-b927-50875afc10f7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:53.704874 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:53.714468 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0612e-335a-4a5b-a557-053f112a4454 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:53.752136 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c08f1-6174-4020-9901-dcf8864e91c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:53.752770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c08f1-6174-4020-9901-dcf8864e91c5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:53.753050 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c08f1-6174-4020-9901-dcf8864e91c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:53.753324 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c08f1-6174-4020-9901-dcf8864e91c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:53.764271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c08f1-6174-4020-9901-dcf8864e91c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-482c08f1-6174-4020-9901-dcf8864e91c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:53.769446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:53.770634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:53.771470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:53.771470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:53.771470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:53.771470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:53.771470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:53.771470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:53.771470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:53.771470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:53.771470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:53.771470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:53.771470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:05:53.771470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:53.771470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 254/505] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:05:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:53.772121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c08f1-6174-4020-9901-dcf8864e91c5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:53.782175 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:53.790360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7ac4d-a086-404f-b927-50875afc10f7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:53.827373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5580ce-91d1-400c-9dca-9313065de5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:53.827982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5580ce-91d1-400c-9dca-9313065de5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:53.828263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5580ce-91d1-400c-9dca-9313065de5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:53.828537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5580ce-91d1-400c-9dca-9313065de5a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:53.829186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5580ce-91d1-400c-9dca-9313065de5a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:53.829489 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5580ce-91d1-400c-9dca-9313065de5a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:53.830864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5580ce-91d1-400c-9dca-9313065de5a9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:53.842508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 252/506] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:53.843323 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5580ce-91d1-400c-9dca-9313065de5a9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:53.887462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c08f1-6174-4020-9901-dcf8864e91c5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:53.921004 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6e172-af59-4564-83bf-2d882dbae02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:53.921601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6e172-af59-4564-83bf-2d882dbae02f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:53.921877 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6e172-af59-4564-83bf-2d882dbae02f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:53.922146 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6e172-af59-4564-83bf-2d882dbae02f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:53.940787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5580ce-91d1-400c-9dca-9313065de5a9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:53.943953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:53.974364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f4a35-75e4-4558-b4cf-8bb16e9ff4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:53.974967 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f4a35-75e4-4558-b4cf-8bb16e9ff4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:53.975273 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f4a35-75e4-4558-b4cf-8bb16e9ff4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:53.975545 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f4a35-75e4-4558-b4cf-8bb16e9ff4c0 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:53.976269 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f4a35-75e4-4558-b4cf-8bb16e9ff4c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:53.976569 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f4a35-75e4-4558-b4cf-8bb16e9ff4c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:53.977993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f4a35-75e4-4558-b4cf-8bb16e9ff4c0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:53.991367 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6e172-af59-4564-83bf-2d882dbae02f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:53.992827 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6e172-af59-4564-83bf-2d882dbae02f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:53.996062 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 253/507] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 13 01:05:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:53.996860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f4a35-75e4-4558-b4cf-8bb16e9ff4c0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:54.015356 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:54.091932 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 255/508] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:54.092769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6e172-af59-4564-83bf-2d882dbae02f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:54.100403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f4a35-75e4-4558-b4cf-8bb16e9ff4c0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:54.133398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcec84-28b3-4dcd-82d5-8fa706fa6568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:54.134000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcec84-28b3-4dcd-82d5-8fa706fa6568 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:54.134281 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcec84-28b3-4dcd-82d5-8fa706fa6568 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:54.134556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcec84-28b3-4dcd-82d5-8fa706fa6568 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:54.135258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcec84-28b3-4dcd-82d5-8fa706fa6568 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:54.135564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcec84-28b3-4dcd-82d5-8fa706fa6568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:54.136945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcec84-28b3-4dcd-82d5-8fa706fa6568 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:54.144663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 254/509] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:05:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:54.145384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:54.146046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcec84-28b3-4dcd-82d5-8fa706fa6568 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:54.194879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6e172-af59-4564-83bf-2d882dbae02f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:54.220959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:54.230001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d96aa-bd6a-4b8a-92e4-2542236220e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:54.230628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d96aa-bd6a-4b8a-92e4-2542236220e2 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:54.230904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d96aa-bd6a-4b8a-92e4-2542236220e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:54.231208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d96aa-bd6a-4b8a-92e4-2542236220e2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:54.238121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d96aa-bd6a-4b8a-92e4-2542236220e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:54.239712 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d96aa-bd6a-4b8a-92e4-2542236220e2 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:54.244483 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcec84-28b3-4dcd-82d5-8fa706fa6568 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-d85d96aa-bd6a-4b8a-92e4-2542236220e2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:05:54.252392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:54.253334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:54.254215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:54.254215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:54.254215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:05:54.254215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:05:54.254215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:05:54.254215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:05:54.254215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:05:54.254215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:05:54.254215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 01:05:54.254215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:54.254215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 256/510] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:05:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:54.255214 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d96aa-bd6a-4b8a-92e4-2542236220e2 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:54.282440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cb23d-03fb-42f7-9522-30eafdb0d500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:54.282986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cb23d-03fb-42f7-9522-30eafdb0d500 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:54.283612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cb23d-03fb-42f7-9522-30eafdb0d500 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:54.283612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cb23d-03fb-42f7-9522-30eafdb0d500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:54.294822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cb23d-03fb-42f7-9522-30eafdb0d500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:54.296302 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cb23d-03fb-42f7-9522-30eafdb0d500 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-d67cb23d-03fb-42f7-9522-30eafdb0d500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:05:54.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:54.311264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:05:54.312136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:05:54.312136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:54.312136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:54.312136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 255/511] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:54.312376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cb23d-03fb-42f7-9522-30eafdb0d500 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:54.359402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d96aa-bd6a-4b8a-92e4-2542236220e2 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:54.372524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:54.395615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ee42c-46d2-45e1-95de-df65160c443a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:54.396400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ee42c-46d2-45e1-95de-df65160c443a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:54.396675 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ee42c-46d2-45e1-95de-df65160c443a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:54.396942 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ee42c-46d2-45e1-95de-df65160c443a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:54.411003 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cb23d-03fb-42f7-9522-30eafdb0d500 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:54.437514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:54.446496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b5b89-6749-4006-b141-2eee11e2c9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:54.447153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b5b89-6749-4006-b141-2eee11e2c9bb None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:54.447438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b5b89-6749-4006-b141-2eee11e2c9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:54.447713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b5b89-6749-4006-b141-2eee11e2c9bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:54.458432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b5b89-6749-4006-b141-2eee11e2c9bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:54.459913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b5b89-6749-4006-b141-2eee11e2c9bb None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:54.469592 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ee42c-46d2-45e1-95de-df65160c443a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:54.471085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ee42c-46d2-45e1-95de-df65160c443a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-296b5b89-6749-4006-b141-2eee11e2c9bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:05:54.475150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:54.476197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:05:54.477059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:05:54.477059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:54.477059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:54.477059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 256/512] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:54.477059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b5b89-6749-4006-b141-2eee11e2c9bb None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:54.571351 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 257/513] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:54.571900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ee42c-46d2-45e1-95de-df65160c443a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:54.577950 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b5b89-6749-4006-b141-2eee11e2c9bb None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:54.588853 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:54.611155 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971fde3-f3fa-4fe9-af63-83a5aace6c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:54.611742 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971fde3-f3fa-4fe9-af63-83a5aace6c58 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:54.612016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971fde3-f3fa-4fe9-af63-83a5aace6c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:54.612287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971fde3-f3fa-4fe9-af63-83a5aace6c58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:54.622397 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971fde3-f3fa-4fe9-af63-83a5aace6c58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:54.623849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971fde3-f3fa-4fe9-af63-83a5aace6c58 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-1971fde3-f3fa-4fe9-af63-83a5aace6c58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:05:54.638142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:54.639016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:05:54.639949 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:05:54.639949 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:54.639949 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:54.639949 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 257/514] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:54.640404 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971fde3-f3fa-4fe9-af63-83a5aace6c58 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:54.671312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:54.677594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ee42c-46d2-45e1-95de-df65160c443a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:54.711681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720e2e3-56dd-4407-a710-5152b40f2e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:54.712289 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720e2e3-56dd-4407-a710-5152b40f2e5d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:54.712565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720e2e3-56dd-4407-a710-5152b40f2e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:54.712835 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720e2e3-56dd-4407-a710-5152b40f2e5d None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:54.713559 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720e2e3-56dd-4407-a710-5152b40f2e5d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:54.713860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720e2e3-56dd-4407-a710-5152b40f2e5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:54.715330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720e2e3-56dd-4407-a710-5152b40f2e5d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:54.739673 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971fde3-f3fa-4fe9-af63-83a5aace6c58 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:54.756662 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 258/515] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 13 01:05:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:54.757497 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720e2e3-56dd-4407-a710-5152b40f2e5d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:54.774076 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83427c83-5478-40d4-a763-86fa50f351a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:54.774676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83427c83-5478-40d4-a763-86fa50f351a4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:54.774951 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83427c83-5478-40d4-a763-86fa50f351a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:54.775250 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83427c83-5478-40d4-a763-86fa50f351a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:54.775891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83427c83-5478-40d4-a763-86fa50f351a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:54.776188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83427c83-5478-40d4-a763-86fa50f351a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:54.777542 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83427c83-5478-40d4-a763-86fa50f351a4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:54.789446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 258/516] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:54.790232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83427c83-5478-40d4-a763-86fa50f351a4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:54.828474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:54.859176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720e2e3-56dd-4407-a710-5152b40f2e5d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:54.881109 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:54.890457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83427c83-5478-40d4-a763-86fa50f351a4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:54.893012 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f74695-d1e7-470e-abf1-385aeb0053a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:54.893619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f74695-d1e7-470e-abf1-385aeb0053a0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:54.893893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f74695-d1e7-470e-abf1-385aeb0053a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:54.894160 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f74695-d1e7-470e-abf1-385aeb0053a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:54.894870 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f74695-d1e7-470e-abf1-385aeb0053a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:54.895194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f74695-d1e7-470e-abf1-385aeb0053a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:54.896569 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f74695-d1e7-470e-abf1-385aeb0053a0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:54.907582 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 259/517] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:54.908379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f74695-d1e7-470e-abf1-385aeb0053a0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:54.926783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c26a9-3fee-4c0b-b387-b2509aa30489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:54.927476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c26a9-3fee-4c0b-b387-b2509aa30489 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:54.927754 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c26a9-3fee-4c0b-b387-b2509aa30489 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:54.928020 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c26a9-3fee-4c0b-b387-b2509aa30489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:54.938164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c26a9-3fee-4c0b-b387-b2509aa30489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:54.939627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c26a9-3fee-4c0b-b387-b2509aa30489 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-5e8c26a9-3fee-4c0b-b387-b2509aa30489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:05:54.954186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:54.955317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:05:54.956181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:05:54.956181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:54.956181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:54.956181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 259/518] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:54.956181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c26a9-3fee-4c0b-b387-b2509aa30489 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:55.008013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f74695-d1e7-470e-abf1-385aeb0053a0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:55.038800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:55.045078 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58a6af-8320-46fd-8c35-4671b36be7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:55.046117 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58a6af-8320-46fd-8c35-4671b36be7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:55.046398 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58a6af-8320-46fd-8c35-4671b36be7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:55.046674 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58a6af-8320-46fd-8c35-4671b36be7a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:55.047343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58a6af-8320-46fd-8c35-4671b36be7a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:55.047650 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58a6af-8320-46fd-8c35-4671b36be7a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:55.049034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58a6af-8320-46fd-8c35-4671b36be7a0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:55.057515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c26a9-3fee-4c0b-b387-b2509aa30489 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:55.060724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 260/519] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:55.061501 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58a6af-8320-46fd-8c35-4671b36be7a0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:55.093586 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc1094-8eb8-4451-b855-be0ca4ebae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:55.094121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc1094-8eb8-4451-b855-be0ca4ebae8e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:55.094402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc1094-8eb8-4451-b855-be0ca4ebae8e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:55.094672 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc1094-8eb8-4451-b855-be0ca4ebae8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:55.109045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:55.161287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58a6af-8320-46fd-8c35-4671b36be7a0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:55.162247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc1094-8eb8-4451-b855-be0ca4ebae8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:55.163743 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc1094-8eb8-4451-b855-be0ca4ebae8e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:55.194739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706abfe-0dae-4b9a-a160-69681dd84c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:55.195370 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706abfe-0dae-4b9a-a160-69681dd84c8c None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:55.195648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706abfe-0dae-4b9a-a160-69681dd84c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:55.195923 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706abfe-0dae-4b9a-a160-69681dd84c8c None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:55.196566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706abfe-0dae-4b9a-a160-69681dd84c8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:55.197982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706abfe-0dae-4b9a-a160-69681dd84c8c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:55.219857 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 261/520] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:05:55 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:05:55.220742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706abfe-0dae-4b9a-a160-69681dd84c8c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:55.280910 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 260/521] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:55.282160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc1094-8eb8-4451-b855-be0ca4ebae8e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:55.285221 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:55.335840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:55.349728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706abfe-0dae-4b9a-a160-69681dd84c8c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:55.390800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db18776-4774-49de-9a49-6e96fc5b9921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:55.391570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db18776-4774-49de-9a49-6e96fc5b9921 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:55.391919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db18776-4774-49de-9a49-6e96fc5b9921 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:55.392200 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db18776-4774-49de-9a49-6e96fc5b9921 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:55.397637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc1094-8eb8-4451-b855-be0ca4ebae8e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:55.399871 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db18776-4774-49de-9a49-6e96fc5b9921 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:55.401374 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db18776-4774-49de-9a49-6e96fc5b9921 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:55.414794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-3db18776-4774-49de-9a49-6e96fc5b9921 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:05:55.414794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:55.414794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:55.414794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:55.414794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:55.414794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:55.414794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:55.414794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:55.414794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:55.414794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:55.414794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:55.414794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:55.414794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:05:55.414794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:05:55.414794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:55.415715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:55.416538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:05:55.416538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:05:55.416538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:05:55.416538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:05:55.416538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:05:55.416538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:05:55.416538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:05:55.416538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:55.416538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 262/522] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:05:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:55.416998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db18776-4774-49de-9a49-6e96fc5b9921 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:55.446751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06166211-5ec0-4d99-b6a1-71a9d351d8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:55.447436 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06166211-5ec0-4d99-b6a1-71a9d351d8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:55.447704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06166211-5ec0-4d99-b6a1-71a9d351d8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:55.447978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06166211-5ec0-4d99-b6a1-71a9d351d8d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:55.448632 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06166211-5ec0-4d99-b6a1-71a9d351d8d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:55.448933 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06166211-5ec0-4d99-b6a1-71a9d351d8d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:55.450314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06166211-5ec0-4d99-b6a1-71a9d351d8d8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:55.462118 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 261/523] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:55.462945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06166211-5ec0-4d99-b6a1-71a9d351d8d8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:55.531982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db18776-4774-49de-9a49-6e96fc5b9921 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:55.540509 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:55.569818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06166211-5ec0-4d99-b6a1-71a9d351d8d8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:55.570774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6ea90-4124-4c7c-856f-01a97630d295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:55.571567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6ea90-4124-4c7c-856f-01a97630d295 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:55.572115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6ea90-4124-4c7c-856f-01a97630d295 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:55.572115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6ea90-4124-4c7c-856f-01a97630d295 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:55.572432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:55.582175 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6ea90-4124-4c7c-856f-01a97630d295 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:55.583780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6ea90-4124-4c7c-856f-01a97630d295 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-56c6ea90-4124-4c7c-856f-01a97630d295 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:05:55.596070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:55.597014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:55.598016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:55.598016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:55.598016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:05:55.598016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:05:55.598016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:05:55.598016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:05:55.598016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:05:55.598016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:05:55.598016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 01:05:55.598016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:55.598016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 263/524] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:05:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:55.598672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6ea90-4124-4c7c-856f-01a97630d295 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:55.610709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200ba7f-ab15-40aa-91c2-acbcbd12caec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:55.611296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200ba7f-ab15-40aa-91c2-acbcbd12caec None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:55.611582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200ba7f-ab15-40aa-91c2-acbcbd12caec None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:55.611857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200ba7f-ab15-40aa-91c2-acbcbd12caec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:55.623493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200ba7f-ab15-40aa-91c2-acbcbd12caec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:55.624968 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200ba7f-ab15-40aa-91c2-acbcbd12caec None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-7200ba7f-ab15-40aa-91c2-acbcbd12caec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:05:55.643125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:55.644129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:05:55.645980 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:05:55.645980 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:55.645980 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:55.645980 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 262/525] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:55.645980 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200ba7f-ab15-40aa-91c2-acbcbd12caec None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:55.711801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6ea90-4124-4c7c-856f-01a97630d295 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:55.749794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0894430-2cab-41b3-877d-231ceadf170c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:55.750401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0894430-2cab-41b3-877d-231ceadf170c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:55.750710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0894430-2cab-41b3-877d-231ceadf170c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:55.750990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0894430-2cab-41b3-877d-231ceadf170c None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:55.751713 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0894430-2cab-41b3-877d-231ceadf170c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:55.752019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0894430-2cab-41b3-877d-231ceadf170c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:55.753515 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0894430-2cab-41b3-877d-231ceadf170c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:55.756428 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200ba7f-ab15-40aa-91c2-acbcbd12caec None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:55.773926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 264/526] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:05:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:55.774783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0894430-2cab-41b3-877d-231ceadf170c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:55.795616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d72a3f-aad8-4838-b64c-166976347a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:55.796381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d72a3f-aad8-4838-b64c-166976347a26 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:55.796662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d72a3f-aad8-4838-b64c-166976347a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:55.796938 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d72a3f-aad8-4838-b64c-166976347a26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:55.802300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:55.805697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d72a3f-aad8-4838-b64c-166976347a26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:55.807184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d72a3f-aad8-4838-b64c-166976347a26 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:55.819420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-46d72a3f-aad8-4838-b64c-166976347a26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:05:55.819420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:55.819420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:55.819420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:55.819420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:55.819420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:55.819420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:55.819420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:55.819420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:55.819420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:55.819420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:55.819420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:55.819420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:05:55.819420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:05:55.819420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:55.820264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:55.821114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:05:55.821114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:05:55.821114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:05:55.821114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:05:55.821114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:05:55.821114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:05:55.821114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:05:55.821114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:55.821114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 263/527] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:05:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:55.821572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d72a3f-aad8-4838-b64c-166976347a26 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:55.841038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:55.885752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0894430-2cab-41b3-877d-231ceadf170c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:55.926639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d446892-abb0-4d68-8753-4c92b74c4148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:55.927279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d446892-abb0-4d68-8753-4c92b74c4148 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:55.927665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d446892-abb0-4d68-8753-4c92b74c4148 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:55.927832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d446892-abb0-4d68-8753-4c92b74c4148 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:55.928558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d446892-abb0-4d68-8753-4c92b74c4148 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:55.929008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d446892-abb0-4d68-8753-4c92b74c4148 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:55.930330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d446892-abb0-4d68-8753-4c92b74c4148 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:55.937486 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d72a3f-aad8-4838-b64c-166976347a26 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:55.950194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 265/528] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 13 01:05:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:55.950194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d446892-abb0-4d68-8753-4c92b74c4148 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:55.980081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb47e79-eec8-4a78-b3b2-2a67239f2cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:55.980789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb47e79-eec8-4a78-b3b2-2a67239f2cea None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:55.981064 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb47e79-eec8-4a78-b3b2-2a67239f2cea None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:55.981340 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb47e79-eec8-4a78-b3b2-2a67239f2cea None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:55.981981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb47e79-eec8-4a78-b3b2-2a67239f2cea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:55.982285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb47e79-eec8-4a78-b3b2-2a67239f2cea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:55.983688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb47e79-eec8-4a78-b3b2-2a67239f2cea None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:56.002479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 264/529] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:56.002479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb47e79-eec8-4a78-b3b2-2a67239f2cea None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:56.047399 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:56.068623 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d446892-abb0-4d68-8753-4c92b74c4148 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:56.087459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:56.105058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5c2ce-acc3-4c16-a276-ec988c99fd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:56.105672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c2ce-acc3-4c16-a276-ec988c99fd26 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:56.105952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c2ce-acc3-4c16-a276-ec988c99fd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:56.106227 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c2ce-acc3-4c16-a276-ec988c99fd26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:56.106945 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5c2ce-acc3-4c16-a276-ec988c99fd26 None admin] RBAC: Adding query filter params (role.id=e55e17c894314bc6a5772b2de35b4874, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=fadc83bec6be41979e1aa4d71f8fc2bd) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:56.107296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5c2ce-acc3-4c16-a276-ec988c99fd26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:56.108775 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5c2ce-acc3-4c16-a276-ec988c99fd26 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:56.112468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb47e79-eec8-4a78-b3b2-2a67239f2cea None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:56.114300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 266/530] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:55 2022] GET /identity/v3/role_assignments?user.id=fadc83bec6be41979e1aa4d71f8fc2bd&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=e55e17c894314bc6a5772b2de35b4874 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:56.115295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5c2ce-acc3-4c16-a276-ec988c99fd26 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:56.163830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49559690-be9a-4218-bab3-9e70c54792b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:56.164685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559690-be9a-4218-bab3-9e70c54792b5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:56.165057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559690-be9a-4218-bab3-9e70c54792b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:56.165479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559690-be9a-4218-bab3-9e70c54792b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:56.166309 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49559690-be9a-4218-bab3-9e70c54792b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:56.166749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49559690-be9a-4218-bab3-9e70c54792b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:56.168341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49559690-be9a-4218-bab3-9e70c54792b5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:56.188811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 265/531] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:05:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:56.189897 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49559690-be9a-4218-bab3-9e70c54792b5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:56.243821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5c2ce-acc3-4c16-a276-ec988c99fd26 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:56.284186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97ba3-fa45-4461-9645-2051d3d7b995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:56.285165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97ba3-fa45-4461-9645-2051d3d7b995 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:56.285752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97ba3-fa45-4461-9645-2051d3d7b995 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:56.286356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97ba3-fa45-4461-9645-2051d3d7b995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:56.315402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:56.323202 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49559690-be9a-4218-bab3-9e70c54792b5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:56.360645 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ce0ea-8f1b-412a-acd3-67a3b897cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:56.361276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ce0ea-8f1b-412a-acd3-67a3b897cc95 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:56.361555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ce0ea-8f1b-412a-acd3-67a3b897cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:56.361827 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ce0ea-8f1b-412a-acd3-67a3b897cc95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:56.366428 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:56.371536 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ce0ea-8f1b-412a-acd3-67a3b897cc95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:56.373616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ce0ea-8f1b-412a-acd3-67a3b897cc95 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:56.385784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-a11ce0ea-8f1b-412a-acd3-67a3b897cc95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:05:56.385784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:56.385784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:56.385784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:56.385784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:56.385784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:56.385784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:56.385784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:56.385784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:56.385784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:56.385784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:56.385784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:56.385784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:05:56.385784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:05:56.385784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:56.386900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:56.388024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:05:56.388024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:05:56.388024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:05:56.388024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:05:56.388024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:05:56.388024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:05:56.388024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:05:56.388024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:56.391116 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 266/532] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:05:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:56.391116 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ce0ea-8f1b-412a-acd3-67a3b897cc95 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:56.395766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d97ba3-fa45-4461-9645-2051d3d7b995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:56.397542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d97ba3-fa45-4461-9645-2051d3d7b995 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:56.521663 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 267/533] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:56.523162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97ba3-fa45-4461-9645-2051d3d7b995 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:56.547429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ce0ea-8f1b-412a-acd3-67a3b897cc95 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:56.577885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:56.600857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3dfa5-28aa-4e27-b0d7-cea936055881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:56.602082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3dfa5-28aa-4e27-b0d7-cea936055881 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:56.602588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3dfa5-28aa-4e27-b0d7-cea936055881 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:56.603355 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3dfa5-28aa-4e27-b0d7-cea936055881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:56.605176 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3dfa5-28aa-4e27-b0d7-cea936055881 None admin] RBAC: Adding query filter params (role.id=e55e17c894314bc6a5772b2de35b4874, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=50c78d95e6774755b11508fc1954ad5e) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:56.605695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3dfa5-28aa-4e27-b0d7-cea936055881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:56.607353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3dfa5-28aa-4e27-b0d7-cea936055881 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:56.615361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 267/534] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:56 2022] GET /identity/v3/role_assignments?user.id=50c78d95e6774755b11508fc1954ad5e&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=e55e17c894314bc6a5772b2de35b4874 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:56.616731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3dfa5-28aa-4e27-b0d7-cea936055881 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:56.670027 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97ba3-fa45-4461-9645-2051d3d7b995 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:56.710742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b932756-3837-432e-a6d9-f7d00bd301a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:56.711750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b932756-3837-432e-a6d9-f7d00bd301a0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:56.712257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b932756-3837-432e-a6d9-f7d00bd301a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:56.712790 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b932756-3837-432e-a6d9-f7d00bd301a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:56.713700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b932756-3837-432e-a6d9-f7d00bd301a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:56.714221 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b932756-3837-432e-a6d9-f7d00bd301a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:56.715984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b932756-3837-432e-a6d9-f7d00bd301a0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:56.729263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 268/535] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:05:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:56.735327 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b932756-3837-432e-a6d9-f7d00bd301a0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:56.741873 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:56.830759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3dfa5-28aa-4e27-b0d7-cea936055881 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:56.855216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b932756-3837-432e-a6d9-f7d00bd301a0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:56.869516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:56.905018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50503e7-48c9-4968-b107-a019bb05ba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:56.905657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50503e7-48c9-4968-b107-a019bb05ba22 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:56.905931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50503e7-48c9-4968-b107-a019bb05ba22 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:56.906199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50503e7-48c9-4968-b107-a019bb05ba22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:56.922550 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45058e35-c567-4bb8-9856-186e6359dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:56.923104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45058e35-c567-4bb8-9856-186e6359dbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:56.923380 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45058e35-c567-4bb8-9856-186e6359dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:56.923645 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45058e35-c567-4bb8-9856-186e6359dbd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:56.924368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45058e35-c567-4bb8-9856-186e6359dbd6 None admin] RBAC: Adding query filter params (role.id=e55e17c894314bc6a5772b2de35b4874, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=ff33b1a82c4c42f6ab4a0588d5b616db) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:56.924737 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45058e35-c567-4bb8-9856-186e6359dbd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:56.926629 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45058e35-c567-4bb8-9856-186e6359dbd6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:56.930681 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50503e7-48c9-4968-b107-a019bb05ba22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:56.932299 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50503e7-48c9-4968-b107-a019bb05ba22 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:56.944066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 269/536] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:56 2022] GET /identity/v3/role_assignments?user.id=ff33b1a82c4c42f6ab4a0588d5b616db&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=e55e17c894314bc6a5772b2de35b4874 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c50503e7-48c9-4968-b107-a019bb05ba22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:05:56.952593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:56.953753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:05:56.954890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:05:56.954890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:56.954890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:56.964834 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 268/537] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:56.970770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45058e35-c567-4bb8-9856-186e6359dbd6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:57.128857 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45058e35-c567-4bb8-9856-186e6359dbd6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:57.177500 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8417456-7f56-44c0-8dbb-6f04e4d949d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:57.178040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8417456-7f56-44c0-8dbb-6f04e4d949d1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:57.178318 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8417456-7f56-44c0-8dbb-6f04e4d949d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:57.178588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8417456-7f56-44c0-8dbb-6f04e4d949d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:57.179264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8417456-7f56-44c0-8dbb-6f04e4d949d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:57.179630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8417456-7f56-44c0-8dbb-6f04e4d949d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:57.181060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8417456-7f56-44c0-8dbb-6f04e4d949d1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:57.193710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 270/538] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:57.199272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50503e7-48c9-4968-b107-a019bb05ba22 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:57.359660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50503e7-48c9-4968-b107-a019bb05ba22 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:57.379085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:57.408712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfb6af-31c1-4f33-848f-5a3a9b0083ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:57.409341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfb6af-31c1-4f33-848f-5a3a9b0083ef None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:57.409621 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfb6af-31c1-4f33-848f-5a3a9b0083ef None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:57.409892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfb6af-31c1-4f33-848f-5a3a9b0083ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:57.424215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfb6af-31c1-4f33-848f-5a3a9b0083ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:57.425667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfb6af-31c1-4f33-848f-5a3a9b0083ef None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:57.442842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-1abfb6af-31c1-4f33-848f-5a3a9b0083ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:05:57.442842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:57.442842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:57.442842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:57.442842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:57.442842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:57.442842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:57.442842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:57.442842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:57.442842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:57.442842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:57.442842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:57.442842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:05:57.442842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:05:57.442842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:57.443767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:57.444612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:05:57.444612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:05:57.444612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:05:57.444612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:05:57.444612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:05:57.444612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:05:57.444612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:05:57.444612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:57.444612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 269/539] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:05:57.449551 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8417456-7f56-44c0-8dbb-6f04e4d949d1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:57.541863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:57.589991 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc61793-9023-4962-b9eb-bda84f11b080 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:57.590642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc61793-9023-4962-b9eb-bda84f11b080 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:57.590642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc61793-9023-4962-b9eb-bda84f11b080 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:57.593248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 270/540] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:57.597306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a0c2e-3732-4208-89f3-215dabd936da None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:57.597584 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a0c2e-3732-4208-89f3-215dabd936da None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:57.598511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a0c2e-3732-4208-89f3-215dabd936da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:57.619923 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-922a0c2e-3732-4208-89f3-215dabd936da None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:57.621199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-922a0c2e-3732-4208-89f3-215dabd936da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:57.658836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8417456-7f56-44c0-8dbb-6f04e4d949d1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:57.722565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 271/541] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:05:57.733098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02d800-1b1b-46f1-8ae7-ffcbbad009be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:57.733710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02d800-1b1b-46f1-8ae7-ffcbbad009be None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:57.733985 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02d800-1b1b-46f1-8ae7-ffcbbad009be None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:57.734305 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02d800-1b1b-46f1-8ae7-ffcbbad009be None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:57.734999 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02d800-1b1b-46f1-8ae7-ffcbbad009be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:57.735331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02d800-1b1b-46f1-8ae7-ffcbbad009be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:57.736878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02d800-1b1b-46f1-8ae7-ffcbbad009be None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:57.753863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 271/542] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:57.759861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a0c2e-3732-4208-89f3-215dabd936da None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:57.890405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a0c2e-3732-4208-89f3-215dabd936da None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:57.896765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:57.938998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c17aa6-7628-47e3-813c-865d53d596a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:57.939629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c17aa6-7628-47e3-813c-865d53d596a6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:57.940078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c17aa6-7628-47e3-813c-865d53d596a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:57.940360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c17aa6-7628-47e3-813c-865d53d596a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:57.941100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c17aa6-7628-47e3-813c-865d53d596a6 None admin] RBAC: Adding query filter params (role.id=e55e17c894314bc6a5772b2de35b4874, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=a672e63fa5e345679bac3d67301fe875) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:57.941456 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c17aa6-7628-47e3-813c-865d53d596a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:57.943188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c17aa6-7628-47e3-813c-865d53d596a6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:57.953303 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 272/543] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:05:57 2022] GET /identity/v3/role_assignments?user.id=a672e63fa5e345679bac3d67301fe875&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=e55e17c894314bc6a5772b2de35b4874 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:05:58.106841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02d800-1b1b-46f1-8ae7-ffcbbad009be None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:58.216900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:58.227755 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02d800-1b1b-46f1-8ae7-ffcbbad009be None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:58.265350 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cfefa-0496-41fb-b55e-0b75792cbfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:58.265997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cfefa-0496-41fb-b55e-0b75792cbfe4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:58.266342 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cfefa-0496-41fb-b55e-0b75792cbfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:58.266615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cfefa-0496-41fb-b55e-0b75792cbfe4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:58.283594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cfefa-0496-41fb-b55e-0b75792cbfe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-137cfefa-0496-41fb-b55e-0b75792cbfe4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:58.290143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:58.292356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:58.293704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:58.293704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:58.293704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:58.293704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:58.293704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:58.293704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:58.293704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:58.293704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:58.293704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:58.293704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:58.293704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:05:58.293704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:58.296501 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 272/544] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:05:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:58.300298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c17aa6-7628-47e3-813c-865d53d596a6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:58.452635 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c17aa6-7628-47e3-813c-865d53d596a6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:58.503765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a02065-3ff3-4d42-941a-3ad42c48d045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:58.504930 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a02065-3ff3-4d42-941a-3ad42c48d045 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:58.505208 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a02065-3ff3-4d42-941a-3ad42c48d045 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:58.505480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a02065-3ff3-4d42-941a-3ad42c48d045 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:58.506157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a02065-3ff3-4d42-941a-3ad42c48d045 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:58.506462 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a02065-3ff3-4d42-941a-3ad42c48d045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:58.507853 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a02065-3ff3-4d42-941a-3ad42c48d045 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:58.522797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 273/545] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:05:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:58.528299 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cfefa-0496-41fb-b55e-0b75792cbfe4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:58.651045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cfefa-0496-41fb-b55e-0b75792cbfe4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:58.702198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c0cc0-a60b-4b1e-8870-e70f4c7e483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:58.702796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c0cc0-a60b-4b1e-8870-e70f4c7e483a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:58.703108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c0cc0-a60b-4b1e-8870-e70f4c7e483a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:58.703292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c0cc0-a60b-4b1e-8870-e70f4c7e483a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:58.719297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c0cc0-a60b-4b1e-8870-e70f4c7e483a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:58.720829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c0cc0-a60b-4b1e-8870-e70f4c7e483a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-2e6c0cc0-a60b-4b1e-8870-e70f4c7e483a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:05:58.735792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:58.736717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:05:58.737555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:05:58.737555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:05:58.737555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:58.737555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 273/546] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:58.752249 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a02065-3ff3-4d42-941a-3ad42c48d045 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:58.812038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:58.906921 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a02065-3ff3-4d42-941a-3ad42c48d045 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:58.948337 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e53316-759e-4b78-a4c0-64529c6e7156 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:58.948980 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e53316-759e-4b78-a4c0-64529c6e7156 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:58.949480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e53316-759e-4b78-a4c0-64529c6e7156 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:58.951571 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 274/547] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:58.957171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d6ec3-fdb0-4673-81ac-f4e08b2b1bc2 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:58.957697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d6ec3-fdb0-4673-81ac-f4e08b2b1bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:58.958074 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33117a72-f366-466b-8e41-9230821ffe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:58.958577 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d6ec3-fdb0-4673-81ac-f4e08b2b1bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:58.958683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33117a72-f366-466b-8e41-9230821ffe7b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:58.958925 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33117a72-f366-466b-8e41-9230821ffe7b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:58.959164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33117a72-f366-466b-8e41-9230821ffe7b None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:58.959819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33117a72-f366-466b-8e41-9230821ffe7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:58.960116 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33117a72-f366-466b-8e41-9230821ffe7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:58.961456 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33117a72-f366-466b-8e41-9230821ffe7b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:58.967763 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:58.979731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 274/548] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:58.984848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33117a72-f366-466b-8e41-9230821ffe7b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:58.994033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-622d6ec3-fdb0-4673-81ac-f4e08b2b1bc2 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:58.999660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-622d6ec3-fdb0-4673-81ac-f4e08b2b1bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:59.144697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 275/549] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:05:59.147992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6c026-fd5e-4caf-94b4-fa0e0acc4d30 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:59.148287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6c026-fd5e-4caf-94b4-fa0e0acc4d30 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:59.148572 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6c026-fd5e-4caf-94b4-fa0e0acc4d30 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:59.150089 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 276/550] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:05:59.154902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938aa16-0e5d-4fa6-8133-0b0482543656 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:59.155212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938aa16-0e5d-4fa6-8133-0b0482543656 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:59.155485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938aa16-0e5d-4fa6-8133-0b0482543656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:59.156429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:59.170891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33117a72-f366-466b-8e41-9230821ffe7b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:59.177997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3938aa16-0e5d-4fa6-8133-0b0482543656 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:05:59.179283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3938aa16-0e5d-4fa6-8133-0b0482543656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:05:59.236750 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fcabe-c39e-468f-ac36-21cd44c6b36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:59.237723 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fcabe-c39e-468f-ac36-21cd44c6b36b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:59.239683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fcabe-c39e-468f-ac36-21cd44c6b36b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:59.240158 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fcabe-c39e-468f-ac36-21cd44c6b36b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:59.255439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fcabe-c39e-468f-ac36-21cd44c6b36b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:59.259655 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fcabe-c39e-468f-ac36-21cd44c6b36b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-4c4fcabe-c39e-468f-ac36-21cd44c6b36b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:05:59.282616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:59.283782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:59.284684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:59.284684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:59.284684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:05:59.284684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:05:59.284684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:05:59.284684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:05:59.284684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:05:59.284684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:05:59.284684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 01:05:59.284684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:05:59.288298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 275/551] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:05:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:05:59.294759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fcabe-c39e-468f-ac36-21cd44c6b36b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:59.319086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 277/552] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:05:59.424227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fcabe-c39e-468f-ac36-21cd44c6b36b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:59.458870 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1b34a-1e94-4752-b0cd-f50833d3d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:59.459515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1b34a-1e94-4752-b0cd-f50833d3d967 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:59.459801 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1b34a-1e94-4752-b0cd-f50833d3d967 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:59.460076 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1b34a-1e94-4752-b0cd-f50833d3d967 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:59.460809 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1b34a-1e94-4752-b0cd-f50833d3d967 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:05:59.461120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1b34a-1e94-4752-b0cd-f50833d3d967 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:59.462565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1b34a-1e94-4752-b0cd-f50833d3d967 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:59.474223 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938aa16-0e5d-4fa6-8133-0b0482543656 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:59.481227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 276/553] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Sep 13 01:05:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:05:59.488068 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1b34a-1e94-4752-b0cd-f50833d3d967 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:59.499788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:59.605329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:59.681653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1b34a-1e94-4752-b0cd-f50833d3d967 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:59.685060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938aa16-0e5d-4fa6-8133-0b0482543656 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:59.729258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527a199-842b-4c16-85b3-420e6560a2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:59.729489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1688679-d22c-4ae3-9059-9edd3b2ef702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:59.729997 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527a199-842b-4c16-85b3-420e6560a2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:59.730078 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1688679-d22c-4ae3-9059-9edd3b2ef702 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:59.730161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527a199-842b-4c16-85b3-420e6560a2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:59.730312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1688679-d22c-4ae3-9059-9edd3b2ef702 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:59.730392 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527a199-842b-4c16-85b3-420e6560a2c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:59.730676 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1688679-d22c-4ae3-9059-9edd3b2ef702 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:59.742890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1688679-d22c-4ae3-9059-9edd3b2ef702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-c1688679-d22c-4ae3-9059-9edd3b2ef702 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:59.748114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:59.749019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:59.749828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:59.749828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:59.749828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:59.749828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:59.749828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:59.749828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:59.749828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:59.749828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:59.749828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:59.749828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:59.749828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:05:59.749828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:59.749828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 278/554] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:05:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:59.750522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1688679-d22c-4ae3-9059-9edd3b2ef702 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:59.800444 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527a199-842b-4c16-85b3-420e6560a2c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:05:59.802604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527a199-842b-4c16-85b3-420e6560a2c3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:05:59.811207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:59.862103 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1688679-d22c-4ae3-9059-9edd3b2ef702 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:05:59.887254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:05:59.901818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25c4c1-9b7e-4056-846e-ce92b7380965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:05:59.902531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25c4c1-9b7e-4056-846e-ce92b7380965 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:59.902819 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25c4c1-9b7e-4056-846e-ce92b7380965 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:59.903110 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25c4c1-9b7e-4056-846e-ce92b7380965 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:59.909579 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 277/555] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:05:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:05:59.911332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527a199-842b-4c16-85b3-420e6560a2c3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:05:59.918465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25c4c1-9b7e-4056-846e-ce92b7380965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-fb25c4c1-9b7e-4056-846e-ce92b7380965 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:05:59.923648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:05:59.924562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:05:59.925371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:05:59.925371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:05:59.925371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:05:59.925371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:05:59.925371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:05:59.925371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:05:59.925371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:05:59.925371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:05:59.925371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:05:59.925371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:05:59.925371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:05:59.925371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:05:59.933364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 279/556] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:05:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:05:59.933364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9fa1b-b5f1-4f1b-8bf3-9af7e6bc6e93 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:05:59.933364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9fa1b-b5f1-4f1b-8bf3-9af7e6bc6e93 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:05:59.933364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9fa1b-b5f1-4f1b-8bf3-9af7e6bc6e93 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:05:59.933364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 280/557] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:05:59.934149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9fa1b-b5f1-4f1b-8bf3-9af7e6bc6e93 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:00.023809 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527a199-842b-4c16-85b3-420e6560a2c3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:00.032088 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:00.047382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9fa1b-b5f1-4f1b-8bf3-9af7e6bc6e93 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:00.060706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add98e42-1c59-4c2b-82de-a13e2ba068ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:00.061253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add98e42-1c59-4c2b-82de-a13e2ba068ac None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:00.061537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add98e42-1c59-4c2b-82de-a13e2ba068ac None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:00.061816 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add98e42-1c59-4c2b-82de-a13e2ba068ac None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:00.062595 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add98e42-1c59-4c2b-82de-a13e2ba068ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:00.063027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add98e42-1c59-4c2b-82de-a13e2ba068ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:00.064411 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add98e42-1c59-4c2b-82de-a13e2ba068ac None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:00.078560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 278/558] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:05:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:00.078560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add98e42-1c59-4c2b-82de-a13e2ba068ac None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:00.085659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7cda6-a4ab-42d4-b302-e76b2259b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:00.086294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7cda6-a4ab-42d4-b302-e76b2259b7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:00.086635 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7cda6-a4ab-42d4-b302-e76b2259b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:00.086911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7cda6-a4ab-42d4-b302-e76b2259b7b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:00.097020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7cda6-a4ab-42d4-b302-e76b2259b7b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:00.098645 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7cda6-a4ab-42d4-b302-e76b2259b7b5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-d8d7cda6-a4ab-42d4-b302-e76b2259b7b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:00.114288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:00.115460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:00.116351 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:00.116351 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:00.116351 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:00.116351 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 281/559] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:00.117715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e128f-afed-42e0-9d30-b52965e92dc7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:00.118185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e128f-afed-42e0-9d30-b52965e92dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:00.118663 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e128f-afed-42e0-9d30-b52965e92dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:00.137405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-558e128f-afed-42e0-9d30-b52965e92dc7 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:00.138601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-558e128f-afed-42e0-9d30-b52965e92dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:00.168809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:00.191885 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add98e42-1c59-4c2b-82de-a13e2ba068ac None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:00.209453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 282/560] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:06:00.219951 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e128f-afed-42e0-9d30-b52965e92dc7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:00.230044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a31e3a-1aac-4e54-b3cd-90886969adaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:00.230659 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a31e3a-1aac-4e54-b3cd-90886969adaa None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:00.230942 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a31e3a-1aac-4e54-b3cd-90886969adaa None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:00.231271 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a31e3a-1aac-4e54-b3cd-90886969adaa None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:00.231947 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a31e3a-1aac-4e54-b3cd-90886969adaa None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:00.232256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a31e3a-1aac-4e54-b3cd-90886969adaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:00.233629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a31e3a-1aac-4e54-b3cd-90886969adaa None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:00.246779 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 279/561] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:06:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:00.247799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a31e3a-1aac-4e54-b3cd-90886969adaa None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:00.279816 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:00.344204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e128f-afed-42e0-9d30-b52965e92dc7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:00.374470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a31e3a-1aac-4e54-b3cd-90886969adaa None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:00.382754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e40b0-7b8a-4e45-b182-a5726cffc097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:00.383525 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e40b0-7b8a-4e45-b182-a5726cffc097 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:00.383910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e40b0-7b8a-4e45-b182-a5726cffc097 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:00.384247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e40b0-7b8a-4e45-b182-a5726cffc097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:00.395443 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e40b0-7b8a-4e45-b182-a5726cffc097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:00.397131 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e40b0-7b8a-4e45-b182-a5726cffc097 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-f00e40b0-7b8a-4e45-b182-a5726cffc097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:00.413042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:00.413998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:00.414879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:00.414879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:00.414879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:00.414879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 283/562] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:00.415132 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e40b0-7b8a-4e45-b182-a5726cffc097 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:00.429817 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92189a-627a-4c24-a7b3-b8942c1b310d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:00.430933 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92189a-627a-4c24-a7b3-b8942c1b310d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:00.431444 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92189a-627a-4c24-a7b3-b8942c1b310d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:00.432154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92189a-627a-4c24-a7b3-b8942c1b310d None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:00.433450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92189a-627a-4c24-a7b3-b8942c1b310d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:00.433905 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92189a-627a-4c24-a7b3-b8942c1b310d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:00.436081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92189a-627a-4c24-a7b3-b8942c1b310d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:00.437228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:00.456010 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 280/563] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:00.457354 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92189a-627a-4c24-a7b3-b8942c1b310d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:00.530583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e40b0-7b8a-4e45-b182-a5726cffc097 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:00.567215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b3241-b468-46d3-9387-404b8a6e6410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:00.567647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:00.568557 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b3241-b468-46d3-9387-404b8a6e6410 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:00.569076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b3241-b468-46d3-9387-404b8a6e6410 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:00.569076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b3241-b468-46d3-9387-404b8a6e6410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:00.578073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92189a-627a-4c24-a7b3-b8942c1b310d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:00.580644 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b3241-b468-46d3-9387-404b8a6e6410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:00.582120 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b3241-b468-46d3-9387-404b8a6e6410 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-009b3241-b468-46d3-9387-404b8a6e6410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:00.596325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:00.597293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:00.598739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:00.598739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:00.598739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:00.598739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 284/564] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:00.599320 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b3241-b468-46d3-9387-404b8a6e6410 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:00.618776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf468396-0f2c-4628-b17f-a51f00fc4270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:00.619413 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf468396-0f2c-4628-b17f-a51f00fc4270 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:00.619694 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf468396-0f2c-4628-b17f-a51f00fc4270 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:00.619960 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf468396-0f2c-4628-b17f-a51f00fc4270 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:00.620603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf468396-0f2c-4628-b17f-a51f00fc4270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:00.620901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf468396-0f2c-4628-b17f-a51f00fc4270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:00.622252 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf468396-0f2c-4628-b17f-a51f00fc4270 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:00.635058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 281/565] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:00.636081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf468396-0f2c-4628-b17f-a51f00fc4270 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:00.673040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:00.705782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b3241-b468-46d3-9387-404b8a6e6410 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:00.735887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf468396-0f2c-4628-b17f-a51f00fc4270 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:00.738245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a54b4-db85-46b6-9902-650db45300ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:00.738926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a54b4-db85-46b6-9902-650db45300ff None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:00.739238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a54b4-db85-46b6-9902-650db45300ff None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:00.739515 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a54b4-db85-46b6-9902-650db45300ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:00.746028 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a54b4-db85-46b6-9902-650db45300ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:00.747527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a54b4-db85-46b6-9902-650db45300ff None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:00.758984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-5b1a54b4-db85-46b6-9902-650db45300ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:00.758984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:00.758984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:00.758984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:00.758984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:00.758984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:00.758984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:00.758984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:00.758984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:00.758984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:00.758984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:00.758984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:00.758984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:00.758984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:00.758984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:00.760011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:00.760907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:00.760907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:00.760907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:00.760907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:00.760907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:00.760907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:00.760907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:00.760907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:00.764855 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 285/566] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:00.765947 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba587c6-34aa-49fc-ab53-548eb7316e0a None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:00.766234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba587c6-34aa-49fc-ab53-548eb7316e0a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:00.766507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba587c6-34aa-49fc-ab53-548eb7316e0a None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:00.767770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 286/567] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:00.768461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba587c6-34aa-49fc-ab53-548eb7316e0a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:00.770403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbdad4-a9a9-4800-aa65-c164f19eba9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:00.771257 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbdad4-a9a9-4800-aa65-c164f19eba9f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:00.771673 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbdad4-a9a9-4800-aa65-c164f19eba9f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:00.772101 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbdad4-a9a9-4800-aa65-c164f19eba9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:00.782579 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbdad4-a9a9-4800-aa65-c164f19eba9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-2bcbdad4-a9a9-4800-aa65-c164f19eba9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:00.788664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:00.789661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:00.790514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:00.790514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:00.790514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:00.790514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:00.790514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:00.790514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:00.790514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:00.790514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:00.790514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:00.790514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:00.790514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:00.790514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:00.790514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 282/568] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:06:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:00.790514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbdad4-a9a9-4800-aa65-c164f19eba9f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:00.803921 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:00.872375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba587c6-34aa-49fc-ab53-548eb7316e0a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:00.889166 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbdad4-a9a9-4800-aa65-c164f19eba9f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:00.900896 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:00.907007 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c861b38-9567-41dc-9b36-86df22fbca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:00.907630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c861b38-9567-41dc-9b36-86df22fbca7e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:00.907911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c861b38-9567-41dc-9b36-86df22fbca7e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:00.908183 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c861b38-9567-41dc-9b36-86df22fbca7e None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:00.908829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c861b38-9567-41dc-9b36-86df22fbca7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:00.909129 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c861b38-9567-41dc-9b36-86df22fbca7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:00.910720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c861b38-9567-41dc-9b36-86df22fbca7e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:00.922203 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 287/569] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:00.922391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f40af-c7e6-49de-9f49-b4334e918acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:00.922965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f40af-c7e6-49de-9f49-b4334e918acf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:00.923290 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f40af-c7e6-49de-9f49-b4334e918acf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:00.923455 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c861b38-9567-41dc-9b36-86df22fbca7e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:00.923580 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f40af-c7e6-49de-9f49-b4334e918acf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:00.933160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f40af-c7e6-49de-9f49-b4334e918acf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:00.934602 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f40af-c7e6-49de-9f49-b4334e918acf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-ac7f40af-c7e6-49de-9f49-b4334e918acf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:00.946217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:00.947390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:00.948371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:00.948371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:00.948371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:00.948371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:00.948371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:00.948371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:00.948371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:00.948371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:00.948371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:06:00.948371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:00.948371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 283/570] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 13 01:06:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:00.948976 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c1bba-9ae8-4584-a9a8-d3bfa4d90c33 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:00.949095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c1bba-9ae8-4584-a9a8-d3bfa4d90c33 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:00.949372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c1bba-9ae8-4584-a9a8-d3bfa4d90c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:00.966902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ab1c1bba-9ae8-4584-a9a8-d3bfa4d90c33 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:00.968112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ab1c1bba-9ae8-4584-a9a8-d3bfa4d90c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:01.028586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c861b38-9567-41dc-9b36-86df22fbca7e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:01.030489 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:01.036161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 284/571] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:06:01.036907 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c1bba-9ae8-4584-a9a8-d3bfa4d90c33 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:01.063234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d3917-cf84-4838-a792-b80ef6c194b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:01.063842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d3917-cf84-4838-a792-b80ef6c194b8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:01.064121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d3917-cf84-4838-a792-b80ef6c194b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:01.064393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d3917-cf84-4838-a792-b80ef6c194b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:01.065077 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d3917-cf84-4838-a792-b80ef6c194b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:01.065534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d3917-cf84-4838-a792-b80ef6c194b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:01.067555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d3917-cf84-4838-a792-b80ef6c194b8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:01.086162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 288/572] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:01.089108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d3917-cf84-4838-a792-b80ef6c194b8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:01.142639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:01.147547 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c1bba-9ae8-4584-a9a8-d3bfa4d90c33 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:01.183964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de31ba2-23e4-4df9-b28b-4a882bffdcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:01.184987 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de31ba2-23e4-4df9-b28b-4a882bffdcdb None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:01.185261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de31ba2-23e4-4df9-b28b-4a882bffdcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:01.185535 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de31ba2-23e4-4df9-b28b-4a882bffdcdb None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:01.186204 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de31ba2-23e4-4df9-b28b-4a882bffdcdb None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:01.186510 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de31ba2-23e4-4df9-b28b-4a882bffdcdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:01.188589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de31ba2-23e4-4df9-b28b-4a882bffdcdb None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:01.197108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d3917-cf84-4838-a792-b80ef6c194b8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:01.202946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 285/573] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:06:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:01.203636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de31ba2-23e4-4df9-b28b-4a882bffdcdb None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:01.234410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd7f55-202f-4731-93eb-e7ed30708e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:01.235039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd7f55-202f-4731-93eb-e7ed30708e34 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:01.235350 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd7f55-202f-4731-93eb-e7ed30708e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:01.235619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd7f55-202f-4731-93eb-e7ed30708e34 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:01.243048 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd7f55-202f-4731-93eb-e7ed30708e34 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:01.244511 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd7f55-202f-4731-93eb-e7ed30708e34 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-14fd7f55-202f-4731-93eb-e7ed30708e34 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:01.256266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:01.257274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:01.258243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:01.258243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:01.258243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:01.258243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:01.258243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:01.258243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:01.258243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:01.258243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:01.258243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 01:06:01.258243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:01.258243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 289/574] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:06:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:01.258243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd7f55-202f-4731-93eb-e7ed30708e34 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:01.271336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:01.314720 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de31ba2-23e4-4df9-b28b-4a882bffdcdb None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:01.350297 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883accf9-fcbd-4dea-877d-85cc54be20fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:01.350888 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883accf9-fcbd-4dea-877d-85cc54be20fb None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:01.351195 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883accf9-fcbd-4dea-877d-85cc54be20fb None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:01.351466 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883accf9-fcbd-4dea-877d-85cc54be20fb None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:01.352179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883accf9-fcbd-4dea-877d-85cc54be20fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:01.352480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883accf9-fcbd-4dea-877d-85cc54be20fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:01.353894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883accf9-fcbd-4dea-877d-85cc54be20fb None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:01.360809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd7f55-202f-4731-93eb-e7ed30708e34 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:01.370502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 286/575] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 13 01:06:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:01.371164 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:01.371338 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883accf9-fcbd-4dea-877d-85cc54be20fb None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:01.401509 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46f881-f206-49cd-8c9b-ee818732a58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:01.402184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46f881-f206-49cd-8c9b-ee818732a58f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:01.402440 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46f881-f206-49cd-8c9b-ee818732a58f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:01.402772 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46f881-f206-49cd-8c9b-ee818732a58f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:01.403580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46f881-f206-49cd-8c9b-ee818732a58f None admin] RBAC: Adding query filter params (role.id=e55e17c894314bc6a5772b2de35b4874, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=e2414e53593b4e2084c895651fd0d0e5) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:01.404254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46f881-f206-49cd-8c9b-ee818732a58f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:01.405808 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46f881-f206-49cd-8c9b-ee818732a58f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:01.411666 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 290/576] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:06:01 2022] GET /identity/v3/role_assignments?user.id=e2414e53593b4e2084c895651fd0d0e5&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=e55e17c894314bc6a5772b2de35b4874 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:01.412449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46f881-f206-49cd-8c9b-ee818732a58f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:01.493897 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883accf9-fcbd-4dea-877d-85cc54be20fb None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:01.517071 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:01.524084 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46f881-f206-49cd-8c9b-ee818732a58f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:01.536270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b539a38-788b-4337-869e-a629356c57e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:01.537373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b539a38-788b-4337-869e-a629356c57e4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:01.537717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b539a38-788b-4337-869e-a629356c57e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:01.538097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b539a38-788b-4337-869e-a629356c57e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:01.551744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b539a38-788b-4337-869e-a629356c57e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:01.554138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b539a38-788b-4337-869e-a629356c57e4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:01.561507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5441b74-da33-4c7d-b4c6-849fc4ecc7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:01.562132 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5441b74-da33-4c7d-b4c6-849fc4ecc7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:01.562409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5441b74-da33-4c7d-b4c6-849fc4ecc7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:01.562703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5441b74-da33-4c7d-b4c6-849fc4ecc7e1 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:01.563507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5441b74-da33-4c7d-b4c6-849fc4ecc7e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:01.563814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5441b74-da33-4c7d-b4c6-849fc4ecc7e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:01.565338 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5441b74-da33-4c7d-b4c6-849fc4ecc7e1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-3b539a38-788b-4337-869e-a629356c57e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:01.573744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:01.574798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:01.576112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:01.576112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:01.576112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:01.577804 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 287/577] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:01.578759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b539a38-788b-4337-869e-a629356c57e4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:01.586631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 291/578] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 13 01:06:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:01.587505 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5441b74-da33-4c7d-b4c6-849fc4ecc7e1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:01.621282 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:01.689667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b539a38-788b-4337-869e-a629356c57e4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:01.693686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5441b74-da33-4c7d-b4c6-849fc4ecc7e1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:01.725626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec81af2-a75f-405b-9af1-3eeff4b1c961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:01.726263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec81af2-a75f-405b-9af1-3eeff4b1c961 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:01.726545 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec81af2-a75f-405b-9af1-3eeff4b1c961 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:01.726820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec81af2-a75f-405b-9af1-3eeff4b1c961 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:01.729260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa20a6-88da-4396-adfb-e00e43cb917a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:01.729933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa20a6-88da-4396-adfb-e00e43cb917a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:01.730217 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa20a6-88da-4396-adfb-e00e43cb917a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:01.730489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa20a6-88da-4396-adfb-e00e43cb917a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:01.737376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec81af2-a75f-405b-9af1-3eeff4b1c961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:01.742052 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa20a6-88da-4396-adfb-e00e43cb917a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-6ec81af2-a75f-405b-9af1-3eeff4b1c961 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:01.743446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:01.744381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:01.745232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:01.745232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:01.745232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:01.745232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:01.745232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:01.745232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:01.745232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:01.745232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:01.745232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:01.745232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:01.745232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:01.745232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:01.745887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa20a6-88da-4396-adfb-e00e43cb917a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:01.745964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 288/579] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:06:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:01.745964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec81af2-a75f-405b-9af1-3eeff4b1c961 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-eefa20a6-88da-4396-adfb-e00e43cb917a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:01.766668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:01.767914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:01.768909 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:01.768909 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:01.768909 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:01.770142 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 292/580] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:01.770982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa20a6-88da-4396-adfb-e00e43cb917a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:01.784053 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:01.858846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:01.859911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec81af2-a75f-405b-9af1-3eeff4b1c961 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:01.878451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa20a6-88da-4396-adfb-e00e43cb917a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:01.902398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5257f0-f1dd-4c57-8a43-8edee2c6e3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:01.903556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5257f0-f1dd-4c57-8a43-8edee2c6e3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:01.904162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5257f0-f1dd-4c57-8a43-8edee2c6e3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:01.904515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5257f0-f1dd-4c57-8a43-8edee2c6e3e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:01.905392 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5257f0-f1dd-4c57-8a43-8edee2c6e3e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:01.905831 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5257f0-f1dd-4c57-8a43-8edee2c6e3e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:01.907797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5257f0-f1dd-4c57-8a43-8edee2c6e3e3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:01.913867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63896c8b-b449-4935-8aca-be2b172014c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:01.914599 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63896c8b-b449-4935-8aca-be2b172014c1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:01.914972 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63896c8b-b449-4935-8aca-be2b172014c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:01.915379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63896c8b-b449-4935-8aca-be2b172014c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:01.926333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 289/581] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:01.926333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5257f0-f1dd-4c57-8a43-8edee2c6e3e3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:01.927304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63896c8b-b449-4935-8aca-be2b172014c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:01.929024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63896c8b-b449-4935-8aca-be2b172014c1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-63896c8b-b449-4935-8aca-be2b172014c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:01.943962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:01.945151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:01.950926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:01.950926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:01.950926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:01.950926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 293/582] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:01.950926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63896c8b-b449-4935-8aca-be2b172014c1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:02.032588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:02.042590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5257f0-f1dd-4c57-8a43-8edee2c6e3e3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:02.055691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63896c8b-b449-4935-8aca-be2b172014c1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:02.077966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471af446-9f9d-4567-9028-3fd4d4700721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:02.078582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471af446-9f9d-4567-9028-3fd4d4700721 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:02.078863 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471af446-9f9d-4567-9028-3fd4d4700721 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:02.079170 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471af446-9f9d-4567-9028-3fd4d4700721 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:02.079840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471af446-9f9d-4567-9028-3fd4d4700721 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:02.080155 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471af446-9f9d-4567-9028-3fd4d4700721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:02.081508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471af446-9f9d-4567-9028-3fd4d4700721 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:02.090248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 290/583] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:06:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:02.091085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471af446-9f9d-4567-9028-3fd4d4700721 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:02.098557 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab755c5a-5675-43a1-9190-b48b37a31218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:02.099212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755c5a-5675-43a1-9190-b48b37a31218 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:02.099551 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755c5a-5675-43a1-9190-b48b37a31218 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:02.099828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755c5a-5675-43a1-9190-b48b37a31218 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:02.100477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab755c5a-5675-43a1-9190-b48b37a31218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:02.100830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab755c5a-5675-43a1-9190-b48b37a31218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:02.102241 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab755c5a-5675-43a1-9190-b48b37a31218 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:02.107411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:02.123470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 294/584] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:02.123470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab755c5a-5675-43a1-9190-b48b37a31218 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:02.207166 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471af446-9f9d-4567-9028-3fd4d4700721 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:02.232877 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab755c5a-5675-43a1-9190-b48b37a31218 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:02.241575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a5188-de0f-457b-84ca-51bfbc605416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:02.242204 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a5188-de0f-457b-84ca-51bfbc605416 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:02.242480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a5188-de0f-457b-84ca-51bfbc605416 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:02.242960 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a5188-de0f-457b-84ca-51bfbc605416 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:02.250198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a5188-de0f-457b-84ca-51bfbc605416 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:02.251660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a5188-de0f-457b-84ca-51bfbc605416 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-fa9a5188-de0f-457b-84ca-51bfbc605416 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:02.263843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:02.264850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:02.265798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:02.265798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:02.265798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:02.265798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:02.265798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:02.265798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:02.265798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:02.265798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:02.265798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 01:06:02.265798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:02.265798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 291/585] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:06:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:02.265798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a5188-de0f-457b-84ca-51bfbc605416 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:02.275107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b40bd-135f-4e3b-9da1-0a70dc8135c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:02.275712 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b40bd-135f-4e3b-9da1-0a70dc8135c4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:02.275988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b40bd-135f-4e3b-9da1-0a70dc8135c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:02.276260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b40bd-135f-4e3b-9da1-0a70dc8135c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:02.276910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b40bd-135f-4e3b-9da1-0a70dc8135c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:02.277213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b40bd-135f-4e3b-9da1-0a70dc8135c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:02.278597 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b40bd-135f-4e3b-9da1-0a70dc8135c4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:02.284000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:02.295775 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 295/586] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:02.295775 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b40bd-135f-4e3b-9da1-0a70dc8135c4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:02.354691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:02.385647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a5188-de0f-457b-84ca-51bfbc605416 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:02.402230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b40bd-135f-4e3b-9da1-0a70dc8135c4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:02.427531 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d34eec-c15e-43f9-90a0-0d1361320139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:02.428239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d34eec-c15e-43f9-90a0-0d1361320139 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:02.428585 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d34eec-c15e-43f9-90a0-0d1361320139 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:02.428927 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d34eec-c15e-43f9-90a0-0d1361320139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:02.437296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce728142-1d70-4654-91ab-550e3b8eb787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:02.438086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce728142-1d70-4654-91ab-550e3b8eb787 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:02.438366 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce728142-1d70-4654-91ab-550e3b8eb787 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:02.438693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce728142-1d70-4654-91ab-550e3b8eb787 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:02.439771 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d34eec-c15e-43f9-90a0-0d1361320139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:02.441308 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d34eec-c15e-43f9-90a0-0d1361320139 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:02.446227 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce728142-1d70-4654-91ab-550e3b8eb787 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:02.447915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce728142-1d70-4654-91ab-550e3b8eb787 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-88d34eec-c15e-43f9-90a0-0d1361320139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:02.455612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:02.456528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:02.463009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:02.463009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:02.463009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:02.463009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 292/587] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:02.463009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d34eec-c15e-43f9-90a0-0d1361320139 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:02.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-ce728142-1d70-4654-91ab-550e3b8eb787 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:02.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:02.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:02.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:02.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:02.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:02.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:02.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:02.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:02.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:02.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:02.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:02.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:02.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:02.463554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:02.464352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:02.465232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:02.465232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:02.465232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:02.465232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:02.465232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:02.465232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:02.465232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:02.465232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:02.465232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 296/588] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:02.465232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce728142-1d70-4654-91ab-550e3b8eb787 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:02.533350 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:02.574706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d34eec-c15e-43f9-90a0-0d1361320139 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:02.575807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce728142-1d70-4654-91ab-550e3b8eb787 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:02.593761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:02.613970 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdeea1f-7d76-49e3-9e76-aef7c6b7fd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:02.614622 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdeea1f-7d76-49e3-9e76-aef7c6b7fd03 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:02.614900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdeea1f-7d76-49e3-9e76-aef7c6b7fd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:02.615205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdeea1f-7d76-49e3-9e76-aef7c6b7fd03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:02.616766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595aa32-9746-48ed-8acd-b1b132f5b1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:02.617549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595aa32-9746-48ed-8acd-b1b132f5b1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:02.617987 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595aa32-9746-48ed-8acd-b1b132f5b1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:02.618260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595aa32-9746-48ed-8acd-b1b132f5b1c1 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:02.619006 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595aa32-9746-48ed-8acd-b1b132f5b1c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:02.619344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595aa32-9746-48ed-8acd-b1b132f5b1c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:02.620776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595aa32-9746-48ed-8acd-b1b132f5b1c1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:02.622574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdeea1f-7d76-49e3-9e76-aef7c6b7fd03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:02.624043 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdeea1f-7d76-49e3-9e76-aef7c6b7fd03 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:02.635960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-1cdeea1f-7d76-49e3-9e76-aef7c6b7fd03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:02.635960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:02.635960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:02.635960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:02.635960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:02.635960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:02.635960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:02.635960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:02.635960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:02.635960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:02.635960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:02.635960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:02.635960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:02.635960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:02.635960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:02.636849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:02.637782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:02.637782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:02.637782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:02.637782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:02.637782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:02.637782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:02.637782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:02.637782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:02.637782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 297/589] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:02.637782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdeea1f-7d76-49e3-9e76-aef7c6b7fd03 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:02.650220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 293/590] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 13 01:06:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:02.650220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595aa32-9746-48ed-8acd-b1b132f5b1c1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:02.752625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdeea1f-7d76-49e3-9e76-aef7c6b7fd03 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:02.754336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595aa32-9746-48ed-8acd-b1b132f5b1c1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:02.778874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:02.791154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fa2ba-5420-4194-8968-bdf92bef2e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:02.791767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fa2ba-5420-4194-8968-bdf92bef2e58 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:02.792051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fa2ba-5420-4194-8968-bdf92bef2e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:02.792327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fa2ba-5420-4194-8968-bdf92bef2e58 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:02.792603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d1d84-194a-4541-8ad1-29080f29da00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:02.793020 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fa2ba-5420-4194-8968-bdf92bef2e58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:02.793207 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d1d84-194a-4541-8ad1-29080f29da00 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:02.793318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fa2ba-5420-4194-8968-bdf92bef2e58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:02.793469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d1d84-194a-4541-8ad1-29080f29da00 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:02.793742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d1d84-194a-4541-8ad1-29080f29da00 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:02.794376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d1d84-194a-4541-8ad1-29080f29da00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:02.794675 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d1d84-194a-4541-8ad1-29080f29da00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:02.794785 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fa2ba-5420-4194-8968-bdf92bef2e58 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:02.796060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d1d84-194a-4541-8ad1-29080f29da00 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:02.811906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 294/591] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:02.811906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fa2ba-5420-4194-8968-bdf92bef2e58 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:02.812521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 298/592] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:02.813437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d1d84-194a-4541-8ad1-29080f29da00 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:02.852138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:02.917858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fa2ba-5420-4194-8968-bdf92bef2e58 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:02.923170 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d1d84-194a-4541-8ad1-29080f29da00 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:02.952817 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d8a23-180a-4d7e-8912-b37b470e597d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:02.953567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d8a23-180a-4d7e-8912-b37b470e597d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:02.953843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d8a23-180a-4d7e-8912-b37b470e597d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:02.954114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d8a23-180a-4d7e-8912-b37b470e597d None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:02.954959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d8a23-180a-4d7e-8912-b37b470e597d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:02.955603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d8a23-180a-4d7e-8912-b37b470e597d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:02.957382 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d8a23-180a-4d7e-8912-b37b470e597d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:02.960024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba0d20-7e80-4a36-b732-9917255c1445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:02.960653 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba0d20-7e80-4a36-b732-9917255c1445 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:02.960933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba0d20-7e80-4a36-b732-9917255c1445 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:02.961207 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba0d20-7e80-4a36-b732-9917255c1445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:02.969909 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 295/593] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:02.970569 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d8a23-180a-4d7e-8912-b37b470e597d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:02.976921 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba0d20-7e80-4a36-b732-9917255c1445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:02.978403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba0d20-7e80-4a36-b732-9917255c1445 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-2eba0d20-7e80-4a36-b732-9917255c1445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:02.993531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:02.994507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:02.995441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:02.995441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:02.995441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:02.999491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 299/594] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:03.000197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba0d20-7e80-4a36-b732-9917255c1445 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:03.020571 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:03.087296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d8a23-180a-4d7e-8912-b37b470e597d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:03.093022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:03.108012 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba0d20-7e80-4a36-b732-9917255c1445 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:03.132625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9e240-4d0c-45db-b4af-ca244c1f2e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:03.133292 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9e240-4d0c-45db-b4af-ca244c1f2e9e None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:03.133571 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9e240-4d0c-45db-b4af-ca244c1f2e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:03.133852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9e240-4d0c-45db-b4af-ca244c1f2e9e None admin] PATH_INFO: `/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/fadc83bec6be41979e1aa4d71f8fc2bd/roles/e55e17c894314bc6a5772b2de35b4874` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:03.145714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2c84e-9fbc-43fa-b907-a25785b411b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:03.147030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2c84e-9fbc-43fa-b907-a25785b411b0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:03.147466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2c84e-9fbc-43fa-b907-a25785b411b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:03.147746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2c84e-9fbc-43fa-b907-a25785b411b0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:03.148904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9e240-4d0c-45db-b4af-ca244c1f2e9e None admin] RBAC: Authorizing `identity:create_grant(project_id=fe73ceb0a582452b9b636a701adafb6f, user_id=fadc83bec6be41979e1aa4d71f8fc2bd, role_id=e55e17c894314bc6a5772b2de35b4874)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:03.150354 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9e240-4d0c-45db-b4af-ca244c1f2e9e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:03.156544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2c84e-9fbc-43fa-b907-a25785b411b0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:03.158002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2c84e-9fbc-43fa-b907-a25785b411b0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:03.165671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 296/595] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:06:02 2022] PUT /identity/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/fadc83bec6be41979e1aa4d71f8fc2bd/roles/e55e17c894314bc6a5772b2de35b4874 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:06:03.166748 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9e240-4d0c-45db-b4af-ca244c1f2e9e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-91d2c84e-9fbc-43fa-b907-a25785b411b0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:03.170038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:03.170994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:03.171966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:03.171966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:03.171966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:03.171966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:03.171966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:03.171966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:03.171966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:03.171966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:03.171966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 01:06:03.171966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:03.171966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 300/596] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:06:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:03.172562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2c84e-9fbc-43fa-b907-a25785b411b0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:03.299509 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:03.310865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9e240-4d0c-45db-b4af-ca244c1f2e9e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:03.327690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2c84e-9fbc-43fa-b907-a25785b411b0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:03.358185 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01643db-9473-4919-b1a1-ede8fca75153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:03.359092 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01643db-9473-4919-b1a1-ede8fca75153 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:03.359492 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01643db-9473-4919-b1a1-ede8fca75153 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:03.359865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01643db-9473-4919-b1a1-ede8fca75153 None admin] PATH_INFO: `/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/50c78d95e6774755b11508fc1954ad5e/roles/e55e17c894314bc6a5772b2de35b4874` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:03.377723 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c6b5e-d039-403e-a1b5-56ab8dc4984c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:03.378337 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c6b5e-d039-403e-a1b5-56ab8dc4984c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:03.378653 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c6b5e-d039-403e-a1b5-56ab8dc4984c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:03.379525 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c6b5e-d039-403e-a1b5-56ab8dc4984c None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:03.379707 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01643db-9473-4919-b1a1-ede8fca75153 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe73ceb0a582452b9b636a701adafb6f, user_id=50c78d95e6774755b11508fc1954ad5e, role_id=e55e17c894314bc6a5772b2de35b4874)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:03.380157 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c6b5e-d039-403e-a1b5-56ab8dc4984c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:03.380462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c6b5e-d039-403e-a1b5-56ab8dc4984c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:03.381244 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01643db-9473-4919-b1a1-ede8fca75153 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:03.381834 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c6b5e-d039-403e-a1b5-56ab8dc4984c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:03.394728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 301/597] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:03.395617 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c6b5e-d039-403e-a1b5-56ab8dc4984c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:03.401857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 297/598] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:06:03 2022] PUT /identity/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/50c78d95e6774755b11508fc1954ad5e/roles/e55e17c894314bc6a5772b2de35b4874 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:06:03.402703 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01643db-9473-4919-b1a1-ede8fca75153 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:03.411490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:03.578650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01643db-9473-4919-b1a1-ede8fca75153 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:03.622654 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c6b5e-d039-403e-a1b5-56ab8dc4984c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:03.626775 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b31de-a901-473d-9a4c-deaa2c6e1532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:03.627506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b31de-a901-473d-9a4c-deaa2c6e1532 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:03.627793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b31de-a901-473d-9a4c-deaa2c6e1532 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:03.628066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b31de-a901-473d-9a4c-deaa2c6e1532 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:03.639767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b31de-a901-473d-9a4c-deaa2c6e1532 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:03.641237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b31de-a901-473d-9a4c-deaa2c6e1532 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:03.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f03b31de-a901-473d-9a4c-deaa2c6e1532 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:03.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:03.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:03.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:03.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:03.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:03.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:03.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:03.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:03.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:03.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:03.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:03.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:03.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:03.653574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:03.654520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:03.655835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:03.655835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:03.655835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:03.655835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:03.655835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:03.655835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:03.655835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:03.655835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:03.655835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 298/599] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:03.656327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884d138-8295-43a9-8312-6a16a0471199 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:03.656794 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884d138-8295-43a9-8312-6a16a0471199 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:03.656794 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884d138-8295-43a9-8312-6a16a0471199 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:03.658226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 299/600] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:03.661537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884d138-8295-43a9-8312-6a16a0471199 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:03.663753 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc8a9d-edb1-414f-ae02-192a64d25629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:03.664443 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc8a9d-edb1-414f-ae02-192a64d25629 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:03.664728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc8a9d-edb1-414f-ae02-192a64d25629 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:03.665066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc8a9d-edb1-414f-ae02-192a64d25629 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:03.665809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc8a9d-edb1-414f-ae02-192a64d25629 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:03.666171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc8a9d-edb1-414f-ae02-192a64d25629 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:03.668213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc8a9d-edb1-414f-ae02-192a64d25629 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:03.669090 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:03.687687 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 302/601] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 13 01:06:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:03.689092 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bc731-dd63-4afd-a68e-82a9bdfdf5d8 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:03.689229 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bc731-dd63-4afd-a68e-82a9bdfdf5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:03.689461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bc731-dd63-4afd-a68e-82a9bdfdf5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:03.709204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-479bc731-dd63-4afd-a68e-82a9bdfdf5d8 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:03.710591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-479bc731-dd63-4afd-a68e-82a9bdfdf5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:03.788439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884d138-8295-43a9-8312-6a16a0471199 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:03.791508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:03.798657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 303/602] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:06:03.800137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bc731-dd63-4afd-a68e-82a9bdfdf5d8 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:03.850615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6a271-6395-4e18-b56b-dcb3dbcdc7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:03.851255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6a271-6395-4e18-b56b-dcb3dbcdc7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:03.851538 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6a271-6395-4e18-b56b-dcb3dbcdc7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:03.851812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6a271-6395-4e18-b56b-dcb3dbcdc7b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:03.852515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6a271-6395-4e18-b56b-dcb3dbcdc7b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:03.852822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6a271-6395-4e18-b56b-dcb3dbcdc7b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:03.854276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6a271-6395-4e18-b56b-dcb3dbcdc7b7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:03.883490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 300/603] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:03.888197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6a271-6395-4e18-b56b-dcb3dbcdc7b7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:03.989550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:03.990264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bc731-dd63-4afd-a68e-82a9bdfdf5d8 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:04.030494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6a271-6395-4e18-b56b-dcb3dbcdc7b7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:04.066070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1d257-3c66-4b29-82b4-9999b9cfe756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:04.066441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d5675-23b2-46dc-8ce7-f5f33e3e8057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:04.067347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d257-3c66-4b29-82b4-9999b9cfe756 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:04.067472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d5675-23b2-46dc-8ce7-f5f33e3e8057 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:04.067663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d5675-23b2-46dc-8ce7-f5f33e3e8057 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:04.067900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d5675-23b2-46dc-8ce7-f5f33e3e8057 None admin] PATH_INFO: `/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/ff33b1a82c4c42f6ab4a0588d5b616db/roles/e55e17c894314bc6a5772b2de35b4874` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:04.068323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d257-3c66-4b29-82b4-9999b9cfe756 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:04.068817 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d257-3c66-4b29-82b4-9999b9cfe756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:04.083777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d5675-23b2-46dc-8ce7-f5f33e3e8057 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe73ceb0a582452b9b636a701adafb6f, user_id=ff33b1a82c4c42f6ab4a0588d5b616db, role_id=e55e17c894314bc6a5772b2de35b4874)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:04.087089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d5675-23b2-46dc-8ce7-f5f33e3e8057 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:04.091354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1d257-3c66-4b29-82b4-9999b9cfe756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:04.092987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1d257-3c66-4b29-82b4-9999b9cfe756 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:04.105581 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 301/604] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:06:03 2022] PUT /identity/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/ff33b1a82c4c42f6ab4a0588d5b616db/roles/e55e17c894314bc6a5772b2de35b4874 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-6ae1d257-3c66-4b29-82b4-9999b9cfe756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:04.112911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:04.114533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:04.115796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:04.115796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:04.115796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:04.115796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 304/605] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:04.121718 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d5675-23b2-46dc-8ce7-f5f33e3e8057 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:04.142160 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1d257-3c66-4b29-82b4-9999b9cfe756 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:04.248237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:04.314414 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d5675-23b2-46dc-8ce7-f5f33e3e8057 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:04.338678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:04.349379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1d257-3c66-4b29-82b4-9999b9cfe756 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:04.366969 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b4ffd-d99f-4247-a98d-49b5ccaeba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:04.367727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b4ffd-d99f-4247-a98d-49b5ccaeba79 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:04.368081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b4ffd-d99f-4247-a98d-49b5ccaeba79 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:04.368437 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b4ffd-d99f-4247-a98d-49b5ccaeba79 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:04.369162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b4ffd-d99f-4247-a98d-49b5ccaeba79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:04.370293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b4ffd-d99f-4247-a98d-49b5ccaeba79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:04.371694 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b4ffd-d99f-4247-a98d-49b5ccaeba79 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:04.386363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 302/606] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:04.393171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b4ffd-d99f-4247-a98d-49b5ccaeba79 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:04.399887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1520ea-4b1b-495e-8ac8-29d0574c298c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:04.400830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1520ea-4b1b-495e-8ac8-29d0574c298c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:04.401321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1520ea-4b1b-495e-8ac8-29d0574c298c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:04.401791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1520ea-4b1b-495e-8ac8-29d0574c298c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:04.427728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1520ea-4b1b-495e-8ac8-29d0574c298c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-fb1520ea-4b1b-495e-8ac8-29d0574c298c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:04.433364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:04.434474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:04.435565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:04.435565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:04.435565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:04.435565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:04.435565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:04.435565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:04.435565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:04.435565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:04.435565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:04.435565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:04.435565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:04.435565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:04.437862 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 305/607] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:06:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:04.446635 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1520ea-4b1b-495e-8ac8-29d0574c298c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:04.527657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b4ffd-d99f-4247-a98d-49b5ccaeba79 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:04.600014 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c01f6-b46b-4846-be95-a5479ab86e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:04.603227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c01f6-b46b-4846-be95-a5479ab86e9f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:04.603514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c01f6-b46b-4846-be95-a5479ab86e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:04.603785 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c01f6-b46b-4846-be95-a5479ab86e9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:04.624215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c01f6-b46b-4846-be95-a5479ab86e9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:04.625660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c01f6-b46b-4846-be95-a5479ab86e9f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:04.640637 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1520ea-4b1b-495e-8ac8-29d0574c298c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:04.649638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-420c01f6-b46b-4846-be95-a5479ab86e9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:04.649638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:04.649638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:04.649638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:04.649638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:04.649638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:04.649638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:04.649638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:04.649638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:04.649638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:04.649638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:04.649638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:04.649638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:04.649638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:04.649638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:04.650620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:04.651546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:04.651546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:04.651546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:04.651546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:04.651546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:04.651546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:04.651546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:04.651546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:04.651975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:04.652047 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 303/608] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:04.665664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c01f6-b46b-4846-be95-a5479ab86e9f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:04.681905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3188c0c-27ac-4fa4-ac78-4c7555a17b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:04.682624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3188c0c-27ac-4fa4-ac78-4c7555a17b64 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:04.682909 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3188c0c-27ac-4fa4-ac78-4c7555a17b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:04.683217 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3188c0c-27ac-4fa4-ac78-4c7555a17b64 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:04.683883 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3188c0c-27ac-4fa4-ac78-4c7555a17b64 None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:04.684247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3188c0c-27ac-4fa4-ac78-4c7555a17b64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:04.685697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3188c0c-27ac-4fa4-ac78-4c7555a17b64 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:04.694516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 306/609] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:06:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:04.699889 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3188c0c-27ac-4fa4-ac78-4c7555a17b64 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:04.729436 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:04.803807 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c01f6-b46b-4846-be95-a5479ab86e9f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:04.810353 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3188c0c-27ac-4fa4-ac78-4c7555a17b64 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:04.839166 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6c8cc-b857-4f2b-a2a8-1793b8144b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:04.839875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6c8cc-b857-4f2b-a2a8-1793b8144b01 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:04.840074 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6c8cc-b857-4f2b-a2a8-1793b8144b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:04.840320 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6c8cc-b857-4f2b-a2a8-1793b8144b01 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:04.841018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6c8cc-b857-4f2b-a2a8-1793b8144b01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:04.841322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6c8cc-b857-4f2b-a2a8-1793b8144b01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:04.842781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6c8cc-b857-4f2b-a2a8-1793b8144b01 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:04.849009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e1042-7909-4bcd-b97a-b6ee47719cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:04.849951 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e1042-7909-4bcd-b97a-b6ee47719cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:04.850474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e1042-7909-4bcd-b97a-b6ee47719cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:04.850954 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e1042-7909-4bcd-b97a-b6ee47719cf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:04.855620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 304/610] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:04.866438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6c8cc-b857-4f2b-a2a8-1793b8144b01 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:04.867989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e1042-7909-4bcd-b97a-b6ee47719cf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:04.869615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e1042-7909-4bcd-b97a-b6ee47719cf0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-486e1042-7909-4bcd-b97a-b6ee47719cf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:04.885860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:04.886838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:04.887769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:04.887769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:04.887769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:04.889905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 307/611] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:04.895696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e1042-7909-4bcd-b97a-b6ee47719cf0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:04.934420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:04.981901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:04.993318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6c8cc-b857-4f2b-a2a8-1793b8144b01 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:05.039623 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e1042-7909-4bcd-b97a-b6ee47719cf0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:05.075343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fc1bd-b2a0-4bbc-8739-0d8ef80d22b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:05.076279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fc1bd-b2a0-4bbc-8739-0d8ef80d22b6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:05.076667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fc1bd-b2a0-4bbc-8739-0d8ef80d22b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:05.077090 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fc1bd-b2a0-4bbc-8739-0d8ef80d22b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:05.077826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fc1bd-b2a0-4bbc-8739-0d8ef80d22b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:05.078220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fc1bd-b2a0-4bbc-8739-0d8ef80d22b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:05.079863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fc1bd-b2a0-4bbc-8739-0d8ef80d22b6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:05.093531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 308/612] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:05.096398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386294d6-df77-4c54-8abc-df87858eecbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:05.097093 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386294d6-df77-4c54-8abc-df87858eecbd None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:05.097427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386294d6-df77-4c54-8abc-df87858eecbd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:05.097708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386294d6-df77-4c54-8abc-df87858eecbd None admin] PATH_INFO: `/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/a672e63fa5e345679bac3d67301fe875/roles/e55e17c894314bc6a5772b2de35b4874` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:05.099338 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fc1bd-b2a0-4bbc-8739-0d8ef80d22b6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:05.151655 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386294d6-df77-4c54-8abc-df87858eecbd None admin] RBAC: Authorizing `identity:create_grant(project_id=fe73ceb0a582452b9b636a701adafb6f, user_id=a672e63fa5e345679bac3d67301fe875, role_id=e55e17c894314bc6a5772b2de35b4874)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:05.153148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386294d6-df77-4c54-8abc-df87858eecbd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:05.191433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:05.201858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 305/613] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:06:04 2022] PUT /identity/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/a672e63fa5e345679bac3d67301fe875/roles/e55e17c894314bc6a5772b2de35b4874 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:06:05.213165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fc1bd-b2a0-4bbc-8739-0d8ef80d22b6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:05.268276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ab277-cece-414b-ae54-1625157eecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:05.268911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ab277-cece-414b-ae54-1625157eecbc None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:05.269220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ab277-cece-414b-ae54-1625157eecbc None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:05.269483 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ab277-cece-414b-ae54-1625157eecbc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:05.281606 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ab277-cece-414b-ae54-1625157eecbc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:05.283089 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ab277-cece-414b-ae54-1625157eecbc None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-4d2ab277-cece-414b-ae54-1625157eecbc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:05.296231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:05.297269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:05.298238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:05.298238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:05.298238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:05.298238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:05.298238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:05.298238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:05.298238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:05.298238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:05.298238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 01:06:05.298238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:05.298238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 309/614] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:06:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:05.303706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386294d6-df77-4c54-8abc-df87858eecbd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:05.443717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386294d6-df77-4c54-8abc-df87858eecbd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:05.504769 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20e159-1c54-468c-be53-08ae3e732f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:05.505396 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20e159-1c54-468c-be53-08ae3e732f37 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:05.505678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20e159-1c54-468c-be53-08ae3e732f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:05.505952 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20e159-1c54-468c-be53-08ae3e732f37 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:05.506707 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20e159-1c54-468c-be53-08ae3e732f37 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:05.507018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20e159-1c54-468c-be53-08ae3e732f37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:05.508492 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20e159-1c54-468c-be53-08ae3e732f37 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:05.530027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 306/615] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Sep 13 01:06:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:05.535461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ab277-cece-414b-ae54-1625157eecbc None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:05.608644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca7525-b240-4347-bbda-489251c62d81 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:05.608926 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca7525-b240-4347-bbda-489251c62d81 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:05.609194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca7525-b240-4347-bbda-489251c62d81 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:05.610923 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 307/616] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:06:05.618968 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9aaa5-a5ab-4908-a77b-53ee1e6d806f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:05.619272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9aaa5-a5ab-4908-a77b-53ee1e6d806f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:05.619541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9aaa5-a5ab-4908-a77b-53ee1e6d806f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:05.626899 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:05.645800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-20f9aaa5-a5ab-4908-a77b-53ee1e6d806f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:05.647000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-20f9aaa5-a5ab-4908-a77b-53ee1e6d806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:05.675510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ab277-cece-414b-ae54-1625157eecbc None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:05.744716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911f1af-7082-4907-89a7-1f45b53aafbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:05.745320 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911f1af-7082-4907-89a7-1f45b53aafbb None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:05.745599 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911f1af-7082-4907-89a7-1f45b53aafbb None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:05.745871 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911f1af-7082-4907-89a7-1f45b53aafbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:05.756732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 308/617] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:06:05.760376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911f1af-7082-4907-89a7-1f45b53aafbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:05.761848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911f1af-7082-4907-89a7-1f45b53aafbb None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:05.764002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a911f1af-7082-4907-89a7-1f45b53aafbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:05.780491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:05.781466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:05.782360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:05.782360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:05.782360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:05.782360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 310/618] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:05.788130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9aaa5-a5ab-4908-a77b-53ee1e6d806f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:05.940173 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9aaa5-a5ab-4908-a77b-53ee1e6d806f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:05.974851 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:05.980488 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c648c84-4668-480b-aeb1-c463dc212e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:05.981896 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c648c84-4668-480b-aeb1-c463dc212e36 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:05.982189 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c648c84-4668-480b-aeb1-c463dc212e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:05.982462 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c648c84-4668-480b-aeb1-c463dc212e36 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:05.983127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c648c84-4668-480b-aeb1-c463dc212e36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:05.983434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c648c84-4668-480b-aeb1-c463dc212e36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:05.984792 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c648c84-4668-480b-aeb1-c463dc212e36 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:05.996961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 309/619] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:06.002168 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911f1af-7082-4907-89a7-1f45b53aafbb None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:06.143614 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c648c84-4668-480b-aeb1-c463dc212e36 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:06.164998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911f1af-7082-4907-89a7-1f45b53aafbb None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:06.203940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ed5db-29d2-49c1-94c3-a4627d0ff6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:06.204502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed5db-29d2-49c1-94c3-a4627d0ff6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:06.204776 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed5db-29d2-49c1-94c3-a4627d0ff6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:06.205045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed5db-29d2-49c1-94c3-a4627d0ff6c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:06.222180 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ed5db-29d2-49c1-94c3-a4627d0ff6c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:06.226421 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ed5db-29d2-49c1-94c3-a4627d0ff6c0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:06.248100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-ec0ed5db-29d2-49c1-94c3-a4627d0ff6c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:06.248100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:06.248100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:06.248100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:06.248100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:06.248100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:06.248100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:06.248100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:06.248100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:06.248100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:06.248100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:06.248100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:06.248100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:06.248100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:06.248100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:06.249053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:06.249950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:06.249950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:06.249950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:06.249950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:06.249950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:06.249950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:06.249950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:06.249950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:06.252364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 311/620] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:06.253961 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40234fd1-f957-4a1f-934f-dcfb8eb66e1b None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:06.254452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40234fd1-f957-4a1f-934f-dcfb8eb66e1b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:06.255144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40234fd1-f957-4a1f-934f-dcfb8eb66e1b None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:06.256891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 312/621] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:06.261752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40234fd1-f957-4a1f-934f-dcfb8eb66e1b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:06.316423 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c648c84-4668-480b-aeb1-c463dc212e36 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:06.323592 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:06.361473 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b4179-33ea-45ec-a1ca-62f1c2274d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:06.362095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b4179-33ea-45ec-a1ca-62f1c2274d6b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:06.362372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b4179-33ea-45ec-a1ca-62f1c2274d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:06.362644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b4179-33ea-45ec-a1ca-62f1c2274d6b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:06.375935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40234fd1-f957-4a1f-934f-dcfb8eb66e1b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:06.376661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b4179-33ea-45ec-a1ca-62f1c2274d6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-3c4b4179-33ea-45ec-a1ca-62f1c2274d6b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:06.383114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:06.384069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:06.384990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:06.384990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:06.384990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:06.384990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:06.384990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:06.384990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:06.384990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:06.384990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:06.384990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:06.384990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:06.384990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:06.384990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:06.384990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 310/622] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:06:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:06.386276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f37637-bae1-4af8-8664-412cc5138ff4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:06.386276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f37637-bae1-4af8-8664-412cc5138ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:06.386435 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f37637-bae1-4af8-8664-412cc5138ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:06.410384 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-90f37637-bae1-4af8-8664-412cc5138ff4 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:06.411822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-90f37637-bae1-4af8-8664-412cc5138ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:06.417885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fcac7-1a6d-4205-9e91-0f46ce3b7098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:06.418878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fcac7-1a6d-4205-9e91-0f46ce3b7098 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:06.419443 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fcac7-1a6d-4205-9e91-0f46ce3b7098 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:06.419935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fcac7-1a6d-4205-9e91-0f46ce3b7098 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:06.420908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fcac7-1a6d-4205-9e91-0f46ce3b7098 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:06.421428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fcac7-1a6d-4205-9e91-0f46ce3b7098 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:06.423233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fcac7-1a6d-4205-9e91-0f46ce3b7098 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:06.438210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 313/623] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:06.439406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fcac7-1a6d-4205-9e91-0f46ce3b7098 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:06.475114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:06.510376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 311/624] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:06:06.511955 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f37637-bae1-4af8-8664-412cc5138ff4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:06.559723 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fcac7-1a6d-4205-9e91-0f46ce3b7098 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:06.576940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:06.596828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34e5c0-5944-4ac3-905a-ce5cfd35ac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:06.598270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e5c0-5944-4ac3-905a-ce5cfd35ac19 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:06.598777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e5c0-5944-4ac3-905a-ce5cfd35ac19 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:06.599069 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e5c0-5944-4ac3-905a-ce5cfd35ac19 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:06.599754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34e5c0-5944-4ac3-905a-ce5cfd35ac19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:06.600058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34e5c0-5944-4ac3-905a-ce5cfd35ac19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:06.601629 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34e5c0-5944-4ac3-905a-ce5cfd35ac19 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:06.610904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 314/625] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:06:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:06.617730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34e5c0-5944-4ac3-905a-ce5cfd35ac19 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:06.741830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34e5c0-5944-4ac3-905a-ce5cfd35ac19 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:06.765204 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f37637-bae1-4af8-8664-412cc5138ff4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:06.781178 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4f1ed-c7a6-435b-a395-d1080f5c202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:06.781792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4f1ed-c7a6-435b-a395-d1080f5c202c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:06.782066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4f1ed-c7a6-435b-a395-d1080f5c202c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:06.782337 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4f1ed-c7a6-435b-a395-d1080f5c202c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:06.795467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4f1ed-c7a6-435b-a395-d1080f5c202c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:06.796918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4f1ed-c7a6-435b-a395-d1080f5c202c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-23f4f1ed-c7a6-435b-a395-d1080f5c202c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:06.813555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:06.814549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:06.815499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:06.815499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:06.815499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:06.815499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 315/626] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:06.824033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4f1ed-c7a6-435b-a395-d1080f5c202c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:06.845356 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2777e4-fab0-4b23-aa5e-771058a02b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:06.846069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2777e4-fab0-4b23-aa5e-771058a02b2b None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:06.846319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2777e4-fab0-4b23-aa5e-771058a02b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:06.846596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2777e4-fab0-4b23-aa5e-771058a02b2b None admin] PATH_INFO: `/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/e2414e53593b4e2084c895651fd0d0e5/roles/e55e17c894314bc6a5772b2de35b4874` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:06.860257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:06.862447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2777e4-fab0-4b23-aa5e-771058a02b2b None admin] RBAC: Authorizing `identity:create_grant(project_id=fe73ceb0a582452b9b636a701adafb6f, user_id=e2414e53593b4e2084c895651fd0d0e5, role_id=e55e17c894314bc6a5772b2de35b4874)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:06.864551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2777e4-fab0-4b23-aa5e-771058a02b2b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:06.879822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 312/627] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:06:06 2022] PUT /identity/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/e2414e53593b4e2084c895651fd0d0e5/roles/e55e17c894314bc6a5772b2de35b4874 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:06:06.880620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2777e4-fab0-4b23-aa5e-771058a02b2b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:06.924365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:06.957143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4f1ed-c7a6-435b-a395-d1080f5c202c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:06.997482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9515434-84d3-425e-ab5e-34569df1f435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:06.998342 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9515434-84d3-425e-ab5e-34569df1f435 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:06.998760 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9515434-84d3-425e-ab5e-34569df1f435 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:06.999231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9515434-84d3-425e-ab5e-34569df1f435 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:07.000028 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9515434-84d3-425e-ab5e-34569df1f435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:07.000475 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9515434-84d3-425e-ab5e-34569df1f435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:07.002021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9515434-84d3-425e-ab5e-34569df1f435 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:07.003085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2777e4-fab0-4b23-aa5e-771058a02b2b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:07.016672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 316/628] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:07.018544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f400384-6981-4c46-8a6d-a1affbaf3129 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:07.018987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f400384-6981-4c46-8a6d-a1affbaf3129 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:07.019947 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f400384-6981-4c46-8a6d-a1affbaf3129 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:07.022317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 317/629] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:07.023263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f400384-6981-4c46-8a6d-a1affbaf3129 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:07.042303 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69479d04-45cd-42bf-8a34-6a61e23c9685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:07.042657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69479d04-45cd-42bf-8a34-6a61e23c9685 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:07.042938 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69479d04-45cd-42bf-8a34-6a61e23c9685 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:07.043258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69479d04-45cd-42bf-8a34-6a61e23c9685 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:07.056712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69479d04-45cd-42bf-8a34-6a61e23c9685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-69479d04-45cd-42bf-8a34-6a61e23c9685 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:07.061839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:07.062966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:07.063861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:07.063861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:07.063861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:07.063861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:07.063861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:07.063861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:07.063861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:07.063861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:07.063861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:07.063861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:07.063861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:07.063861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:07.063861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 313/630] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:06:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:07.064924 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b8dc-faaf-4272-b98c-ae9e54c6b588 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:07.065178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b8dc-faaf-4272-b98c-ae9e54c6b588 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:07.065459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b8dc-faaf-4272-b98c-ae9e54c6b588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:07.086372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7e17b8dc-faaf-4272-b98c-ae9e54c6b588 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:07.088470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7e17b8dc-faaf-4272-b98c-ae9e54c6b588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:07.146802 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:07.162743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f400384-6981-4c46-8a6d-a1affbaf3129 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:07.166187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 314/631] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:06:07.166548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b8dc-faaf-4272-b98c-ae9e54c6b588 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:07.193617 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:07.231085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d97e7-d881-4d3e-9757-6c891f75eb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:07.231727 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d97e7-d881-4d3e-9757-6c891f75eb14 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:07.232000 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d97e7-d881-4d3e-9757-6c891f75eb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:07.232268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d97e7-d881-4d3e-9757-6c891f75eb14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:07.245013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d97e7-d881-4d3e-9757-6c891f75eb14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:07.246528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d97e7-d881-4d3e-9757-6c891f75eb14 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-884d97e7-d881-4d3e-9757-6c891f75eb14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:07.268725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:07.269761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:07.270710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:07.270710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:07.270710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:07.270710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:07.270710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:07.270710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:07.270710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:07.270710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:07.270710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:06:07.270710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:07.279413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 318/632] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 13 01:06:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:07.280328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d97e7-d881-4d3e-9757-6c891f75eb14 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:07.308289 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b8dc-faaf-4272-b98c-ae9e54c6b588 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:07.346541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51343821-74ef-46be-8c74-974aef224640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:07.347729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51343821-74ef-46be-8c74-974aef224640 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:07.348060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51343821-74ef-46be-8c74-974aef224640 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:07.350692 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51343821-74ef-46be-8c74-974aef224640 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:07.351401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51343821-74ef-46be-8c74-974aef224640 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:07.351713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51343821-74ef-46be-8c74-974aef224640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:07.353105 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51343821-74ef-46be-8c74-974aef224640 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:07.374675 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 315/633] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:06:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:07.383539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51343821-74ef-46be-8c74-974aef224640 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:07.478030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d97e7-d881-4d3e-9757-6c891f75eb14 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:07.521820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:07.524283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91c477-acf5-4b77-aa12-eeeed1e5a7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:07.524894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91c477-acf5-4b77-aa12-eeeed1e5a7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:07.525168 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91c477-acf5-4b77-aa12-eeeed1e5a7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:07.525437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91c477-acf5-4b77-aa12-eeeed1e5a7a4 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:07.526163 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91c477-acf5-4b77-aa12-eeeed1e5a7a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:07.526511 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91c477-acf5-4b77-aa12-eeeed1e5a7a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:07.528094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91c477-acf5-4b77-aa12-eeeed1e5a7a4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:07.542213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51343821-74ef-46be-8c74-974aef224640 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:07.548444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 319/634] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 13 01:06:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:07.549356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91c477-acf5-4b77-aa12-eeeed1e5a7a4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:07.558566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:07.583622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4ba26-bd74-44a5-a20c-47833f5e223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:07.584633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4ba26-bd74-44a5-a20c-47833f5e223a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:07.585116 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4ba26-bd74-44a5-a20c-47833f5e223a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:07.585568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4ba26-bd74-44a5-a20c-47833f5e223a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:07.600067 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4ba26-bd74-44a5-a20c-47833f5e223a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:07.601859 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4ba26-bd74-44a5-a20c-47833f5e223a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-05c4ba26-bd74-44a5-a20c-47833f5e223a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:07.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:07.622361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:07.623687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:07.623687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:07.623687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:07.630449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 316/635] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:07.631641 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4ba26-bd74-44a5-a20c-47833f5e223a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:07.661332 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91c477-acf5-4b77-aa12-eeeed1e5a7a4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:07.698852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36e9a0-0851-4976-bda3-9b3b34a9f942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:07.699811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36e9a0-0851-4976-bda3-9b3b34a9f942 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:07.700095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36e9a0-0851-4976-bda3-9b3b34a9f942 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:07.700364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36e9a0-0851-4976-bda3-9b3b34a9f942 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:07.716197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36e9a0-0851-4976-bda3-9b3b34a9f942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-1a36e9a0-0851-4976-bda3-9b3b34a9f942 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:07.722039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:07.723326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:07.724205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:07.724205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:07.724205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:07.724205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:07.724205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:07.724205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:07.724205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:07.724205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:07.724205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:07.724205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:07.724205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:07.724205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:07.724205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 320/636] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:06:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:07.724920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36e9a0-0851-4976-bda3-9b3b34a9f942 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:07.767336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4ba26-bd74-44a5-a20c-47833f5e223a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:07.805026 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:07.812745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268e05a-2bfd-4400-8dc7-fb5c071ef10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:07.813787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268e05a-2bfd-4400-8dc7-fb5c071ef10e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:07.814278 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268e05a-2bfd-4400-8dc7-fb5c071ef10e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:07.814760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268e05a-2bfd-4400-8dc7-fb5c071ef10e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:07.821542 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:07.857308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36e9a0-0851-4976-bda3-9b3b34a9f942 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:07.905727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268e05a-2bfd-4400-8dc7-fb5c071ef10e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:07.908303 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268e05a-2bfd-4400-8dc7-fb5c071ef10e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:07.945792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49714d5a-7e0a-44ef-9993-0fd2a12e1562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:07.946414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49714d5a-7e0a-44ef-9993-0fd2a12e1562 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:07.946689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49714d5a-7e0a-44ef-9993-0fd2a12e1562 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:07.946960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49714d5a-7e0a-44ef-9993-0fd2a12e1562 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:07.947664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49714d5a-7e0a-44ef-9993-0fd2a12e1562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:07.947974 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49714d5a-7e0a-44ef-9993-0fd2a12e1562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:07.949702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49714d5a-7e0a-44ef-9993-0fd2a12e1562 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:07.970332 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 321/637] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:07.970332 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49714d5a-7e0a-44ef-9993-0fd2a12e1562 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:08.032668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 317/638] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:06:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:06:08.036357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b3d82-8bfa-47e9-a596-dbd571d24b42 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:08.036884 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b3d82-8bfa-47e9-a596-dbd571d24b42 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:08.037634 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b3d82-8bfa-47e9-a596-dbd571d24b42 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:08.039574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 318/639] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:08.040495 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b3d82-8bfa-47e9-a596-dbd571d24b42 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:08.077792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49714d5a-7e0a-44ef-9993-0fd2a12e1562 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:08.086352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:08.106347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:08.119851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42ff61-ab6f-439d-b34f-a8e5a7c19fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:08.121460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42ff61-ab6f-439d-b34f-a8e5a7c19fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:08.121928 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42ff61-ab6f-439d-b34f-a8e5a7c19fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:08.122427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42ff61-ab6f-439d-b34f-a8e5a7c19fb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:08.123426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42ff61-ab6f-439d-b34f-a8e5a7c19fb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:08.123945 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42ff61-ab6f-439d-b34f-a8e5a7c19fb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:08.125762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42ff61-ab6f-439d-b34f-a8e5a7c19fb2 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:08.139893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 322/640] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:06:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:08.139893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42ff61-ab6f-439d-b34f-a8e5a7c19fb2 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:08.170740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b3d82-8bfa-47e9-a596-dbd571d24b42 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:08.209193 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61754b9-6b78-4777-a9f7-cc9f83a80100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:08.210077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61754b9-6b78-4777-a9f7-cc9f83a80100 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:08.210519 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61754b9-6b78-4777-a9f7-cc9f83a80100 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:08.210795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61754b9-6b78-4777-a9f7-cc9f83a80100 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:08.219100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61754b9-6b78-4777-a9f7-cc9f83a80100 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:08.220564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61754b9-6b78-4777-a9f7-cc9f83a80100 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-d61754b9-6b78-4777-a9f7-cc9f83a80100 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:08.234583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:08.235701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:08.236631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:08.236631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:08.236631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:08.236631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:08.236631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:08.236631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:08.236631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:08.236631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:08.236631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 01:06:08.236631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:08.236631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 319/641] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:06:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:08.237217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3bd9c-22fa-46a5-a3e0-e0221856bfd2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:08.237217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3bd9c-22fa-46a5-a3e0-e0221856bfd2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:08.238176 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3bd9c-22fa-46a5-a3e0-e0221856bfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:08.259710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42ff61-ab6f-439d-b34f-a8e5a7c19fb2 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:08.259906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-46b3bd9c-22fa-46a5-a3e0-e0221856bfd2 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:08.261004 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-46b3bd9c-22fa-46a5-a3e0-e0221856bfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:08.303737 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666732f-92e2-4ad2-aebd-3bbab1d840ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:08.304370 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666732f-92e2-4ad2-aebd-3bbab1d840ea None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:08.304651 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666732f-92e2-4ad2-aebd-3bbab1d840ea None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:08.304924 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666732f-92e2-4ad2-aebd-3bbab1d840ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:08.326725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666732f-92e2-4ad2-aebd-3bbab1d840ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:08.328485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666732f-92e2-4ad2-aebd-3bbab1d840ea None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a666732f-92e2-4ad2-aebd-3bbab1d840ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:08.344420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:08.345480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:08.346410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:08.346410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:08.346410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:08.346410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 323/642] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:08.346410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666732f-92e2-4ad2-aebd-3bbab1d840ea None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:08.357160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 320/643] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:06:08.358257 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3bd9c-22fa-46a5-a3e0-e0221856bfd2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:08.394544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:08.420314 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:08.478728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3bd9c-22fa-46a5-a3e0-e0221856bfd2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:08.497278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666732f-92e2-4ad2-aebd-3bbab1d840ea None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:08.519865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3fd45-d955-4109-bf3d-e5e7a52481c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:08.520491 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3fd45-d955-4109-bf3d-e5e7a52481c8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:08.520767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3fd45-d955-4109-bf3d-e5e7a52481c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:08.521033 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3fd45-d955-4109-bf3d-e5e7a52481c8 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:08.521760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3fd45-d955-4109-bf3d-e5e7a52481c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:08.522063 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3fd45-d955-4109-bf3d-e5e7a52481c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:08.523544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3fd45-d955-4109-bf3d-e5e7a52481c8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:08.538973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51540b0-5075-4a2b-a997-71ed1e13b83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:08.539630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51540b0-5075-4a2b-a997-71ed1e13b83e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:08.539959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51540b0-5075-4a2b-a997-71ed1e13b83e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:08.540237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51540b0-5075-4a2b-a997-71ed1e13b83e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:08.546221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 321/644] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 13 01:06:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:08.547278 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3fd45-d955-4109-bf3d-e5e7a52481c8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:08.557192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51540b0-5075-4a2b-a997-71ed1e13b83e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:08.558821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51540b0-5075-4a2b-a997-71ed1e13b83e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-d51540b0-5075-4a2b-a997-71ed1e13b83e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:08.574818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:08.576076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:08.577120 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:08.577120 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:08.577120 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:08.584295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 324/645] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:08.585351 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51540b0-5075-4a2b-a997-71ed1e13b83e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:08.638031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:08.656489 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3fd45-d955-4109-bf3d-e5e7a52481c8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:08.693550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d8e80-6ec6-416e-bfc5-0d479d7bfef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:08.694164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d8e80-6ec6-416e-bfc5-0d479d7bfef9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:08.694442 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d8e80-6ec6-416e-bfc5-0d479d7bfef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:08.694710 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d8e80-6ec6-416e-bfc5-0d479d7bfef9 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:08.695388 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d8e80-6ec6-416e-bfc5-0d479d7bfef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:08.696110 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d8e80-6ec6-416e-bfc5-0d479d7bfef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:08.697053 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d8e80-6ec6-416e-bfc5-0d479d7bfef9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:08.699926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:08.709659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51540b0-5075-4a2b-a997-71ed1e13b83e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:08.710631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 322/646] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:08.715640 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d8e80-6ec6-416e-bfc5-0d479d7bfef9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:08.744750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d731e21-0979-4a6f-b40e-225408cd3794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:08.745361 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d731e21-0979-4a6f-b40e-225408cd3794 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:08.745634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d731e21-0979-4a6f-b40e-225408cd3794 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:08.745916 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d731e21-0979-4a6f-b40e-225408cd3794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:08.817700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d731e21-0979-4a6f-b40e-225408cd3794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:08.819194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d731e21-0979-4a6f-b40e-225408cd3794 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:08.825305 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d8e80-6ec6-416e-bfc5-0d479d7bfef9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:08.868741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6105c4-5fc4-430e-ac3e-7bd8f68c24f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:08.869474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6105c4-5fc4-430e-ac3e-7bd8f68c24f6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:08.869752 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6105c4-5fc4-430e-ac3e-7bd8f68c24f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:08.870025 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6105c4-5fc4-430e-ac3e-7bd8f68c24f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:08.870666 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6105c4-5fc4-430e-ac3e-7bd8f68c24f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:08.870969 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6105c4-5fc4-430e-ac3e-7bd8f68c24f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:08.872372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6105c4-5fc4-430e-ac3e-7bd8f68c24f6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:08.884811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 323/647] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:08.885444 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6105c4-5fc4-430e-ac3e-7bd8f68c24f6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:08.888732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:08.922712 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:08.933937 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 325/648] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:06:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:06:08.935008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d731e21-0979-4a6f-b40e-225408cd3794 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:08.995975 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6105c4-5fc4-430e-ac3e-7bd8f68c24f6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:09.034840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9deb20a-8659-4cae-8040-68c1b1286ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:09.036495 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9deb20a-8659-4cae-8040-68c1b1286ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:09.036950 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9deb20a-8659-4cae-8040-68c1b1286ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:09.037389 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9deb20a-8659-4cae-8040-68c1b1286ea1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:09.041279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d731e21-0979-4a6f-b40e-225408cd3794 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:09.048892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9deb20a-8659-4cae-8040-68c1b1286ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e9deb20a-8659-4cae-8040-68c1b1286ea1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:09.054164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:09.055322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:09.056391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:09.056391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:09.056391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:09.056391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:09.056391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:09.056391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:09.056391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:09.056391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:09.056391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:09.056391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:09.056391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:09.056391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:09.059218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 324/649] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:06:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:09.060539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9deb20a-8659-4cae-8040-68c1b1286ea1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:09.087145 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d763792-bcb2-47d1-a8bd-04ec7d03a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:09.088426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d763792-bcb2-47d1-a8bd-04ec7d03a70b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:09.088768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d763792-bcb2-47d1-a8bd-04ec7d03a70b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:09.089201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d763792-bcb2-47d1-a8bd-04ec7d03a70b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:09.096443 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d763792-bcb2-47d1-a8bd-04ec7d03a70b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:09.098280 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d763792-bcb2-47d1-a8bd-04ec7d03a70b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:09.109602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-8d763792-bcb2-47d1-a8bd-04ec7d03a70b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:09.109602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:09.109602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:09.109602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:09.109602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:09.109602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:09.109602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:09.109602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:09.109602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:09.109602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:09.109602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:09.109602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:09.109602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:09.109602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:09.109602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:09.110506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:09.112144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:09.112144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:09.112144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:09.112144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:09.112144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:09.112144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:09.112144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:09.112144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:09.112144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 326/650] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:09.112144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d763792-bcb2-47d1-a8bd-04ec7d03a70b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:09.138121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:09.172451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:09.183913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9deb20a-8659-4cae-8040-68c1b1286ea1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:09.218400 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05d389-e7ad-45c6-8ad9-9e23e143bb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:09.219024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05d389-e7ad-45c6-8ad9-9e23e143bb80 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:09.219325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05d389-e7ad-45c6-8ad9-9e23e143bb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:09.219595 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05d389-e7ad-45c6-8ad9-9e23e143bb80 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:09.220431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d763792-bcb2-47d1-a8bd-04ec7d03a70b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:09.227466 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05d389-e7ad-45c6-8ad9-9e23e143bb80 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:09.228896 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05d389-e7ad-45c6-8ad9-9e23e143bb80 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-1f05d389-e7ad-45c6-8ad9-9e23e143bb80 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:09.239797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:09.240943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:09.242142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:09.242142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:09.242142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:09.242142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:09.242142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:09.242142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:09.242142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:09.242142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:09.242142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 01:06:09.242142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:09.242142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 325/651] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:06:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:09.242142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05d389-e7ad-45c6-8ad9-9e23e143bb80 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:09.259379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf54f14-9a1c-43bf-9314-703911040b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:09.260010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf54f14-9a1c-43bf-9314-703911040b32 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:09.260287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf54f14-9a1c-43bf-9314-703911040b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:09.260568 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf54f14-9a1c-43bf-9314-703911040b32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:09.270981 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf54f14-9a1c-43bf-9314-703911040b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:09.272453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf54f14-9a1c-43bf-9314-703911040b32 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-6bf54f14-9a1c-43bf-9314-703911040b32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:09.287233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:09.288268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:09.289162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:09.289162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:09.289162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:09.289162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 327/652] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:09.289162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf54f14-9a1c-43bf-9314-703911040b32 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:09.343530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05d389-e7ad-45c6-8ad9-9e23e143bb80 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:09.367002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:09.377766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cd74c-6204-4b30-b290-feeca55607a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:09.378423 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cd74c-6204-4b30-b290-feeca55607a8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:09.379235 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cd74c-6204-4b30-b290-feeca55607a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:09.379505 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cd74c-6204-4b30-b290-feeca55607a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:09.380157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cd74c-6204-4b30-b290-feeca55607a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:09.380456 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cd74c-6204-4b30-b290-feeca55607a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:09.381808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cd74c-6204-4b30-b290-feeca55607a8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:09.389591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 326/653] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:06:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:09.389707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf54f14-9a1c-43bf-9314-703911040b32 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:09.390993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91230-96d8-4e6e-bb86-06cef103bba5 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:09.391338 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91230-96d8-4e6e-bb86-06cef103bba5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:09.391612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91230-96d8-4e6e-bb86-06cef103bba5 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:09.392798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 327/654] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:09.393473 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b91230-96d8-4e6e-bb86-06cef103bba5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:09.396761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:09.431619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170be71-f8e3-4504-b5de-7bceae462c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:09.432219 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170be71-f8e3-4504-b5de-7bceae462c91 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:09.432494 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170be71-f8e3-4504-b5de-7bceae462c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:09.432762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170be71-f8e3-4504-b5de-7bceae462c91 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:09.433438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170be71-f8e3-4504-b5de-7bceae462c91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:09.433735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170be71-f8e3-4504-b5de-7bceae462c91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:09.435187 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170be71-f8e3-4504-b5de-7bceae462c91 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:09.447786 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 328/655] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:09.448573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170be71-f8e3-4504-b5de-7bceae462c91 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:09.499773 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b91230-96d8-4e6e-bb86-06cef103bba5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:09.533323 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0f846-d400-4cf6-bf47-3f3955a6d9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:09.533922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0f846-d400-4cf6-bf47-3f3955a6d9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:09.534200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0f846-d400-4cf6-bf47-3f3955a6d9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:09.534470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0f846-d400-4cf6-bf47-3f3955a6d9d5 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:09.535471 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0f846-d400-4cf6-bf47-3f3955a6d9d5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:09.535775 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0f846-d400-4cf6-bf47-3f3955a6d9d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:09.537188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0f846-d400-4cf6-bf47-3f3955a6d9d5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:09.549157 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170be71-f8e3-4504-b5de-7bceae462c91 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:09.553991 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 328/656] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 13 01:06:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:09.554793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0f846-d400-4cf6-bf47-3f3955a6d9d5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:09.585911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08397fb2-ea20-44e3-86f9-938265d667b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:09.586512 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08397fb2-ea20-44e3-86f9-938265d667b5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:09.586784 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08397fb2-ea20-44e3-86f9-938265d667b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:09.587052 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08397fb2-ea20-44e3-86f9-938265d667b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:09.587708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08397fb2-ea20-44e3-86f9-938265d667b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:09.588004 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08397fb2-ea20-44e3-86f9-938265d667b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:09.589358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08397fb2-ea20-44e3-86f9-938265d667b5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:09.604886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 329/657] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:09.605046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:09.605162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17bc4e-509d-4b74-bfe1-366e7189f207 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:09.605162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17bc4e-509d-4b74-bfe1-366e7189f207 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:09.605162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17bc4e-509d-4b74-bfe1-366e7189f207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:09.619993 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ff17bc4e-509d-4b74-bfe1-366e7189f207 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:09.621174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ff17bc4e-509d-4b74-bfe1-366e7189f207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:09.640605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:09.658836 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0f846-d400-4cf6-bf47-3f3955a6d9d5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:09.704294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 330/658] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:06:09.704294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17bc4e-509d-4b74-bfe1-366e7189f207 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:09.704568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad714412-1359-456c-95ac-2da3d642f6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:09.704568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad714412-1359-456c-95ac-2da3d642f6da None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:09.704568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad714412-1359-456c-95ac-2da3d642f6da None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:09.704568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad714412-1359-456c-95ac-2da3d642f6da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:09.709799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad714412-1359-456c-95ac-2da3d642f6da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:09.711264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad714412-1359-456c-95ac-2da3d642f6da None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-ad714412-1359-456c-95ac-2da3d642f6da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:09.727041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:09.728051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:09.728965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:09.728965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:09.728965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:09.728965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 329/659] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:09.729692 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad714412-1359-456c-95ac-2da3d642f6da None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:09.810593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17bc4e-509d-4b74-bfe1-366e7189f207 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:09.838333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:09.845243 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad714412-1359-456c-95ac-2da3d642f6da None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:09.852820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e19c1-d34d-4a18-8bc1-2878e6eccd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:09.853547 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e19c1-d34d-4a18-8bc1-2878e6eccd29 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:09.853820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e19c1-d34d-4a18-8bc1-2878e6eccd29 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:09.854085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e19c1-d34d-4a18-8bc1-2878e6eccd29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:09.854802 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e19c1-d34d-4a18-8bc1-2878e6eccd29 None admin] RBAC: Adding query filter params (role.id=e55e17c894314bc6a5772b2de35b4874, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=fadc83bec6be41979e1aa4d71f8fc2bd) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:09.855246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e19c1-d34d-4a18-8bc1-2878e6eccd29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:09.856780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e19c1-d34d-4a18-8bc1-2878e6eccd29 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:09.865499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 331/660] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:06:09 2022] GET /identity/v3/role_assignments?user.id=fadc83bec6be41979e1aa4d71f8fc2bd&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=e55e17c894314bc6a5772b2de35b4874 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:09.867175 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e19c1-d34d-4a18-8bc1-2878e6eccd29 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:09.893673 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ed323-4b12-4d6a-a2b9-103d312a96f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:09.895267 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed323-4b12-4d6a-a2b9-103d312a96f2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:09.895824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed323-4b12-4d6a-a2b9-103d312a96f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:09.896279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed323-4b12-4d6a-a2b9-103d312a96f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:09.896790 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:09.983442 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ed323-4b12-4d6a-a2b9-103d312a96f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:09.985242 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ed323-4b12-4d6a-a2b9-103d312a96f2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:10.034728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e19c1-d34d-4a18-8bc1-2878e6eccd29 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:10.090752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d3a4c-090d-45e0-9e6f-44886713dbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:10.092508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d3a4c-090d-45e0-9e6f-44886713dbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:10.093743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d3a4c-090d-45e0-9e6f-44886713dbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:10.094045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d3a4c-090d-45e0-9e6f-44886713dbf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:10.103197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d3a4c-090d-45e0-9e6f-44886713dbf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:10.105144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d3a4c-090d-45e0-9e6f-44886713dbf1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:10.108903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:10.117596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 330/661] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:06:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:06:10.118118 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ed323-4b12-4d6a-a2b9-103d312a96f2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:10.121588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-058d3a4c-090d-45e0-9e6f-44886713dbf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:10.121588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:10.121588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:10.121588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:10.121588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:10.121588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:10.121588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:10.121588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:10.121588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:10.121588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:10.121588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:10.121588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:10.121588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:10.121588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:10.121588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:10.123636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:10.124526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:10.124526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:10.124526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:10.124526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:10.124526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:10.124526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:10.124526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:10.124526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:10.124526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 332/662] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:10.124526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d3a4c-090d-45e0-9e6f-44886713dbf1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:10.218343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:10.245346 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ed323-4b12-4d6a-a2b9-103d312a96f2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:10.248748 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d3a4c-090d-45e0-9e6f-44886713dbf1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:10.286724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a87818-bab7-46cc-984d-84e9d95295e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:10.287387 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a87818-bab7-46cc-984d-84e9d95295e4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:10.287663 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a87818-bab7-46cc-984d-84e9d95295e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:10.287935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a87818-bab7-46cc-984d-84e9d95295e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:10.290438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f44baf-6ced-4622-9439-467eb33ee492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:10.291055 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f44baf-6ced-4622-9439-467eb33ee492 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:10.291357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f44baf-6ced-4622-9439-467eb33ee492 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:10.291632 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f44baf-6ced-4622-9439-467eb33ee492 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:10.292283 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f44baf-6ced-4622-9439-467eb33ee492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:10.292583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f44baf-6ced-4622-9439-467eb33ee492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:10.293962 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f44baf-6ced-4622-9439-467eb33ee492 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:10.299823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a87818-bab7-46cc-984d-84e9d95295e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-06a87818-bab7-46cc-984d-84e9d95295e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:10.305893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:10.306929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:10.313250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:10.313250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:10.313250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:10.313250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:10.313250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:10.313250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:10.313250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:10.313250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:10.313250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:10.313250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:10.313250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:10.313250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:10.313250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 333/663] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:06:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:10.313934 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 331/664] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:10.313934 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f44baf-6ced-4622-9439-467eb33ee492 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:10.314061 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a87818-bab7-46cc-984d-84e9d95295e4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:10.382472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:10.435528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a87818-bab7-46cc-984d-84e9d95295e4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:10.442893 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f44baf-6ced-4622-9439-467eb33ee492 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:10.473978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240922d0-12ad-462e-a4f6-a97594387aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:10.474568 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240922d0-12ad-462e-a4f6-a97594387aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:10.474869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240922d0-12ad-462e-a4f6-a97594387aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:10.475170 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240922d0-12ad-462e-a4f6-a97594387aa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:10.483304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:10.487041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b372bd-2c98-40fb-bcf3-e631a8acdc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:10.487561 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b372bd-2c98-40fb-bcf3-e631a8acdc97 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:10.488623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b372bd-2c98-40fb-bcf3-e631a8acdc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:10.488983 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b372bd-2c98-40fb-bcf3-e631a8acdc97 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:10.489866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b372bd-2c98-40fb-bcf3-e631a8acdc97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:10.490172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b372bd-2c98-40fb-bcf3-e631a8acdc97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:10.490707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240922d0-12ad-462e-a4f6-a97594387aa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:10.491851 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b372bd-2c98-40fb-bcf3-e631a8acdc97 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:10.492660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240922d0-12ad-462e-a4f6-a97594387aa5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:10.506127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 332/665] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:10.507110 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b372bd-2c98-40fb-bcf3-e631a8acdc97 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-240922d0-12ad-462e-a4f6-a97594387aa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:10.514615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:10.515756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:10.516651 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:10.516651 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:10.516651 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:10.516651 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 334/666] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:10.522433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240922d0-12ad-462e-a4f6-a97594387aa5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:10.626996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b372bd-2c98-40fb-bcf3-e631a8acdc97 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:10.646375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:10.656409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240922d0-12ad-462e-a4f6-a97594387aa5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:10.669986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7ab16-fd27-433e-99bb-9edc350f087a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:10.670975 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7ab16-fd27-433e-99bb-9edc350f087a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:10.671287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7ab16-fd27-433e-99bb-9edc350f087a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:10.671555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7ab16-fd27-433e-99bb-9edc350f087a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:10.680031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7ab16-fd27-433e-99bb-9edc350f087a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:10.681511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7ab16-fd27-433e-99bb-9edc350f087a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:10.699624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead69a3f-da4d-45ae-87a8-aaf19359eb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-03a7ab16-fd27-433e-99bb-9edc350f087a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:10.700194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:10.701362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:10.702298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:10.702298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:10.702298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:10.702298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:10.702298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:10.702298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:10.702298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:10.702298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:10.702298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 01:06:10.702298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:10.702858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead69a3f-da4d-45ae-87a8-aaf19359eb41 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:10.702858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead69a3f-da4d-45ae-87a8-aaf19359eb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:10.702858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead69a3f-da4d-45ae-87a8-aaf19359eb41 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:10.702858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead69a3f-da4d-45ae-87a8-aaf19359eb41 None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:10.702858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead69a3f-da4d-45ae-87a8-aaf19359eb41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:10.703715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead69a3f-da4d-45ae-87a8-aaf19359eb41 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:10.707038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 333/667] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:06:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:10.707738 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7ab16-fd27-433e-99bb-9edc350f087a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:10.714276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 335/668] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:06:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:10.718725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead69a3f-da4d-45ae-87a8-aaf19359eb41 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:10.776805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:10.824760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7ab16-fd27-433e-99bb-9edc350f087a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:10.832512 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead69a3f-da4d-45ae-87a8-aaf19359eb41 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:10.864136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8c54a-64aa-489a-a630-08f30f172980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:10.864741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8c54a-64aa-489a-a630-08f30f172980 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:10.865009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8c54a-64aa-489a-a630-08f30f172980 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:10.865280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8c54a-64aa-489a-a630-08f30f172980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:10.866007 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8c54a-64aa-489a-a630-08f30f172980 None admin] RBAC: Adding query filter params (role.id=e55e17c894314bc6a5772b2de35b4874, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=50c78d95e6774755b11508fc1954ad5e) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:10.866314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8c54a-64aa-489a-a630-08f30f172980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:10.867782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8c54a-64aa-489a-a630-08f30f172980 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:10.868632 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a212fee-14fc-4886-bf0b-f053df6a03b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:10.869238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a212fee-14fc-4886-bf0b-f053df6a03b3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:10.869522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a212fee-14fc-4886-bf0b-f053df6a03b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:10.869795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a212fee-14fc-4886-bf0b-f053df6a03b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:10.870438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a212fee-14fc-4886-bf0b-f053df6a03b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:10.870742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a212fee-14fc-4886-bf0b-f053df6a03b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:10.872144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a212fee-14fc-4886-bf0b-f053df6a03b3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:10.882301 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 334/669] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:06:10 2022] GET /identity/v3/role_assignments?user.id=50c78d95e6774755b11508fc1954ad5e&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=e55e17c894314bc6a5772b2de35b4874 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:10.883583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8c54a-64aa-489a-a630-08f30f172980 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:10.885056 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 336/670] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:10.889538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a212fee-14fc-4886-bf0b-f053df6a03b3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:10.945270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:11.015760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8c54a-64aa-489a-a630-08f30f172980 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:11.044341 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a212fee-14fc-4886-bf0b-f053df6a03b3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:11.060490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:11.062546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32fe21-09e8-41d7-a89d-e27e541409b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:11.063218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32fe21-09e8-41d7-a89d-e27e541409b2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:11.063687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32fe21-09e8-41d7-a89d-e27e541409b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:11.064071 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32fe21-09e8-41d7-a89d-e27e541409b2 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:11.064848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32fe21-09e8-41d7-a89d-e27e541409b2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:11.065147 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32fe21-09e8-41d7-a89d-e27e541409b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:11.068085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32fe21-09e8-41d7-a89d-e27e541409b2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:11.094289 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 335/671] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 13 01:06:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:11.094289 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32fe21-09e8-41d7-a89d-e27e541409b2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:11.098537 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4da54-85f7-4996-8278-1f61a6787eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:11.099766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4da54-85f7-4996-8278-1f61a6787eaf None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:11.100224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4da54-85f7-4996-8278-1f61a6787eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:11.100702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4da54-85f7-4996-8278-1f61a6787eaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:11.115861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4da54-85f7-4996-8278-1f61a6787eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:11.117342 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4da54-85f7-4996-8278-1f61a6787eaf None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-4ab4da54-85f7-4996-8278-1f61a6787eaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:11.137761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:11.138768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:11.139756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:11.139756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:11.139756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:11.143539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 337/672] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:11.144589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4da54-85f7-4996-8278-1f61a6787eaf None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:11.223309 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:11.232929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32fe21-09e8-41d7-a89d-e27e541409b2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:11.287482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4da54-85f7-4996-8278-1f61a6787eaf None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:11.289227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee060a5-491d-40aa-adec-42fd8c074034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:11.290961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee060a5-491d-40aa-adec-42fd8c074034 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:11.291420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee060a5-491d-40aa-adec-42fd8c074034 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:11.291862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee060a5-491d-40aa-adec-42fd8c074034 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:11.301148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee060a5-491d-40aa-adec-42fd8c074034 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:11.303551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee060a5-491d-40aa-adec-42fd8c074034 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:11.320671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-cee060a5-491d-40aa-adec-42fd8c074034 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:11.320671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:11.320671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:11.320671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:11.320671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:11.320671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:11.320671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:11.320671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:11.320671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:11.320671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:11.320671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:11.320671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:11.320671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:11.320671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:11.320671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:11.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:11.322850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:11.322850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:11.322850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:11.322850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:11.322850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:11.322850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:11.322850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:11.322850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:11.329399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 336/673] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:11.329399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee060a5-491d-40aa-adec-42fd8c074034 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:11.333593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f03bce-d041-4bf9-9328-d2783f685944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:11.334868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f03bce-d041-4bf9-9328-d2783f685944 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:11.334868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f03bce-d041-4bf9-9328-d2783f685944 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:11.334868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f03bce-d041-4bf9-9328-d2783f685944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:11.371262 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:11.420393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f03bce-d041-4bf9-9328-d2783f685944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:11.422376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f03bce-d041-4bf9-9328-d2783f685944 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:11.447027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee060a5-491d-40aa-adec-42fd8c074034 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:11.483605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc85ff5-ea24-4168-a8c8-4f52fa4193be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:11.484314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc85ff5-ea24-4168-a8c8-4f52fa4193be None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:11.484699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc85ff5-ea24-4168-a8c8-4f52fa4193be None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:11.485101 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc85ff5-ea24-4168-a8c8-4f52fa4193be None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:11.485741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc85ff5-ea24-4168-a8c8-4f52fa4193be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:11.486180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc85ff5-ea24-4168-a8c8-4f52fa4193be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:11.488186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc85ff5-ea24-4168-a8c8-4f52fa4193be None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:11.501069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 337/674] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:11.502040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc85ff5-ea24-4168-a8c8-4f52fa4193be None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:11.523107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:11.548235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 338/675] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:06:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:06:11.549415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f03bce-d041-4bf9-9328-d2783f685944 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:11.611166 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc85ff5-ea24-4168-a8c8-4f52fa4193be None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:11.619089 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:11.649364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6d3e5-35ec-4011-b420-3a9e0d0838ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:11.649981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6d3e5-35ec-4011-b420-3a9e0d0838ed None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:11.650331 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6d3e5-35ec-4011-b420-3a9e0d0838ed None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:11.650698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6d3e5-35ec-4011-b420-3a9e0d0838ed None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:11.651649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6d3e5-35ec-4011-b420-3a9e0d0838ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:11.652025 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6d3e5-35ec-4011-b420-3a9e0d0838ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:11.653516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6d3e5-35ec-4011-b420-3a9e0d0838ed None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:11.663377 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f03bce-d041-4bf9-9328-d2783f685944 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:11.670312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 338/676] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:11.670312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6d3e5-35ec-4011-b420-3a9e0d0838ed None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:11.712305 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94631e-7054-46b8-8053-8f2ae37efab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:11.713068 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94631e-7054-46b8-8053-8f2ae37efab6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:11.713346 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94631e-7054-46b8-8053-8f2ae37efab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:11.713616 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94631e-7054-46b8-8053-8f2ae37efab6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:11.724081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94631e-7054-46b8-8053-8f2ae37efab6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:11.726074 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94631e-7054-46b8-8053-8f2ae37efab6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-af94631e-7054-46b8-8053-8f2ae37efab6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:11.741813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:11.743209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:11.744190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:11.744190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:11.744190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:11.744190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:11.744190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:11.744190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:11.744190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:11.744190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:11.744190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 01:06:11.744190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:11.744190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 339/677] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:06:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:11.744824 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94631e-7054-46b8-8053-8f2ae37efab6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:11.780685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:11.807083 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6d3e5-35ec-4011-b420-3a9e0d0838ed None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:11.854682 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858564cc-f3c4-4ddc-9f6d-9a4e66396e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:11.855972 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858564cc-f3c4-4ddc-9f6d-9a4e66396e95 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:11.856940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858564cc-f3c4-4ddc-9f6d-9a4e66396e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:11.857438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858564cc-f3c4-4ddc-9f6d-9a4e66396e95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:11.872251 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858564cc-f3c4-4ddc-9f6d-9a4e66396e95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:11.874516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858564cc-f3c4-4ddc-9f6d-9a4e66396e95 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:11.875603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94631e-7054-46b8-8053-8f2ae37efab6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-858564cc-f3c4-4ddc-9f6d-9a4e66396e95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:11.891824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:11.892824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:11.893737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:11.893737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:11.893737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:11.893737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 339/678] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:11.894648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858564cc-f3c4-4ddc-9f6d-9a4e66396e95 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:11.910539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:11.925065 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a8126-55e9-4d91-9be2-d5b61effeaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:11.926365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a8126-55e9-4d91-9be2-d5b61effeaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:11.926973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a8126-55e9-4d91-9be2-d5b61effeaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:11.927625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a8126-55e9-4d91-9be2-d5b61effeaa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:11.928722 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a8126-55e9-4d91-9be2-d5b61effeaa1 None admin] RBAC: Adding query filter params (role.id=e55e17c894314bc6a5772b2de35b4874, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=ff33b1a82c4c42f6ab4a0588d5b616db) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:11.929374 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a8126-55e9-4d91-9be2-d5b61effeaa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:11.931167 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a8126-55e9-4d91-9be2-d5b61effeaa1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:11.938572 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 340/679] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:06:11 2022] GET /identity/v3/role_assignments?user.id=ff33b1a82c4c42f6ab4a0588d5b616db&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=e55e17c894314bc6a5772b2de35b4874 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:11.940006 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a8126-55e9-4d91-9be2-d5b61effeaa1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:12.083108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a8126-55e9-4d91-9be2-d5b61effeaa1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:12.117328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858564cc-f3c4-4ddc-9f6d-9a4e66396e95 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:12.131688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e3c69-aeb8-48c3-b1c9-6948dc7aa16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:12.132312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e3c69-aeb8-48c3-b1c9-6948dc7aa16a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:12.132561 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e3c69-aeb8-48c3-b1c9-6948dc7aa16a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:12.132836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e3c69-aeb8-48c3-b1c9-6948dc7aa16a None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:12.135789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e3c69-aeb8-48c3-b1c9-6948dc7aa16a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:12.136099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e3c69-aeb8-48c3-b1c9-6948dc7aa16a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:12.137522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e3c69-aeb8-48c3-b1c9-6948dc7aa16a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:12.158304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 341/680] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:12.163783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:12.164924 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e3c69-aeb8-48c3-b1c9-6948dc7aa16a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:12.172009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc94501-2e4f-4599-9da1-4dd50491edcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:12.174760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc94501-2e4f-4599-9da1-4dd50491edcf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:12.175590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc94501-2e4f-4599-9da1-4dd50491edcf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:12.175923 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc94501-2e4f-4599-9da1-4dd50491edcf None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:12.176670 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc94501-2e4f-4599-9da1-4dd50491edcf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:12.179480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc94501-2e4f-4599-9da1-4dd50491edcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:12.181141 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc94501-2e4f-4599-9da1-4dd50491edcf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:12.208602 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 340/681] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Sep 13 01:06:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:12.211568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc94501-2e4f-4599-9da1-4dd50491edcf None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:12.233443 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:12.294519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e3c69-aeb8-48c3-b1c9-6948dc7aa16a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:12.339107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16867ad5-9cb7-4137-b486-9709e6e4891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:12.339107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16867ad5-9cb7-4137-b486-9709e6e4891d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:12.339107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16867ad5-9cb7-4137-b486-9709e6e4891d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:12.339107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16867ad5-9cb7-4137-b486-9709e6e4891d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:12.345591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16867ad5-9cb7-4137-b486-9709e6e4891d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:12.346417 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc94501-2e4f-4599-9da1-4dd50491edcf None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:12.347256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16867ad5-9cb7-4137-b486-9709e6e4891d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:12.363401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-16867ad5-9cb7-4137-b486-9709e6e4891d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:12.363401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:12.363401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:12.363401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:12.363401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:12.363401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:12.363401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:12.363401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:12.363401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:12.363401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:12.363401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:12.363401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:12.363401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:12.363401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:12.363401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:12.364521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:12.365863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:12.365863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:12.365863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:12.365863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:12.365863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:12.365863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:12.365863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:12.365863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:12.365863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 342/682] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:12.371024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16867ad5-9cb7-4137-b486-9709e6e4891d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:12.401343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a12022-a2a3-4ccc-904c-f6ed62c7553b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:12.401880 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a12022-a2a3-4ccc-904c-f6ed62c7553b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:12.402156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a12022-a2a3-4ccc-904c-f6ed62c7553b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:12.402427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a12022-a2a3-4ccc-904c-f6ed62c7553b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:12.504784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:12.518570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a12022-a2a3-4ccc-904c-f6ed62c7553b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:12.519024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16867ad5-9cb7-4137-b486-9709e6e4891d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:12.520901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a12022-a2a3-4ccc-904c-f6ed62c7553b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:12.528842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:12.555508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff1b56-26d0-4970-bd63-83333eefbf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:12.556112 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff1b56-26d0-4970-bd63-83333eefbf51 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:12.556388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff1b56-26d0-4970-bd63-83333eefbf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:12.556654 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff1b56-26d0-4970-bd63-83333eefbf51 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:12.557339 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff1b56-26d0-4970-bd63-83333eefbf51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:12.557640 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff1b56-26d0-4970-bd63-83333eefbf51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:12.559089 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff1b56-26d0-4970-bd63-83333eefbf51 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:12.571969 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 343/683] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:12.578388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdbb2d-7e20-4fc8-a4f2-1ef92810fddd None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:12.578668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdbb2d-7e20-4fc8-a4f2-1ef92810fddd None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:12.578939 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdbb2d-7e20-4fc8-a4f2-1ef92810fddd None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:12.580468 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 344/684] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:12.581172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdbb2d-7e20-4fc8-a4f2-1ef92810fddd None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:12.658847 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 341/685] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:06:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:06:12.664207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4054e-6157-44a8-bb2a-27c73e43d837 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:12.664207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4054e-6157-44a8-bb2a-27c73e43d837 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:12.664207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4054e-6157-44a8-bb2a-27c73e43d837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:12.684190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9fc4054e-6157-44a8-bb2a-27c73e43d837 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:12.685702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9fc4054e-6157-44a8-bb2a-27c73e43d837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:12.704446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdbb2d-7e20-4fc8-a4f2-1ef92810fddd None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:12.742948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52369fe1-a536-412c-b618-890facbe7f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:12.743944 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52369fe1-a536-412c-b618-890facbe7f79 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:12.744500 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52369fe1-a536-412c-b618-890facbe7f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:12.744996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52369fe1-a536-412c-b618-890facbe7f79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:12.746094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52369fe1-a536-412c-b618-890facbe7f79 None admin] RBAC: Adding query filter params (role.id=e55e17c894314bc6a5772b2de35b4874, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=a672e63fa5e345679bac3d67301fe875) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:12.746633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52369fe1-a536-412c-b618-890facbe7f79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:12.748288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52369fe1-a536-412c-b618-890facbe7f79 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:12.756146 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 345/686] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:06:12 2022] GET /identity/v3/role_assignments?user.id=a672e63fa5e345679bac3d67301fe875&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=e55e17c894314bc6a5772b2de35b4874 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:12.757533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52369fe1-a536-412c-b618-890facbe7f79 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:12.775467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 342/687] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:06:12.817200 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:12.914968 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52369fe1-a536-412c-b618-890facbe7f79 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:12.952761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf1cb8-78c7-41bd-84e7-e1fa73036ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:12.953767 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf1cb8-78c7-41bd-84e7-e1fa73036ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:12.954256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf1cb8-78c7-41bd-84e7-e1fa73036ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:12.954728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf1cb8-78c7-41bd-84e7-e1fa73036ca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:12.967011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf1cb8-78c7-41bd-84e7-e1fa73036ca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:12.968747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf1cb8-78c7-41bd-84e7-e1fa73036ca5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-0fcf1cb8-78c7-41bd-84e7-e1fa73036ca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:12.984529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:12.985521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:12.986442 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:12.986442 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:12.986442 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:12.993092 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 346/688] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:12.994787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4054e-6157-44a8-bb2a-27c73e43d837 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:13.022371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:13.107804 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4054e-6157-44a8-bb2a-27c73e43d837 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:13.141849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ea583-8f80-46ec-8060-68066a6ac0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:13.142467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ea583-8f80-46ec-8060-68066a6ac0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:13.142746 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ea583-8f80-46ec-8060-68066a6ac0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:13.143021 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ea583-8f80-46ec-8060-68066a6ac0f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:13.143706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ea583-8f80-46ec-8060-68066a6ac0f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:13.144676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ea583-8f80-46ec-8060-68066a6ac0f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:13.146092 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ea583-8f80-46ec-8060-68066a6ac0f3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:13.159345 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 343/689] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:13.165503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf1cb8-78c7-41bd-84e7-e1fa73036ca5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:13.186181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ea583-8f80-46ec-8060-68066a6ac0f3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:13.307846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:13.314038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:13.325688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf1cb8-78c7-41bd-84e7-e1fa73036ca5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:13.337218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ea583-8f80-46ec-8060-68066a6ac0f3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:13.361608 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd2ca-6547-49a5-9940-9345b697ce50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:13.362250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd2ca-6547-49a5-9940-9345b697ce50 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:13.362569 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd2ca-6547-49a5-9940-9345b697ce50 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:13.362881 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd2ca-6547-49a5-9940-9345b697ce50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:13.369964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dd2ca-6547-49a5-9940-9345b697ce50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:13.371534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dd2ca-6547-49a5-9940-9345b697ce50 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:13.372901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18159692-c3ca-4d9f-8c25-ee3532683234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:13.373648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18159692-c3ca-4d9f-8c25-ee3532683234 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:13.373958 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18159692-c3ca-4d9f-8c25-ee3532683234 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:13.374299 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18159692-c3ca-4d9f-8c25-ee3532683234 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:13.384040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-b31dd2ca-6547-49a5-9940-9345b697ce50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:13.384040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:13.384040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:13.384040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:13.384040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:13.384040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:13.384040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:13.384040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:13.384040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:13.384040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:13.384040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:13.384040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:13.384040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:13.384040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:13.384040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:13.384934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:13.386224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:13.386224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:13.386224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:13.386224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:13.386224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:13.386224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:13.386224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:13.386224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:13.386645 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18159692-c3ca-4d9f-8c25-ee3532683234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:13.386727 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 347/690] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:13.386727 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2ce89-1d66-494d-a92d-ce50aeee5fec None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:13.387106 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2ce89-1d66-494d-a92d-ce50aeee5fec None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:13.388202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2ce89-1d66-494d-a92d-ce50aeee5fec None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-18159692-c3ca-4d9f-8c25-ee3532683234 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:13.390576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:13.392321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:13.393523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:13.393523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:13.393523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:13.393523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:13.393523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:13.393523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:13.393523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:13.393523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:13.393523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:13.393523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:13.393523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:06:13.393523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:13.393523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 344/692] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:06:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:13.394460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 348/692] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:13.396294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8b651-fb2d-49fc-92c5-7a650ce2e288 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:13.396294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8b651-fb2d-49fc-92c5-7a650ce2e288 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:13.396294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8b651-fb2d-49fc-92c5-7a650ce2e288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:13.398322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2ce89-1d66-494d-a92d-ce50aeee5fec None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:13.415128 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-72b8b651-fb2d-49fc-92c5-7a650ce2e288 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:13.416636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-72b8b651-fb2d-49fc-92c5-7a650ce2e288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:13.489126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 345/693] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:06:13.490097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8b651-fb2d-49fc-92c5-7a650ce2e288 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:13.523965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2ce89-1d66-494d-a92d-ce50aeee5fec None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:13.602789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:13.620682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e011b1f-1501-4a6f-be5b-50e33eb519db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:13.621307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e011b1f-1501-4a6f-be5b-50e33eb519db None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:13.621583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e011b1f-1501-4a6f-be5b-50e33eb519db None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:13.621853 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e011b1f-1501-4a6f-be5b-50e33eb519db None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:13.622547 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e011b1f-1501-4a6f-be5b-50e33eb519db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:13.622851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e011b1f-1501-4a6f-be5b-50e33eb519db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:13.624324 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e011b1f-1501-4a6f-be5b-50e33eb519db None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:13.644382 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8b651-fb2d-49fc-92c5-7a650ce2e288 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:13.657280 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 349/694] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:13.663016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e011b1f-1501-4a6f-be5b-50e33eb519db None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:13.677888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:13.704988 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9aaec2-0a62-4125-9069-625234883e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:13.714490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aaec2-0a62-4125-9069-625234883e00 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:13.714958 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aaec2-0a62-4125-9069-625234883e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:13.715406 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aaec2-0a62-4125-9069-625234883e00 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:13.717686 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9aaec2-0a62-4125-9069-625234883e00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:13.718156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9aaec2-0a62-4125-9069-625234883e00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:13.720799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9aaec2-0a62-4125-9069-625234883e00 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:13.742658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 346/695] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:06:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:13.747371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9aaec2-0a62-4125-9069-625234883e00 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:13.823027 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e011b1f-1501-4a6f-be5b-50e33eb519db None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:13.857809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd24330-4b9c-40f7-b7ff-3459b8f96c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:13.858423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd24330-4b9c-40f7-b7ff-3459b8f96c2d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:13.858786 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd24330-4b9c-40f7-b7ff-3459b8f96c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:13.858964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd24330-4b9c-40f7-b7ff-3459b8f96c2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:13.859728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd24330-4b9c-40f7-b7ff-3459b8f96c2d None admin] RBAC: Adding query filter params (role.id=e55e17c894314bc6a5772b2de35b4874, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=e2414e53593b4e2084c895651fd0d0e5) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:13.860039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd24330-4b9c-40f7-b7ff-3459b8f96c2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:13.861501 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd24330-4b9c-40f7-b7ff-3459b8f96c2d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:13.868322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 350/696] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:06:13 2022] GET /identity/v3/role_assignments?user.id=e2414e53593b4e2084c895651fd0d0e5&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=e55e17c894314bc6a5772b2de35b4874 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:13.869189 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd24330-4b9c-40f7-b7ff-3459b8f96c2d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:13.883708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9aaec2-0a62-4125-9069-625234883e00 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:13.926377 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:13.937795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3100f-8d12-475e-a6fe-9a82669799f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:13.938648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3100f-8d12-475e-a6fe-9a82669799f2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:13.939156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3100f-8d12-475e-a6fe-9a82669799f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:13.939759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3100f-8d12-475e-a6fe-9a82669799f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:13.956678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3100f-8d12-475e-a6fe-9a82669799f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:13.957183 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:13.959260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3100f-8d12-475e-a6fe-9a82669799f2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:13.980437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd24330-4b9c-40f7-b7ff-3459b8f96c2d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-5ab3100f-8d12-475e-a6fe-9a82669799f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:13.983747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:13.984676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:13.985573 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:13.985573 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:13.985573 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:13.987817 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 347/697] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:13.997789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3100f-8d12-475e-a6fe-9a82669799f2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:14.051922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b09620-5439-417a-bafe-3b065e25800f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:14.051922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b09620-5439-417a-bafe-3b065e25800f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:14.052666 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b09620-5439-417a-bafe-3b065e25800f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:14.055214 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b09620-5439-417a-bafe-3b065e25800f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:14.074691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b09620-5439-417a-bafe-3b065e25800f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:14.078959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b09620-5439-417a-bafe-3b065e25800f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-c8b09620-5439-417a-bafe-3b065e25800f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:14.109115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:14.110172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:14.111055 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:14.111055 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:14.111055 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:14.117669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 351/698] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:14.118562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b09620-5439-417a-bafe-3b065e25800f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:14.201853 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3100f-8d12-475e-a6fe-9a82669799f2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:14.238401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b09620-5439-417a-bafe-3b065e25800f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:14.241603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7da48-62fc-4b57-9255-66ea99d1c96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:14.242753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7da48-62fc-4b57-9255-66ea99d1c96f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:14.242753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7da48-62fc-4b57-9255-66ea99d1c96f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:14.242976 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7da48-62fc-4b57-9255-66ea99d1c96f None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:14.243527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7da48-62fc-4b57-9255-66ea99d1c96f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:14.243831 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7da48-62fc-4b57-9255-66ea99d1c96f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:14.245198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7da48-62fc-4b57-9255-66ea99d1c96f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:14.259756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 348/699] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:14.267639 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7da48-62fc-4b57-9255-66ea99d1c96f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:14.268118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:14.289791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e9c29-0906-452f-8949-29d3b581d147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:14.290573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e9c29-0906-452f-8949-29d3b581d147 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:14.290948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e9c29-0906-452f-8949-29d3b581d147 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:14.291335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e9c29-0906-452f-8949-29d3b581d147 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:14.292052 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e9c29-0906-452f-8949-29d3b581d147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:14.292420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e9c29-0906-452f-8949-29d3b581d147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:14.293873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e9c29-0906-452f-8949-29d3b581d147 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:14.308731 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 352/700] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:14.314093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e9c29-0906-452f-8949-29d3b581d147 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:14.329820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:14.399953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7da48-62fc-4b57-9255-66ea99d1c96f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:14.449565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3e3df-f084-4ddc-9957-5678db9612a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:14.450210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3e3df-f084-4ddc-9957-5678db9612a3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:14.450753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3e3df-f084-4ddc-9957-5678db9612a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:14.451034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3e3df-f084-4ddc-9957-5678db9612a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:14.462590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3e3df-f084-4ddc-9957-5678db9612a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:14.463995 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3e3df-f084-4ddc-9957-5678db9612a3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-dcb3e3df-f084-4ddc-9957-5678db9612a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:14.485084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:14.486127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:14.487138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:14.487138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:14.487138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:14.487138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:14.487138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:14.487138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:14.487138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:14.487138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:14.487138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:06:14.487138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:14.495089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 349/701] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 13 01:06:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:14.496124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3e3df-f084-4ddc-9957-5678db9612a3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:14.502948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e9c29-0906-452f-8949-29d3b581d147 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:14.540195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8af46a-aca1-43aa-8040-ed87a101fde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:14.540924 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af46a-aca1-43aa-8040-ed87a101fde0 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:14.541201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af46a-aca1-43aa-8040-ed87a101fde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:14.541567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af46a-aca1-43aa-8040-ed87a101fde0 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:14.542218 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8af46a-aca1-43aa-8040-ed87a101fde0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:14.543810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8af46a-aca1-43aa-8040-ed87a101fde0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:14.582646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 353/702] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:06:14 2022] POST /identity/v3/users => generated 254 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:06:14.648274 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3e3df-f084-4ddc-9957-5678db9612a3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:14.650033 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:14.688348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48006842-8cdd-4598-9fdc-b35f62391f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:14.688992 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48006842-8cdd-4598-9fdc-b35f62391f3f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:14.689275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48006842-8cdd-4598-9fdc-b35f62391f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:14.689551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48006842-8cdd-4598-9fdc-b35f62391f3f None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:14.690322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48006842-8cdd-4598-9fdc-b35f62391f3f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:14.691253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48006842-8cdd-4598-9fdc-b35f62391f3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:14.692744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48006842-8cdd-4598-9fdc-b35f62391f3f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:14.715449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 350/703] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 13 01:06:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:14.724477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8af46a-aca1-43aa-8040-ed87a101fde0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:14.785309 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:14.838542 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a4a7d-4bf4-4183-abfe-03b854d64a0e None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:14.839508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a4a7d-4bf4-4183-abfe-03b854d64a0e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:14.840049 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a4a7d-4bf4-4183-abfe-03b854d64a0e None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:14.841635 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 351/704] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:14.847370 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6015e74-bc98-4e1a-b674-b6ca3dcd061f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:14.847888 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6015e74-bc98-4e1a-b674-b6ca3dcd061f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:14.848267 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6015e74-bc98-4e1a-b674-b6ca3dcd061f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:14.874171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a6015e74-bc98-4e1a-b674-b6ca3dcd061f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:14.875337 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a6015e74-bc98-4e1a-b674-b6ca3dcd061f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:14.877250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8af46a-aca1-43aa-8040-ed87a101fde0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:14.920894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e7b4f-5b3d-4c2b-bb98-70709196bd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:14.921472 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e7b4f-5b3d-4c2b-bb98-70709196bd68 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:14.921751 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e7b4f-5b3d-4c2b-bb98-70709196bd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:14.922023 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e7b4f-5b3d-4c2b-bb98-70709196bd68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:14.968267 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 352/705] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:06:15.001273 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e7b4f-5b3d-4c2b-bb98-70709196bd68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:15.002740 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e7b4f-5b3d-4c2b-bb98-70709196bd68 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:15.041953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:15.125226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 354/706] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:06:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:06:15.131213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6015e74-bc98-4e1a-b674-b6ca3dcd061f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:15.276828 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:15.293038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6015e74-bc98-4e1a-b674-b6ca3dcd061f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:15.335220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790068b-520f-48bf-85fc-8ec36e46c900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:15.335865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790068b-520f-48bf-85fc-8ec36e46c900 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:15.336148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790068b-520f-48bf-85fc-8ec36e46c900 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:15.336425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790068b-520f-48bf-85fc-8ec36e46c900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:15.347835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790068b-520f-48bf-85fc-8ec36e46c900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:15.349475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790068b-520f-48bf-85fc-8ec36e46c900 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c790068b-520f-48bf-85fc-8ec36e46c900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:15.377515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:15.378887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:15.379922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:15.379922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:15.379922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:15.379922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 353/707] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:15.386410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e7b4f-5b3d-4c2b-bb98-70709196bd68 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:15.389429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790068b-520f-48bf-85fc-8ec36e46c900 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:15.496481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790068b-520f-48bf-85fc-8ec36e46c900 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:15.530799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e33558-e47d-4774-807f-acb9a578d820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:15.531386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e33558-e47d-4774-807f-acb9a578d820 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:15.531671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e33558-e47d-4774-807f-acb9a578d820 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:15.531962 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e33558-e47d-4774-807f-acb9a578d820 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:15.532544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e33558-e47d-4774-807f-acb9a578d820 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:15.533910 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e33558-e47d-4774-807f-acb9a578d820 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-81e33558-e47d-4774-807f-acb9a578d820 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:15.545711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:15.546982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:15.548008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:15.548008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:15.548008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:15.548008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:15.548008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:15.548008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:15.548008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:15.548008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:15.548008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:15.548008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:15.548008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:15.548008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:15.548008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 01:06:15.548008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:15.548008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 354/708] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Sep 13 01:06:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:15.548801 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82f45f-07b9-49c2-a5ea-f3305bdf73d7 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:15.548801 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82f45f-07b9-49c2-a5ea-f3305bdf73d7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:15.548801 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82f45f-07b9-49c2-a5ea-f3305bdf73d7 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:15.558772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 355/709] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:15.558772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82f45f-07b9-49c2-a5ea-f3305bdf73d7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:15.564418 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:15.566856 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e7b4f-5b3d-4c2b-bb98-70709196bd68 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:15.609554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90763132-afcb-46c3-9a8e-f51963150e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:15.610161 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90763132-afcb-46c3-9a8e-f51963150e40 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:15.610445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90763132-afcb-46c3-9a8e-f51963150e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:15.610721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90763132-afcb-46c3-9a8e-f51963150e40 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:15.611412 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90763132-afcb-46c3-9a8e-f51963150e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:15.611718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90763132-afcb-46c3-9a8e-f51963150e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:15.613295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90763132-afcb-46c3-9a8e-f51963150e40 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:15.615643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:15.626495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 355/710] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:15.627844 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a2601-418a-485b-8572-9c8fb2d37852 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:15.628711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a2601-418a-485b-8572-9c8fb2d37852 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:15.629094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a2601-418a-485b-8572-9c8fb2d37852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:15.647677 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4a7a2601-418a-485b-8572-9c8fb2d37852 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:15.648890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4a7a2601-418a-485b-8572-9c8fb2d37852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:15.679545 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82f45f-07b9-49c2-a5ea-f3305bdf73d7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:15.719763 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8f48e-1b68-4703-805b-78e5617f4373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:15.720434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8f48e-1b68-4703-805b-78e5617f4373 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:15.720742 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8f48e-1b68-4703-805b-78e5617f4373 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:15.721016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8f48e-1b68-4703-805b-78e5617f4373 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:15.721703 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8f48e-1b68-4703-805b-78e5617f4373 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:15.722120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8f48e-1b68-4703-805b-78e5617f4373 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:15.723743 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8f48e-1b68-4703-805b-78e5617f4373 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:15.729407 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 356/711] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:06:15.730472 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a2601-418a-485b-8572-9c8fb2d37852 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:15.734704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 356/712] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 13 01:06:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:15.740397 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8f48e-1b68-4703-805b-78e5617f4373 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:15.844529 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:15.875783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a2601-418a-485b-8572-9c8fb2d37852 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:15.909510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:15.914931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8f48e-1b68-4703-805b-78e5617f4373 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:15.928567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d588b2-8d37-45b4-a941-e5ab09ffc25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:15.929201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d588b2-8d37-45b4-a941-e5ab09ffc25b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:15.929474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d588b2-8d37-45b4-a941-e5ab09ffc25b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:15.929744 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d588b2-8d37-45b4-a941-e5ab09ffc25b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:15.939717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d588b2-8d37-45b4-a941-e5ab09ffc25b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:15.941483 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d588b2-8d37-45b4-a941-e5ab09ffc25b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:15.964323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-17d588b2-8d37-45b4-a941-e5ab09ffc25b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:15.964323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:15.964323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:15.964323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:15.964323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:15.964323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:15.964323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:15.964323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:15.964323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:15.964323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:15.964323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:15.964323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:15.964323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:15.964323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:15.964323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:15.965251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:15.966248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:15.966248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:15.966248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:15.966248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:15.966248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:15.966248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:15.966248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:15.966248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:15.966248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 357/713] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:15.974032 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d588b2-8d37-45b4-a941-e5ab09ffc25b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:15.988551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fc2a6-b07e-4347-a746-79af36011397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:15.989287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fc2a6-b07e-4347-a746-79af36011397 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:15.989562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fc2a6-b07e-4347-a746-79af36011397 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:15.989832 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fc2a6-b07e-4347-a746-79af36011397 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:15.990484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fc2a6-b07e-4347-a746-79af36011397 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:15.990757 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fc2a6-b07e-4347-a746-79af36011397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:15.993897 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fc2a6-b07e-4347-a746-79af36011397 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:16.006468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 357/714] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 13 01:06:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:16.102607 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fc2a6-b07e-4347-a746-79af36011397 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:16.133954 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d588b2-8d37-45b4-a941-e5ab09ffc25b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:16.173601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d511a-f043-467b-8a4a-72b6810fcb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:16.174625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d511a-f043-467b-8a4a-72b6810fcb40 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:16.175480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d511a-f043-467b-8a4a-72b6810fcb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:16.175779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d511a-f043-467b-8a4a-72b6810fcb40 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:16.176477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d511a-f043-467b-8a4a-72b6810fcb40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:16.176782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d511a-f043-467b-8a4a-72b6810fcb40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:16.178234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d511a-f043-467b-8a4a-72b6810fcb40 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:16.194079 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 358/715] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:16.203757 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d511a-f043-467b-8a4a-72b6810fcb40 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:16.265334 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fc2a6-b07e-4347-a746-79af36011397 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:16.266043 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:16.303013 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cc07c-8df6-4067-8c8d-427ff32115e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:16.303694 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cc07c-8df6-4067-8c8d-427ff32115e3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:16.303977 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cc07c-8df6-4067-8c8d-427ff32115e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:16.304254 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cc07c-8df6-4067-8c8d-427ff32115e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:16.304850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cc07c-8df6-4067-8c8d-427ff32115e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:16.306223 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cc07c-8df6-4067-8c8d-427ff32115e3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:16.308129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-2c5cc07c-8df6-4067-8c8d-427ff32115e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:16.316789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:16.317904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:16.318913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:16.318913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:16.318913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:16.318913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:16.318913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:16.318913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:16.318913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:16.318913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:16.318913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:16.318913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:16.318913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:16.318913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:16.318913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 01:06:16.318913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:16.318913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 358/716] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:16 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:16.326016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cc07c-8df6-4067-8c8d-427ff32115e3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:16.333617 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d511a-f043-467b-8a4a-72b6810fcb40 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:16.369570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549c51b-4e61-43cd-8bc9-21e72dfc76a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:16.370102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549c51b-4e61-43cd-8bc9-21e72dfc76a9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:16.370382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549c51b-4e61-43cd-8bc9-21e72dfc76a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:16.370657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549c51b-4e61-43cd-8bc9-21e72dfc76a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:16.371533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549c51b-4e61-43cd-8bc9-21e72dfc76a9 None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=fadc83bec6be41979e1aa4d71f8fc2bd) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:16.371846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549c51b-4e61-43cd-8bc9-21e72dfc76a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:16.373288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549c51b-4e61-43cd-8bc9-21e72dfc76a9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:16.380082 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 359/717] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:06:16 2022] GET /identity/v3/role_assignments?user.id=fadc83bec6be41979e1aa4d71f8fc2bd&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=3799feb4caa64e568971222375957f54 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:16.513550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cc07c-8df6-4067-8c8d-427ff32115e3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:16.562650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597406ea-8ae3-4dab-ae5b-509118ebe700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:16.563355 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597406ea-8ae3-4dab-ae5b-509118ebe700 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:16.563642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597406ea-8ae3-4dab-ae5b-509118ebe700 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:16.563964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597406ea-8ae3-4dab-ae5b-509118ebe700 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:16.564554 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597406ea-8ae3-4dab-ae5b-509118ebe700 None admin] RBAC: Adding query filter params (name=network) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:16.564859 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597406ea-8ae3-4dab-ae5b-509118ebe700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:16.566785 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597406ea-8ae3-4dab-ae5b-509118ebe700 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:16.575197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 359/718] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 13 01:06:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:16.581539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549c51b-4e61-43cd-8bc9-21e72dfc76a9 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:16.693713 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549c51b-4e61-43cd-8bc9-21e72dfc76a9 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:16.704729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:16.731491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3ef2a-9eb1-4ccb-87c9-51d4645acd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:16.732143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3ef2a-9eb1-4ccb-87c9-51d4645acd57 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:16.732428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3ef2a-9eb1-4ccb-87c9-51d4645acd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:16.732701 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3ef2a-9eb1-4ccb-87c9-51d4645acd57 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:16.733339 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3ef2a-9eb1-4ccb-87c9-51d4645acd57 None admin] RBAC: Adding query filter params (type=network) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:16.733645 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3ef2a-9eb1-4ccb-87c9-51d4645acd57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:16.735018 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3ef2a-9eb1-4ccb-87c9-51d4645acd57 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:16.741842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 360/719] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 13 01:06:16 2022] GET /identity/v3/services?type=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:17.092316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f54f2b-b263-4a32-915a-83e77edb3da1 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:17.092707 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f54f2b-b263-4a32-915a-83e77edb3da1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:17.092911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f54f2b-b263-4a32-915a-83e77edb3da1 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:17.094546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 360/720] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:17.100944 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e9ecc-3950-4a9c-a006-7623c0d96b06 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:17.101239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e9ecc-3950-4a9c-a006-7623c0d96b06 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:17.101521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e9ecc-3950-4a9c-a006-7623c0d96b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:17.122005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-619e9ecc-3950-4a9c-a006-7623c0d96b06 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:17.123313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-619e9ecc-3950-4a9c-a006-7623c0d96b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:17.219300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 361/721] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:06:17.479599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e0bfb-8f7e-424f-9ecd-b89e77e13cc4 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:17.479933 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e0bfb-8f7e-424f-9ecd-b89e77e13cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:17.480151 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e0bfb-8f7e-424f-9ecd-b89e77e13cc4 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:17.481728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 361/722] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:17.487950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af466b65-be0d-4797-8d27-8d2dff370d8d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:17.488372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af466b65-be0d-4797-8d27-8d2dff370d8d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:17.488656 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af466b65-be0d-4797-8d27-8d2dff370d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:17.507626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-af466b65-be0d-4797-8d27-8d2dff370d8d None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:17.508833 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-af466b65-be0d-4797-8d27-8d2dff370d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:17.608663 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 362/723] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 01:06:17.671381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e0bfb-8f7e-424f-9ecd-b89e77e13cc4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:17.739676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:17.780555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e0bfb-8f7e-424f-9ecd-b89e77e13cc4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:17.815246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d942a5-2bb0-4662-9856-6449720dd98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:17.816423 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d942a5-2bb0-4662-9856-6449720dd98d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:17.816705 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d942a5-2bb0-4662-9856-6449720dd98d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:17.816978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d942a5-2bb0-4662-9856-6449720dd98d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:17.827337 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d942a5-2bb0-4662-9856-6449720dd98d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-04d942a5-2bb0-4662-9856-6449720dd98d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:17.832726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:17.833662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:17.834499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:17.834499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:17.834499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:17.834499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:17.834499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:17.834499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:17.834499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:17.834499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:17.834499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:17.834499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:17.834499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:06:17.834499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:17.834499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 362/724] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:06:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:17.840032 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af466b65-be0d-4797-8d27-8d2dff370d8d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:17.875857 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:17.959458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af466b65-be0d-4797-8d27-8d2dff370d8d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:18.008320 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e969c8-087d-4d70-ad27-10dff133aaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:18.008853 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e969c8-087d-4d70-ad27-10dff133aaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:18.009134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e969c8-087d-4d70-ad27-10dff133aaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:18.009409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e969c8-087d-4d70-ad27-10dff133aaf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:18.010074 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e969c8-087d-4d70-ad27-10dff133aaf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:18.010378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e969c8-087d-4d70-ad27-10dff133aaf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:18.011784 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e969c8-087d-4d70-ad27-10dff133aaf3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:18.025001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 363/725] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:06:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:18.030647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d942a5-2bb0-4662-9856-6449720dd98d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:18.153138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d942a5-2bb0-4662-9856-6449720dd98d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:18.178186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:18.189922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d387eb4-d757-4e23-9e66-7b4faf322fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:18.190812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d387eb4-d757-4e23-9e66-7b4faf322fbd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:18.191054 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d387eb4-d757-4e23-9e66-7b4faf322fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:18.191371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d387eb4-d757-4e23-9e66-7b4faf322fbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:18.202653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d387eb4-d757-4e23-9e66-7b4faf322fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:18.204130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d387eb4-d757-4e23-9e66-7b4faf322fbd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-3d387eb4-d757-4e23-9e66-7b4faf322fbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:18.219953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:18.220931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:18.221973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:18.221973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:18.221973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:18.221973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 363/726] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:18.227317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e969c8-087d-4d70-ad27-10dff133aaf3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:18.231805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d387eb4-d757-4e23-9e66-7b4faf322fbd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:18.346169 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d387eb4-d757-4e23-9e66-7b4faf322fbd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:18.381417 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cc278-a4ad-4d57-8b3f-8fcbed353322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:18.382065 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cc278-a4ad-4d57-8b3f-8fcbed353322 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:18.382348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cc278-a4ad-4d57-8b3f-8fcbed353322 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:18.382624 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cc278-a4ad-4d57-8b3f-8fcbed353322 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:18.393080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7cc278-a4ad-4d57-8b3f-8fcbed353322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-af7cc278-a4ad-4d57-8b3f-8fcbed353322 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:18.399040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:18.400077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:18.400978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:18.400978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:18.400978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:18.400978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:18.400978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:18.400978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:18.400978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:18.400978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:18.400978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:18.400978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:18.400978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:18.400978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:18.400978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 364/727] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:06:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:18.408868 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cc278-a4ad-4d57-8b3f-8fcbed353322 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:18.436721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e969c8-087d-4d70-ad27-10dff133aaf3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:18.447477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:18.479427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:18.507804 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e97d1-7798-4a3e-822b-8f7f045c64b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:18.508440 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e97d1-7798-4a3e-822b-8f7f045c64b1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:18.508721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e97d1-7798-4a3e-822b-8f7f045c64b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:18.508995 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e97d1-7798-4a3e-822b-8f7f045c64b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:18.509665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e97d1-7798-4a3e-822b-8f7f045c64b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:18.509974 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e97d1-7798-4a3e-822b-8f7f045c64b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:18.511454 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e97d1-7798-4a3e-822b-8f7f045c64b1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:18.535031 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 364/728] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:18.544084 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e97d1-7798-4a3e-822b-8f7f045c64b1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:18.577034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cc278-a4ad-4d57-8b3f-8fcbed353322 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:18.621089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec162bb-c344-4c5b-94af-0f9a36b03ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:18.622082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec162bb-c344-4c5b-94af-0f9a36b03ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:18.622567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec162bb-c344-4c5b-94af-0f9a36b03ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:18.623154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec162bb-c344-4c5b-94af-0f9a36b03ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:18.624043 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec162bb-c344-4c5b-94af-0f9a36b03ea3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:18.624549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec162bb-c344-4c5b-94af-0f9a36b03ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:18.626139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec162bb-c344-4c5b-94af-0f9a36b03ea3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:18.635958 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 365/729] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:06:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:18.637458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374ae00-f115-4683-a0e9-77caffaedab3 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:18.637952 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374ae00-f115-4683-a0e9-77caffaedab3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:18.638427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374ae00-f115-4683-a0e9-77caffaedab3 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:18.640363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 366/730] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:18.641338 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374ae00-f115-4683-a0e9-77caffaedab3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:18.693788 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e97d1-7798-4a3e-822b-8f7f045c64b1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:18.731431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b46310-6acf-4c19-ba77-fe5da44aedd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:18.732089 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b46310-6acf-4c19-ba77-fe5da44aedd1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:18.732410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b46310-6acf-4c19-ba77-fe5da44aedd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:18.732684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b46310-6acf-4c19-ba77-fe5da44aedd1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:18.742094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b46310-6acf-4c19-ba77-fe5da44aedd1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:18.743597 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b46310-6acf-4c19-ba77-fe5da44aedd1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:18.745680 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:18.753512 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374ae00-f115-4683-a0e9-77caffaedab3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-14b46310-6acf-4c19-ba77-fe5da44aedd1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:18.760062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:18.761035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:18.762005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:18.762005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:18.762005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:18.762005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:18.762005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:18.762005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:18.762005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:18.762005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:18.762005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 01:06:18.762005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:18.764377 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 365/731] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:06:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:18.765992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b5e31-c6f7-494b-98b2-3df00dfaa863 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:18.766472 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b5e31-c6f7-494b-98b2-3df00dfaa863 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:18.766946 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b5e31-c6f7-494b-98b2-3df00dfaa863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:18.787555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a23b5e31-c6f7-494b-98b2-3df00dfaa863 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:18.789021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a23b5e31-c6f7-494b-98b2-3df00dfaa863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:18.791171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e439e-6e90-4a65-bd2c-e3933d34f31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:18.791872 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e439e-6e90-4a65-bd2c-e3933d34f31b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:18.792228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e439e-6e90-4a65-bd2c-e3933d34f31b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:18.792575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e439e-6e90-4a65-bd2c-e3933d34f31b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:18.802707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:18.803996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e439e-6e90-4a65-bd2c-e3933d34f31b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:18.805472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e439e-6e90-4a65-bd2c-e3933d34f31b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-ee0e439e-6e90-4a65-bd2c-e3933d34f31b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:18.821379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:18.822378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:18.823697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:18.823697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:18.823697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:18.823697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 367/732] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:18.824285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e439e-6e90-4a65-bd2c-e3933d34f31b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:18.877226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 366/733] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:06:18.878873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b5e31-c6f7-494b-98b2-3df00dfaa863 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:18.962187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e439e-6e90-4a65-bd2c-e3933d34f31b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:18.998461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b5e31-c6f7-494b-98b2-3df00dfaa863 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:19.036005 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610e617-c970-429d-b48f-a81481ce625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:19.036724 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610e617-c970-429d-b48f-a81481ce625c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:19.037014 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610e617-c970-429d-b48f-a81481ce625c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:19.037295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610e617-c970-429d-b48f-a81481ce625c None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:19.038142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610e617-c970-429d-b48f-a81481ce625c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:19.038455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610e617-c970-429d-b48f-a81481ce625c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:19.043692 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610e617-c970-429d-b48f-a81481ce625c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:19.046728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f61dcc-6c58-4b32-b5e1-849a1a96266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:19.047589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f61dcc-6c58-4b32-b5e1-849a1a96266a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:19.048067 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f61dcc-6c58-4b32-b5e1-849a1a96266a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:19.048534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f61dcc-6c58-4b32-b5e1-849a1a96266a None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:19.050491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f61dcc-6c58-4b32-b5e1-849a1a96266a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:19.055505 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f61dcc-6c58-4b32-b5e1-849a1a96266a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:19.056922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f61dcc-6c58-4b32-b5e1-849a1a96266a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:19.068206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 368/734] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Sep 13 01:06:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:19.077545 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 367/735] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:19.078786 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610e617-c970-429d-b48f-a81481ce625c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:19.084312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f61dcc-6c58-4b32-b5e1-849a1a96266a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:19.089322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:19.100730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:19.228106 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610e617-c970-429d-b48f-a81481ce625c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:19.243151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f61dcc-6c58-4b32-b5e1-849a1a96266a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:19.272536 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f875ff-0e42-4dc2-b43a-19c11c8c9ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:19.273621 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f875ff-0e42-4dc2-b43a-19c11c8c9ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:19.274155 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f875ff-0e42-4dc2-b43a-19c11c8c9ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:19.274631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f875ff-0e42-4dc2-b43a-19c11c8c9ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:19.282512 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5e624-6a29-4c7a-a373-ac4c0d0418ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:19.283200 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5e624-6a29-4c7a-a373-ac4c0d0418ef None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:19.283485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5e624-6a29-4c7a-a373-ac4c0d0418ef None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:19.283763 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5e624-6a29-4c7a-a373-ac4c0d0418ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:19.293579 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5e624-6a29-4c7a-a373-ac4c0d0418ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:19.295168 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5e624-6a29-4c7a-a373-ac4c0d0418ef None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-8bf5e624-6a29-4c7a-a373-ac4c0d0418ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:19.307186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:19.308134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:19.309081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:19.309081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:19.309081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:19.309081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:19.309081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:19.309081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:19.309081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:19.309081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:19.309081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 01:06:19.309081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:19.309081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 368/736] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 13 01:06:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:19.309081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5e624-6a29-4c7a-a373-ac4c0d0418ef None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:19.356659 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f875ff-0e42-4dc2-b43a-19c11c8c9ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:19.358130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f875ff-0e42-4dc2-b43a-19c11c8c9ab5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:19.366687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:19.382285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:19.422736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5e624-6a29-4c7a-a373-ac4c0d0418ef None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:19.457331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307493c-1ee8-42af-a704-4d44d9a310fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:19.457933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307493c-1ee8-42af-a704-4d44d9a310fd None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:19.458211 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307493c-1ee8-42af-a704-4d44d9a310fd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:19.458487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307493c-1ee8-42af-a704-4d44d9a310fd None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:19.459174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307493c-1ee8-42af-a704-4d44d9a310fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:19.460548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307493c-1ee8-42af-a704-4d44d9a310fd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:19.461098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 369/737] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:06:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:06:19.462360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c32b1c-bb26-4485-bcab-eee2220c2ae3 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:19.462647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c32b1c-bb26-4485-bcab-eee2220c2ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:19.462923 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c32b1c-bb26-4485-bcab-eee2220c2ae3 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:19.464201 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 370/738] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:19.464901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c32b1c-bb26-4485-bcab-eee2220c2ae3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:19.479473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 369/739] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 13 01:06:19 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:06:19.480972 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a908e40-c022-455f-a0dc-0fa96e4532f6 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:19.481260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a908e40-c022-455f-a0dc-0fa96e4532f6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:19.481540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a908e40-c022-455f-a0dc-0fa96e4532f6 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:19.482762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 370/740] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:19.483523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a908e40-c022-455f-a0dc-0fa96e4532f6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:19.601957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c32b1c-bb26-4485-bcab-eee2220c2ae3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:19.603766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:19.606964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a908e40-c022-455f-a0dc-0fa96e4532f6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:19.632255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:19.643001 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8cc7-3c41-4150-89dc-5fea7456dc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:19.644224 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8cc7-3c41-4150-89dc-5fea7456dc7c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:19.644501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8cc7-3c41-4150-89dc-5fea7456dc7c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:19.644777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8cc7-3c41-4150-89dc-5fea7456dc7c None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:19.645531 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb8cc7-3c41-4150-89dc-5fea7456dc7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:19.645841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb8cc7-3c41-4150-89dc-5fea7456dc7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:19.647311 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb8cc7-3c41-4150-89dc-5fea7456dc7c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:19.647721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96147e-9951-41df-93c8-ac214327cf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:19.648414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96147e-9951-41df-93c8-ac214327cf3a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:19.648697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96147e-9951-41df-93c8-ac214327cf3a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:19.649234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96147e-9951-41df-93c8-ac214327cf3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:19.665471 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 371/741] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Sep 13 01:06:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:19.667200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f99de2-22df-4dae-bf53-66fbdb1ca221 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:19.667384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96147e-9951-41df-93c8-ac214327cf3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:19.667863 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f99de2-22df-4dae-bf53-66fbdb1ca221 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:19.668365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f99de2-22df-4dae-bf53-66fbdb1ca221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:19.668851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96147e-9951-41df-93c8-ac214327cf3a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-4f96147e-9951-41df-93c8-ac214327cf3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:19.684340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:19.685479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:19.686388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:19.686388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:19.686388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:19.686388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 371/742] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:19.686621 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e77146-71d7-4e87-ad8d-6de76c1ccdc2 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:19.686858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e77146-71d7-4e87-ad8d-6de76c1ccdc2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:19.687344 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e77146-71d7-4e87-ad8d-6de76c1ccdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:19.691765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b9f99de2-22df-4dae-bf53-66fbdb1ca221 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:19.693174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b9f99de2-22df-4dae-bf53-66fbdb1ca221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:19.706884 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-55e77146-71d7-4e87-ad8d-6de76c1ccdc2 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:19.708196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-55e77146-71d7-4e87-ad8d-6de76c1ccdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:19.775102 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 372/743] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:06:19.775102 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f99de2-22df-4dae-bf53-66fbdb1ca221 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:19.790504 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 372/744] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 01:06:19.791548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e77146-71d7-4e87-ad8d-6de76c1ccdc2 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:19.889480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:19.909019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f99de2-22df-4dae-bf53-66fbdb1ca221 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:19.977078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76aca06-ad9d-419e-a916-3f2564c4ef4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:19.978255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76aca06-ad9d-419e-a916-3f2564c4ef4f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:19.979158 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76aca06-ad9d-419e-a916-3f2564c4ef4f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:19.979683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76aca06-ad9d-419e-a916-3f2564c4ef4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:19.999666 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e77146-71d7-4e87-ad8d-6de76c1ccdc2 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:20.002187 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:20.059153 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374838a3-2822-45f5-b130-d8f5a0ca3544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:20.059962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374838a3-2822-45f5-b130-d8f5a0ca3544 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:20.060333 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374838a3-2822-45f5-b130-d8f5a0ca3544 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:20.060702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374838a3-2822-45f5-b130-d8f5a0ca3544 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:20.061542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374838a3-2822-45f5-b130-d8f5a0ca3544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:20.061938 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374838a3-2822-45f5-b130-d8f5a0ca3544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:20.063426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374838a3-2822-45f5-b130-d8f5a0ca3544 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:20.076472 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 373/745] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:20.088245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374838a3-2822-45f5-b130-d8f5a0ca3544 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:20.095758 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76aca06-ad9d-419e-a916-3f2564c4ef4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:20.097900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76aca06-ad9d-419e-a916-3f2564c4ef4f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:20.195462 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:20.201065 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374838a3-2822-45f5-b130-d8f5a0ca3544 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:20.207593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 373/746] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:06:19 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 01:06:20.208498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76aca06-ad9d-419e-a916-3f2564c4ef4f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:20.236957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e539e86-1e7c-4e81-a8d6-6a106bb15b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:20.238201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e539e86-1e7c-4e81-a8d6-6a106bb15b3b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:20.238484 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e539e86-1e7c-4e81-a8d6-6a106bb15b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:20.238760 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e539e86-1e7c-4e81-a8d6-6a106bb15b3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:20.245828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e539e86-1e7c-4e81-a8d6-6a106bb15b3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:20.247299 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e539e86-1e7c-4e81-a8d6-6a106bb15b3b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:20.260438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-5e539e86-1e7c-4e81-a8d6-6a106bb15b3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:20.260438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:20.260438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:20.260438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:20.260438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:20.260438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:20.260438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:20.260438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:20.260438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:20.260438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:20.260438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:20.260438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:20.260438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:20.260438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:20.260438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:20.261548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:20.262553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:20.262553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:20.262553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:20.262553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:20.262553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:20.262553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:20.262553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:20.262553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:20.262553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 374/747] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:20.263040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e539e86-1e7c-4e81-a8d6-6a106bb15b3b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:20.293074 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:20.327450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76aca06-ad9d-419e-a916-3f2564c4ef4f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:20.365839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9cde5-4064-4b5f-a06d-bac31d67bc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:20.366478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9cde5-4064-4b5f-a06d-bac31d67bc13 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:20.366806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9cde5-4064-4b5f-a06d-bac31d67bc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:20.367029 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9cde5-4064-4b5f-a06d-bac31d67bc13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:20.373339 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e539e86-1e7c-4e81-a8d6-6a106bb15b3b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:20.379297 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9cde5-4064-4b5f-a06d-bac31d67bc13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-55d9cde5-4064-4b5f-a06d-bac31d67bc13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:20.384570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:20.385496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:20.386329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:20.386329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:20.386329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:20.386329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:20.386329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:20.386329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:20.386329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:20.386329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:20.386329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:20.386329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:20.386329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:06:20.386329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:20.386329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 374/748] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:06:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:20.387017 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9cde5-4064-4b5f-a06d-bac31d67bc13 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:20.418376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4a51f-ba3c-4f6c-bf37-c87bcb05236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:20.419674 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4a51f-ba3c-4f6c-bf37-c87bcb05236d None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:20.419885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4a51f-ba3c-4f6c-bf37-c87bcb05236d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:20.420779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4a51f-ba3c-4f6c-bf37-c87bcb05236d None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:20.421129 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4a51f-ba3c-4f6c-bf37-c87bcb05236d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:20.422879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4a51f-ba3c-4f6c-bf37-c87bcb05236d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:20.439355 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 375/749] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 13 01:06:20 2022] POST /identity/v3/services => generated 240 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:06:20.446387 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:20.448162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4a51f-ba3c-4f6c-bf37-c87bcb05236d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:20.511208 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9cde5-4064-4b5f-a06d-bac31d67bc13 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:20.567745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6a28c-d8ec-4754-807f-8a5814556cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:20.569207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6a28c-d8ec-4754-807f-8a5814556cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:20.569911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6a28c-d8ec-4754-807f-8a5814556cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:20.570350 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6a28c-d8ec-4754-807f-8a5814556cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:20.575671 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:20.588574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6a28c-d8ec-4754-807f-8a5814556cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:20.590557 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6a28c-d8ec-4754-807f-8a5814556cd5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:20.598340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4a51f-ba3c-4f6c-bf37-c87bcb05236d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0dd6a28c-d8ec-4754-807f-8a5814556cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:20.611596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:20.613300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:20.614400 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:20.614400 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:20.614400 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:20.615970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 375/750] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:20.616916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6a28c-d8ec-4754-807f-8a5814556cd5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:20.641763 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57584e6-74da-43af-9fcc-10a5a058a4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:20.642380 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57584e6-74da-43af-9fcc-10a5a058a4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:20.642662 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57584e6-74da-43af-9fcc-10a5a058a4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:20.642933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57584e6-74da-43af-9fcc-10a5a058a4b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:20.644325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57584e6-74da-43af-9fcc-10a5a058a4b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:20.644925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57584e6-74da-43af-9fcc-10a5a058a4b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:20.646451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57584e6-74da-43af-9fcc-10a5a058a4b0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:20.661508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 376/751] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:20.666488 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57584e6-74da-43af-9fcc-10a5a058a4b0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:20.741344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:20.746985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6a28c-d8ec-4754-807f-8a5814556cd5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:20.781393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57584e6-74da-43af-9fcc-10a5a058a4b0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:20.794958 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1b02f-12be-4cf7-bc26-5466f801b314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:20.795599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1b02f-12be-4cf7-bc26-5466f801b314 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:20.796134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1b02f-12be-4cf7-bc26-5466f801b314 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:20.796406 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1b02f-12be-4cf7-bc26-5466f801b314 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:20.797552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1b02f-12be-4cf7-bc26-5466f801b314 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:20.797982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1b02f-12be-4cf7-bc26-5466f801b314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:20.800411 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1b02f-12be-4cf7-bc26-5466f801b314 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:20.812625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 376/752] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:06:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:20.814791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1b02f-12be-4cf7-bc26-5466f801b314 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:20.822467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e8106-f737-4220-9700-ca64d44aa6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:20.823458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e8106-f737-4220-9700-ca64d44aa6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:20.824396 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e8106-f737-4220-9700-ca64d44aa6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:20.824829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e8106-f737-4220-9700-ca64d44aa6f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:20.825868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e8106-f737-4220-9700-ca64d44aa6f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:20.826705 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e8106-f737-4220-9700-ca64d44aa6f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:20.828931 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e8106-f737-4220-9700-ca64d44aa6f1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:20.847131 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 377/753] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:20.849270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e8106-f737-4220-9700-ca64d44aa6f1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:20.854614 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:20.922787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1b02f-12be-4cf7-bc26-5466f801b314 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:20.963586 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0375195-a469-497c-b91f-7dcfdff2529e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:20.964677 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0375195-a469-497c-b91f-7dcfdff2529e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:20.965157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0375195-a469-497c-b91f-7dcfdff2529e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:20.965618 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0375195-a469-497c-b91f-7dcfdff2529e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:20.967255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0375195-a469-497c-b91f-7dcfdff2529e None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=e2414e53593b4e2084c895651fd0d0e5) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:20.967712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0375195-a469-497c-b91f-7dcfdff2529e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:20.969836 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0375195-a469-497c-b91f-7dcfdff2529e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:20.979145 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 377/754] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:06:20 2022] GET /identity/v3/role_assignments?user.id=e2414e53593b4e2084c895651fd0d0e5&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=3799feb4caa64e568971222375957f54 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:20.980444 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0375195-a469-497c-b91f-7dcfdff2529e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:20.987904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e8106-f737-4220-9700-ca64d44aa6f1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:21.018920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:21.026879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4c498-1d25-4bc0-9642-3044f24f640b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:21.027875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4c498-1d25-4bc0-9642-3044f24f640b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:21.028252 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4c498-1d25-4bc0-9642-3044f24f640b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:21.029068 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4c498-1d25-4bc0-9642-3044f24f640b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:21.046322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4c498-1d25-4bc0-9642-3044f24f640b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:21.048144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4c498-1d25-4bc0-9642-3044f24f640b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-88d4c498-1d25-4bc0-9642-3044f24f640b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:21.066810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:21.067978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:21.069075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:21.069075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:21.069075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:21.070949 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 378/755] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:21.076319 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4c498-1d25-4bc0-9642-3044f24f640b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:21.112685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0375195-a469-497c-b91f-7dcfdff2529e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:21.148229 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:21.153620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21139901-1e8e-494d-95c4-60d2c1c1d67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:21.154419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21139901-1e8e-494d-95c4-60d2c1c1d67e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:21.154781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21139901-1e8e-494d-95c4-60d2c1c1d67e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:21.155183 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21139901-1e8e-494d-95c4-60d2c1c1d67e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:21.164137 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21139901-1e8e-494d-95c4-60d2c1c1d67e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:21.165955 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21139901-1e8e-494d-95c4-60d2c1c1d67e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:21.179265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-21139901-1e8e-494d-95c4-60d2c1c1d67e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:21.179265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:21.179265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:21.179265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:21.179265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:21.179265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:21.179265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:21.179265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:21.179265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:21.179265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:21.179265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:21.179265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:21.179265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:21.179265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:21.179265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:21.180402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:21.181590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:21.181590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:21.181590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:21.181590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:21.181590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:21.181590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:21.181590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:21.181590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:21.183351 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 378/756] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:21.188698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21139901-1e8e-494d-95c4-60d2c1c1d67e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:21.208242 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4c498-1d25-4bc0-9642-3044f24f640b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:21.248401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc4f51-b344-4451-a159-67d4e831a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:21.249307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc4f51-b344-4451-a159-67d4e831a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:21.249825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc4f51-b344-4451-a159-67d4e831a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:21.250247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc4f51-b344-4451-a159-67d4e831a2f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:21.251047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc4f51-b344-4451-a159-67d4e831a2f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:21.251542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc4f51-b344-4451-a159-67d4e831a2f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:21.253332 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc4f51-b344-4451-a159-67d4e831a2f0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:21.269032 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 379/757] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:21.275309 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc4f51-b344-4451-a159-67d4e831a2f0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:21.288398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:21.305533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21139901-1e8e-494d-95c4-60d2c1c1d67e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:21.350019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f089a2-1695-4920-82bf-32fb93c3dee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:21.350931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f089a2-1695-4920-82bf-32fb93c3dee5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:21.351612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f089a2-1695-4920-82bf-32fb93c3dee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:21.352066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f089a2-1695-4920-82bf-32fb93c3dee5 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:21.353399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f089a2-1695-4920-82bf-32fb93c3dee5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:21.354149 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f089a2-1695-4920-82bf-32fb93c3dee5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:21.356773 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f089a2-1695-4920-82bf-32fb93c3dee5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:21.373622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 379/758] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:21.380432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f089a2-1695-4920-82bf-32fb93c3dee5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:21.388200 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc4f51-b344-4451-a159-67d4e831a2f0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:21.410967 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:21.464033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc1762-8ad5-429a-bf14-e8cb3b59a07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:21.465959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc1762-8ad5-429a-bf14-e8cb3b59a07f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:21.467148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc1762-8ad5-429a-bf14-e8cb3b59a07f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:21.468960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc1762-8ad5-429a-bf14-e8cb3b59a07f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:21.485921 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc1762-8ad5-429a-bf14-e8cb3b59a07f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:21.489789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc1762-8ad5-429a-bf14-e8cb3b59a07f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-e8dc1762-8ad5-429a-bf14-e8cb3b59a07f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:21.514251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:21.515279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:21.516246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:21.516246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:21.516246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:21.516246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:21.516246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:21.516246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:21.516246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:21.516246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:21.516246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:06:21.516246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:21.524373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 380/759] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 13 01:06:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:21.530410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc1762-8ad5-429a-bf14-e8cb3b59a07f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:21.553919 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f089a2-1695-4920-82bf-32fb93c3dee5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:21.631116 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444331b-1a29-4e06-ba2c-799f74671cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:21.632200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444331b-1a29-4e06-ba2c-799f74671cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:21.632792 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444331b-1a29-4e06-ba2c-799f74671cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:21.633268 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444331b-1a29-4e06-ba2c-799f74671cd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:21.634207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444331b-1a29-4e06-ba2c-799f74671cd4 None admin] RBAC: Adding query filter params (role.id=e55e17c894314bc6a5772b2de35b4874, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=da83fb76a0b04aa2bdb91f6c25dc6cc6) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:21.634713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444331b-1a29-4e06-ba2c-799f74671cd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:21.636457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444331b-1a29-4e06-ba2c-799f74671cd4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:21.644367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 380/760] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:06:21 2022] GET /identity/v3/role_assignments?user.id=da83fb76a0b04aa2bdb91f6c25dc6cc6&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=e55e17c894314bc6a5772b2de35b4874 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:21.749682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc1762-8ad5-429a-bf14-e8cb3b59a07f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:21.790828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475b6a5-1045-43d7-887f-15a6b243bc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:21.791500 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475b6a5-1045-43d7-887f-15a6b243bc72 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:21.791741 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475b6a5-1045-43d7-887f-15a6b243bc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:21.792019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475b6a5-1045-43d7-887f-15a6b243bc72 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:21.792754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475b6a5-1045-43d7-887f-15a6b243bc72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:21.793065 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475b6a5-1045-43d7-887f-15a6b243bc72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:21.794519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475b6a5-1045-43d7-887f-15a6b243bc72 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:21.814199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 381/761] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 13 01:06:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:21.820293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444331b-1a29-4e06-ba2c-799f74671cd4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:21.839279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:21.870022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f82d9-08ed-4d9d-b55b-33469955efbd None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:21.870309 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f82d9-08ed-4d9d-b55b-33469955efbd None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:21.870617 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f82d9-08ed-4d9d-b55b-33469955efbd None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:21.872213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 382/762] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:21.877168 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ffd04-2e91-4246-aa5a-444f2c5bf736 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:21.877454 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ffd04-2e91-4246-aa5a-444f2c5bf736 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:21.877780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ffd04-2e91-4246-aa5a-444f2c5bf736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:21.899393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-287ffd04-2e91-4246-aa5a-444f2c5bf736 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:21.899393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-287ffd04-2e91-4246-aa5a-444f2c5bf736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:21.948658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:21.973800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444331b-1a29-4e06-ba2c-799f74671cd4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:22.043804 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 383/763] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:22.052373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83c541-be7a-4503-aae4-1ae09cdfcd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:22.053026 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c541-be7a-4503-aae4-1ae09cdfcd49 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:22.053307 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c541-be7a-4503-aae4-1ae09cdfcd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:22.053584 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c541-be7a-4503-aae4-1ae09cdfcd49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:22.066090 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83c541-be7a-4503-aae4-1ae09cdfcd49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:22.067740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83c541-be7a-4503-aae4-1ae09cdfcd49 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-df83c541-be7a-4503-aae4-1ae09cdfcd49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:22.094282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:22.095490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:22.097203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:22.097203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:22.097203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:22.097203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 381/764] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:22.101738 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ffd04-2e91-4246-aa5a-444f2c5bf736 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:22.242965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ffd04-2e91-4246-aa5a-444f2c5bf736 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:22.287504 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a7e29-3fb8-4550-85ea-668c82621d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:22.288116 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a7e29-3fb8-4550-85ea-668c82621d50 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:22.288394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a7e29-3fb8-4550-85ea-668c82621d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:22.288674 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a7e29-3fb8-4550-85ea-668c82621d50 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:22.289311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a7e29-3fb8-4550-85ea-668c82621d50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:22.289612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a7e29-3fb8-4550-85ea-668c82621d50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:22.290975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a7e29-3fb8-4550-85ea-668c82621d50 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:22.310784 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 384/765] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:22.316613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83c541-be7a-4503-aae4-1ae09cdfcd49 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:22.384473 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:22.422106 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a7e29-3fb8-4550-85ea-668c82621d50 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:22.435611 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83c541-be7a-4503-aae4-1ae09cdfcd49 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:22.482948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f113d45-f4e7-47a0-9f44-20697cf2a90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:22.483617 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f113d45-f4e7-47a0-9f44-20697cf2a90d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:22.483901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f113d45-f4e7-47a0-9f44-20697cf2a90d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:22.484176 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f113d45-f4e7-47a0-9f44-20697cf2a90d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:22.490405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:22.500116 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f113d45-f4e7-47a0-9f44-20697cf2a90d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:22.501946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f113d45-f4e7-47a0-9f44-20697cf2a90d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:22.519610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-6f113d45-f4e7-47a0-9f44-20697cf2a90d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:22.519610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:22.519610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:22.519610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:22.519610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:22.519610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:22.519610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:22.519610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:22.519610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:22.519610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:22.519610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:22.519610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:22.519610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:22.519610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:22.519610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:22.520564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:22.521527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:22.521527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:22.521527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:22.521527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:22.521527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:22.521527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:22.521527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:22.521527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:22.525463 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 382/766] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:22.526693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f113d45-f4e7-47a0-9f44-20697cf2a90d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:22.634583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f113d45-f4e7-47a0-9f44-20697cf2a90d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:22.659541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:22.663421 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a7e29-3fb8-4550-85ea-668c82621d50 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:22.670504 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a870c7-8935-4216-ad62-c349924bd9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:22.671155 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a870c7-8935-4216-ad62-c349924bd9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:22.671449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a870c7-8935-4216-ad62-c349924bd9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:22.671731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a870c7-8935-4216-ad62-c349924bd9d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:22.672436 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a870c7-8935-4216-ad62-c349924bd9d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:22.672775 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a870c7-8935-4216-ad62-c349924bd9d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:22.674299 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a870c7-8935-4216-ad62-c349924bd9d5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:22.688330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 383/767] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:22.693951 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a870c7-8935-4216-ad62-c349924bd9d5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:22.769662 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ec2b0-fe28-47e5-a74a-dab8267179ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:22.770318 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ec2b0-fe28-47e5-a74a-dab8267179ce None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:22.770596 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ec2b0-fe28-47e5-a74a-dab8267179ce None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:22.770864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ec2b0-fe28-47e5-a74a-dab8267179ce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:22.772387 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ec2b0-fe28-47e5-a74a-dab8267179ce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:22.773866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ec2b0-fe28-47e5-a74a-dab8267179ce None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-ff2ec2b0-fe28-47e5-a74a-dab8267179ce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:22.794300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:22.795836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:22.796691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:22.796691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:22.796691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:22.796691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:22.796691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:22.796691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:22.796691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:22.796691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:22.796691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:22.796691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:22.796691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:22.796691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:22.796691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 01:06:22.796691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:22.804038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 385/768] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Sep 13 01:06:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:22.805139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a870c7-8935-4216-ad62-c349924bd9d5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:22.812600 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ec2b0-fe28-47e5-a74a-dab8267179ce None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:22.849731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b474f-c250-4184-8740-7fee56fbcd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:22.850431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b474f-c250-4184-8740-7fee56fbcd01 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:22.850668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b474f-c250-4184-8740-7fee56fbcd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:22.850949 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b474f-c250-4184-8740-7fee56fbcd01 None admin] PATH_INFO: `/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/fadc83bec6be41979e1aa4d71f8fc2bd/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:22.853112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b474f-c250-4184-8740-7fee56fbcd01 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe73ceb0a582452b9b636a701adafb6f, user_id=fadc83bec6be41979e1aa4d71f8fc2bd, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:22.854574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b474f-c250-4184-8740-7fee56fbcd01 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:22.875732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 384/769] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:06:22 2022] PUT /identity/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/fadc83bec6be41979e1aa4d71f8fc2bd/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:06:22.945253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:22.960659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ec2b0-fe28-47e5-a74a-dab8267179ce None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:23.007874 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ef012-32fd-4732-b50a-872816f0a3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:23.008571 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ef012-32fd-4732-b50a-872816f0a3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:23.008865 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ef012-32fd-4732-b50a-872816f0a3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:23.009145 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ef012-32fd-4732-b50a-872816f0a3b8 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:23.009798 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ef012-32fd-4732-b50a-872816f0a3b8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:23.010107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ef012-32fd-4732-b50a-872816f0a3b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:23.011567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ef012-32fd-4732-b50a-872816f0a3b8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:23.017024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 386/770] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 13 01:06:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:23.023376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b474f-c250-4184-8740-7fee56fbcd01 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:23.080427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:23.152329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b474f-c250-4184-8740-7fee56fbcd01 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:23.200698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa820b-2220-4b14-8f1b-257b6ddc5bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:23.201327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa820b-2220-4b14-8f1b-257b6ddc5bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:23.201603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa820b-2220-4b14-8f1b-257b6ddc5bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:23.201871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa820b-2220-4b14-8f1b-257b6ddc5bb0 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:23.202511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa820b-2220-4b14-8f1b-257b6ddc5bb0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:23.202812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa820b-2220-4b14-8f1b-257b6ddc5bb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:23.204226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa820b-2220-4b14-8f1b-257b6ddc5bb0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:23.210218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 385/771] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 13 01:06:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:23.216070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ef012-32fd-4732-b50a-872816f0a3b8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:23.268185 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee1e1-4283-4fa0-878f-d0796310ad16 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:23.268979 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee1e1-4283-4fa0-878f-d0796310ad16 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:23.269496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee1e1-4283-4fa0-878f-d0796310ad16 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:23.271543 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 386/772] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:23.277383 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aea10-aa3b-47df-99e8-aa4ef1d82fd6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:23.277996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aea10-aa3b-47df-99e8-aa4ef1d82fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:23.278530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aea10-aa3b-47df-99e8-aa4ef1d82fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:23.307126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-187aea10-aa3b-47df-99e8-aa4ef1d82fd6 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:23.308887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-187aea10-aa3b-47df-99e8-aa4ef1d82fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:23.345495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ef012-32fd-4732-b50a-872816f0a3b8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:23.387030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c163242-1c2f-40f2-8aa2-bef5f5280556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:23.387675 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c163242-1c2f-40f2-8aa2-bef5f5280556 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:23.387957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c163242-1c2f-40f2-8aa2-bef5f5280556 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:23.388235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c163242-1c2f-40f2-8aa2-bef5f5280556 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:23.388841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 387/773] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:23.392675 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c163242-1c2f-40f2-8aa2-bef5f5280556 None admin] RBAC: Adding query filter params (interface=public, service_id=972d4f8a5b49499484b2f75b7b2065d8, region_id=RegionOne) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:23.392675 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c163242-1c2f-40f2-8aa2-bef5f5280556 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:23.392675 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c163242-1c2f-40f2-8aa2-bef5f5280556 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:23.400317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 387/774] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 13 01:06:23 2022] GET /identity/v3/endpoints?service_id=972d4f8a5b49499484b2f75b7b2065d8&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:23.405854 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187aea10-aa3b-47df-99e8-aa4ef1d82fd6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:23.458098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:23.551468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187aea10-aa3b-47df-99e8-aa4ef1d82fd6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:23.597305 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b76046-ebff-463c-a4bf-614683137877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:23.597921 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b76046-ebff-463c-a4bf-614683137877 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:23.598203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b76046-ebff-463c-a4bf-614683137877 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:23.598547 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b76046-ebff-463c-a4bf-614683137877 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:23.599185 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b76046-ebff-463c-a4bf-614683137877 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:23.600615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b76046-ebff-463c-a4bf-614683137877 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:23.609266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 388/775] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 13 01:06:23 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:23.724669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bbff2-1277-4947-9806-428231471563 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:23.725027 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bbff2-1277-4947-9806-428231471563 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:23.725231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bbff2-1277-4947-9806-428231471563 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:23.726825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 388/776] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:23.736705 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87c884-31a0-4bab-9fd1-f122f82c2d39 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:23.737046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87c884-31a0-4bab-9fd1-f122f82c2d39 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:23.737354 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87c884-31a0-4bab-9fd1-f122f82c2d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:23.764957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2f87c884-31a0-4bab-9fd1-f122f82c2d39 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:23.766185 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2f87c884-31a0-4bab-9fd1-f122f82c2d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:23.787796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bbff2-1277-4947-9806-428231471563 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:23.811561 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:23.896342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 389/777] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:23.920250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bbff2-1277-4947-9806-428231471563 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:23.961184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e6053-e2e0-49f7-b114-82ef5bc31331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:23.961866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e6053-e2e0-49f7-b114-82ef5bc31331 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:23.962148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e6053-e2e0-49f7-b114-82ef5bc31331 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:23.962419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e6053-e2e0-49f7-b114-82ef5bc31331 None admin] PATH_INFO: `/v3/services/network` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:23.963000 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e6053-e2e0-49f7-b114-82ef5bc31331 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:23.964409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e6053-e2e0-49f7-b114-82ef5bc31331 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-8c3e6053-e2e0-49f7-b114-82ef5bc31331 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:23.974281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:23.975328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:23.976169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:23.976169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:23.976169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:23.976169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:23.976169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:23.976169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:23.976169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:23.976169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:23.976169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:23.976169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:23.976169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:23.976169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:23.976169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 01:06:23.976169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:23.979095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 389/778] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:23 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:23.981641 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87c884-31a0-4bab-9fd1-f122f82c2d39 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:24.019519 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:24.091501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87c884-31a0-4bab-9fd1-f122f82c2d39 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:24.126474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a364d-6ee0-4c07-a0db-92561110ec22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:24.127177 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a364d-6ee0-4c07-a0db-92561110ec22 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:24.127457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a364d-6ee0-4c07-a0db-92561110ec22 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:24.127818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a364d-6ee0-4c07-a0db-92561110ec22 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:24.128513 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a364d-6ee0-4c07-a0db-92561110ec22 None admin] RBAC: Adding query filter params (name=network) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:24.128815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a364d-6ee0-4c07-a0db-92561110ec22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:24.130190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a364d-6ee0-4c07-a0db-92561110ec22 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:24.140419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 390/779] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 13 01:06:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:24.143837 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e6053-e2e0-49f7-b114-82ef5bc31331 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:24.230848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:24.251757 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e6053-e2e0-49f7-b114-82ef5bc31331 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:24.288199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a364d-6ee0-4c07-a0db-92561110ec22 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:24.292221 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d9599-93da-451e-8a0f-31e9cd85e76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:24.293138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d9599-93da-451e-8a0f-31e9cd85e76d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:24.293677 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d9599-93da-451e-8a0f-31e9cd85e76d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:24.294148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d9599-93da-451e-8a0f-31e9cd85e76d None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:24.294974 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d9599-93da-451e-8a0f-31e9cd85e76d None admin] RBAC: Adding query filter params (type=network) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:24.295527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d9599-93da-451e-8a0f-31e9cd85e76d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:24.297137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d9599-93da-451e-8a0f-31e9cd85e76d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:24.304115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 390/780] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 13 01:06:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:24.309720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d9599-93da-451e-8a0f-31e9cd85e76d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:24.461124 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d9599-93da-451e-8a0f-31e9cd85e76d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:24.487434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:24.506476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a364d-6ee0-4c07-a0db-92561110ec22 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:24.530845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a19a79-5cc7-4366-8a3f-bfb9e47afb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:24.531484 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a19a79-5cc7-4366-8a3f-bfb9e47afb5a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:24.531755 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a19a79-5cc7-4366-8a3f-bfb9e47afb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:24.532020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a19a79-5cc7-4366-8a3f-bfb9e47afb5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:24.532719 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a19a79-5cc7-4366-8a3f-bfb9e47afb5a None admin] RBAC: Adding query filter params (interface=public, service_id=ce92bd6570604134b3f11531ea9702b9, region_id=RegionOne) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:24.533019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a19a79-5cc7-4366-8a3f-bfb9e47afb5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:24.537641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a19a79-5cc7-4366-8a3f-bfb9e47afb5a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:24.548307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 391/781] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 13 01:06:24 2022] GET /identity/v3/endpoints?service_id=ce92bd6570604134b3f11531ea9702b9&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:24.554251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a19a79-5cc7-4366-8a3f-bfb9e47afb5a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:24.576555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:24.590222 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de821ff6-2b32-4b84-a00d-f8f0f76dc478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:24.590861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de821ff6-2b32-4b84-a00d-f8f0f76dc478 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:24.591162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de821ff6-2b32-4b84-a00d-f8f0f76dc478 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:24.591652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de821ff6-2b32-4b84-a00d-f8f0f76dc478 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:24.613922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de821ff6-2b32-4b84-a00d-f8f0f76dc478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-de821ff6-2b32-4b84-a00d-f8f0f76dc478 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:24.619605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:24.620544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:24.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:24.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:24.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:24.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:24.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:24.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:24.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:24.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:24.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:24.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:24.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:06:24.621379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:24.623102 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 391/782] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:06:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:24.633754 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de821ff6-2b32-4b84-a00d-f8f0f76dc478 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:24.731269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a19a79-5cc7-4366-8a3f-bfb9e47afb5a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:24.771392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbeaa1d-80e2-4e37-81ad-b3aa85013e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:24.772045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbeaa1d-80e2-4e37-81ad-b3aa85013e75 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:24.772328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbeaa1d-80e2-4e37-81ad-b3aa85013e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:24.772604 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbeaa1d-80e2-4e37-81ad-b3aa85013e75 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:24.773217 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbeaa1d-80e2-4e37-81ad-b3aa85013e75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:24.774600 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbeaa1d-80e2-4e37-81ad-b3aa85013e75 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:24.780235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 392/783] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 13 01:06:24 2022] GET /identity/v3/services => generated 772 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:24.781575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7099e45-f3ca-4a43-bf63-b11a63b4e84e None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:24.781868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7099e45-f3ca-4a43-bf63-b11a63b4e84e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:24.782150 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7099e45-f3ca-4a43-bf63-b11a63b4e84e None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:24.787865 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 393/784] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:24.789462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61171ac-d56d-4606-8669-4c629e607725 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:24.789816 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61171ac-d56d-4606-8669-4c629e607725 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:24.790160 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61171ac-d56d-4606-8669-4c629e607725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:24.792074 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de821ff6-2b32-4b84-a00d-f8f0f76dc478 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:24.813805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a61171ac-d56d-4606-8669-4c629e607725 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:24.815036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a61171ac-d56d-4606-8669-4c629e607725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:24.834122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea3126-23e8-490c-bc55-ebcf0e61629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:24.834836 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea3126-23e8-490c-bc55-ebcf0e61629a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:24.835218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea3126-23e8-490c-bc55-ebcf0e61629a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:24.835567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea3126-23e8-490c-bc55-ebcf0e61629a None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:24.836430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea3126-23e8-490c-bc55-ebcf0e61629a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:24.836837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea3126-23e8-490c-bc55-ebcf0e61629a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:24.838432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea3126-23e8-490c-bc55-ebcf0e61629a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:24.849075 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 392/785] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:06:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:24.856246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea3126-23e8-490c-bc55-ebcf0e61629a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:24.898400 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:24.976885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 394/786] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:25.011352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea3126-23e8-490c-bc55-ebcf0e61629a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:25.050585 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a6bed-edf4-4b7f-928d-f85f02afb7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:25.051448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a6bed-edf4-4b7f-928d-f85f02afb7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:25.051725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a6bed-edf4-4b7f-928d-f85f02afb7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:25.051993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a6bed-edf4-4b7f-928d-f85f02afb7c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:25.062963 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a6bed-edf4-4b7f-928d-f85f02afb7c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:25.064429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a6bed-edf4-4b7f-928d-f85f02afb7c8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-329a6bed-edf4-4b7f-928d-f85f02afb7c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:25.079644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:25.080606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:25.082572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:25.082572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:25.082572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:25.082572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 393/787] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:25.087475 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61171ac-d56d-4606-8669-4c629e607725 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:25.091384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:25.193543 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61171ac-d56d-4606-8669-4c629e607725 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:25.229832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454101be-f68c-42ae-92ea-851893270430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:25.230446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454101be-f68c-42ae-92ea-851893270430 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:25.230722 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454101be-f68c-42ae-92ea-851893270430 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:25.230998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454101be-f68c-42ae-92ea-851893270430 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:25.231672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454101be-f68c-42ae-92ea-851893270430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:25.231975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454101be-f68c-42ae-92ea-851893270430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:25.233355 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454101be-f68c-42ae-92ea-851893270430 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:25.245734 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 395/788] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:25.251330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a6bed-edf4-4b7f-928d-f85f02afb7c8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:25.316087 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454101be-f68c-42ae-92ea-851893270430 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:25.323090 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:25.360889 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a6bed-edf4-4b7f-928d-f85f02afb7c8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:25.401373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a71ceb-7a88-4f0b-b8b4-2caee7f02270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:25.402400 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a71ceb-7a88-4f0b-b8b4-2caee7f02270 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:25.402885 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a71ceb-7a88-4f0b-b8b4-2caee7f02270 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:25.403524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a71ceb-7a88-4f0b-b8b4-2caee7f02270 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:25.404800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:25.413619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a71ceb-7a88-4f0b-b8b4-2caee7f02270 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:25.425612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a71ceb-7a88-4f0b-b8b4-2caee7f02270 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-70a71ceb-7a88-4f0b-b8b4-2caee7f02270 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:25.440965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:25.441998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:25.442928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:25.442928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:25.442928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:25.442928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:25.442928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:25.442928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:25.442928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:25.442928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:25.442928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 01:06:25.442928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:25.446276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 394/789] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:06:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:25.452906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a71ceb-7a88-4f0b-b8b4-2caee7f02270 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:25.512253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454101be-f68c-42ae-92ea-851893270430 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:25.571193 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a71ceb-7a88-4f0b-b8b4-2caee7f02270 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:25.585854 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d52e2-b06d-408e-9201-e3d3dcde2908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:25.586500 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d52e2-b06d-408e-9201-e3d3dcde2908 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:25.586787 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d52e2-b06d-408e-9201-e3d3dcde2908 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:25.587046 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d52e2-b06d-408e-9201-e3d3dcde2908 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:25.598139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d52e2-b06d-408e-9201-e3d3dcde2908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-2d1d52e2-b06d-408e-9201-e3d3dcde2908 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:25.603601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:25.604546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:25.605379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:25.605379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:25.605379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:25.605379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:25.605379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:25.605379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:25.605379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:25.605379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:25.605379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:25.605379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:25.605379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:25.605379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:25.606499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:25.609604 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 396/790] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:06:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:25.610870 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70230f97-2f67-48d2-b74e-7dd03bfbe9e5 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:25.611192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70230f97-2f67-48d2-b74e-7dd03bfbe9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:25.611475 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70230f97-2f67-48d2-b74e-7dd03bfbe9e5 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:25.617963 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 397/791] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:25.618765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70230f97-2f67-48d2-b74e-7dd03bfbe9e5 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:25.619167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3494f6-92ec-4882-865c-9e45f83b0091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:25.619950 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3494f6-92ec-4882-865c-9e45f83b0091 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:25.620374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3494f6-92ec-4882-865c-9e45f83b0091 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:25.620815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3494f6-92ec-4882-865c-9e45f83b0091 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:25.621701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3494f6-92ec-4882-865c-9e45f83b0091 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:25.622344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3494f6-92ec-4882-865c-9e45f83b0091 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:25.624876 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3494f6-92ec-4882-865c-9e45f83b0091 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:25.648406 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 395/792] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Sep 13 01:06:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:25.653606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864de0df-7d4e-4a56-be4a-6b29c2772f6d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:25.653606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864de0df-7d4e-4a56-be4a-6b29c2772f6d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:25.653606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864de0df-7d4e-4a56-be4a-6b29c2772f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:25.677970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-864de0df-7d4e-4a56-be4a-6b29c2772f6d None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:25.679315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-864de0df-7d4e-4a56-be4a-6b29c2772f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:25.761016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70230f97-2f67-48d2-b74e-7dd03bfbe9e5 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:25.775124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 396/793] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:25.775124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864de0df-7d4e-4a56-be4a-6b29c2772f6d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:25.805919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:25.832627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb65668-2300-4576-b46c-8a28d2c77826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:25.833234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb65668-2300-4576-b46c-8a28d2c77826 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:25.833465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb65668-2300-4576-b46c-8a28d2c77826 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:25.833906 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb65668-2300-4576-b46c-8a28d2c77826 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:25.834588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb65668-2300-4576-b46c-8a28d2c77826 None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:25.834894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb65668-2300-4576-b46c-8a28d2c77826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:25.836323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb65668-2300-4576-b46c-8a28d2c77826 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:25.857683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 398/794] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:06:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:25.864322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb65668-2300-4576-b46c-8a28d2c77826 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:25.967995 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864de0df-7d4e-4a56-be4a-6b29c2772f6d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:25.992088 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:26.032454 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20816d-f7f2-4173-80c9-721bba878ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:26.033096 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20816d-f7f2-4173-80c9-721bba878ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:26.033374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20816d-f7f2-4173-80c9-721bba878ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:26.033650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20816d-f7f2-4173-80c9-721bba878ea4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:26.051298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20816d-f7f2-4173-80c9-721bba878ea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:26.052770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20816d-f7f2-4173-80c9-721bba878ea4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:26.057085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb65668-2300-4576-b46c-8a28d2c77826 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:26.125474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e55c6-bb76-42ab-83b4-fe280f3b725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:26.126051 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e55c6-bb76-42ab-83b4-fe280f3b725d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:26.126329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e55c6-bb76-42ab-83b4-fe280f3b725d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:26.126603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e55c6-bb76-42ab-83b4-fe280f3b725d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:26.139105 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e55c6-bb76-42ab-83b4-fe280f3b725d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:26.140616 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e55c6-bb76-42ab-83b4-fe280f3b725d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-1a6e55c6-bb76-42ab-83b4-fe280f3b725d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:26.156495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:26.157514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:26.158386 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:26.158386 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:26.158386 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:26.158386 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 399/795] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:26.159919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e55c6-bb76-42ab-83b4-fe280f3b725d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:26.200128 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-bb20816d-f7f2-4173-80c9-721bba878ea4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:26.211261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:26.212266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:26.213156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:26.213156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:26.213156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:26.217011 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 397/796] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:26.217868 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20816d-f7f2-4173-80c9-721bba878ea4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:26.269467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e55c6-bb76-42ab-83b4-fe280f3b725d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:26.302322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ae89f-bee5-40e2-8e0a-74ffd5e222af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:26.302956 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ae89f-bee5-40e2-8e0a-74ffd5e222af None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:26.303267 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ae89f-bee5-40e2-8e0a-74ffd5e222af None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:26.303541 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ae89f-bee5-40e2-8e0a-74ffd5e222af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:26.313537 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ae89f-bee5-40e2-8e0a-74ffd5e222af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a30ae89f-bee5-40e2-8e0a-74ffd5e222af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:26.319470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:26.320588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:26.321633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:26.321633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:26.321633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:26.321633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:26.321633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:26.321633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:26.321633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:26.321633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:26.321633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:26.321633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:26.321633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:06:26.321633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:26.321633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 400/797] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:06:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:26.322526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f585f-bbba-425d-9d80-9b2305d0121e None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:26.322526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f585f-bbba-425d-9d80-9b2305d0121e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:26.322526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f585f-bbba-425d-9d80-9b2305d0121e None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:26.327193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 401/798] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:26.327193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f585f-bbba-425d-9d80-9b2305d0121e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:26.335893 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20816d-f7f2-4173-80c9-721bba878ea4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:26.373761 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b910d-aae8-4f7a-b9ac-293b4e64d313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:26.374364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b910d-aae8-4f7a-b9ac-293b4e64d313 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:26.374640 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b910d-aae8-4f7a-b9ac-293b4e64d313 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:26.374913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b910d-aae8-4f7a-b9ac-293b4e64d313 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:26.375643 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b910d-aae8-4f7a-b9ac-293b4e64d313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:26.375888 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b910d-aae8-4f7a-b9ac-293b4e64d313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:26.377253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b910d-aae8-4f7a-b9ac-293b4e64d313 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:26.393886 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 398/799] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:26.393886 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b910d-aae8-4f7a-b9ac-293b4e64d313 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:26.430900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:26.433051 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:26.440778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f585f-bbba-425d-9d80-9b2305d0121e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:26.476894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c8720-bca2-4f10-bd29-d1d2c8c99ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:26.477498 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c8720-bca2-4f10-bd29-d1d2c8c99ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:26.477781 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c8720-bca2-4f10-bd29-d1d2c8c99ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:26.478051 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c8720-bca2-4f10-bd29-d1d2c8c99ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:26.478685 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c8720-bca2-4f10-bd29-d1d2c8c99ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:26.478988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c8720-bca2-4f10-bd29-d1d2c8c99ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:26.480386 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c8720-bca2-4f10-bd29-d1d2c8c99ef6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:26.493119 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 402/800] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:26.497044 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2cba9-16c9-47c3-aa1d-0450b04cdb5f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:26.497528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2cba9-16c9-47c3-aa1d-0450b04cdb5f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:26.498015 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2cba9-16c9-47c3-aa1d-0450b04cdb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:26.512122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b910d-aae8-4f7a-b9ac-293b4e64d313 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:26.521718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ddd2cba9-16c9-47c3-aa1d-0450b04cdb5f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:26.523001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ddd2cba9-16c9-47c3-aa1d-0450b04cdb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:26.549224 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300a2d7-4180-4d8d-b347-fc20fd48b0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:26.550446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300a2d7-4180-4d8d-b347-fc20fd48b0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:26.550730 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300a2d7-4180-4d8d-b347-fc20fd48b0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:26.551315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300a2d7-4180-4d8d-b347-fc20fd48b0b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:26.551718 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300a2d7-4180-4d8d-b347-fc20fd48b0b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:26.552020 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300a2d7-4180-4d8d-b347-fc20fd48b0b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:26.553373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300a2d7-4180-4d8d-b347-fc20fd48b0b6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:26.562610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 399/801] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:06:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:26.563339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300a2d7-4180-4d8d-b347-fc20fd48b0b6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:26.598419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 403/802] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:26.599419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2cba9-16c9-47c3-aa1d-0450b04cdb5f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:26.662957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:26.676317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300a2d7-4180-4d8d-b347-fc20fd48b0b6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:26.712063 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260b1a9-11ec-41fd-be83-61b935c0ac4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:26.712696 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260b1a9-11ec-41fd-be83-61b935c0ac4a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:26.712968 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260b1a9-11ec-41fd-be83-61b935c0ac4a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:26.713295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260b1a9-11ec-41fd-be83-61b935c0ac4a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:26.715760 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:26.722682 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260b1a9-11ec-41fd-be83-61b935c0ac4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:26.724208 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260b1a9-11ec-41fd-be83-61b935c0ac4a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-d260b1a9-11ec-41fd-be83-61b935c0ac4a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:26.736608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:26.737866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:26.738818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:26.738818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:26.738818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:26.738818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:26.738818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:26.738818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:26.738818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:26.738818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:26.738818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 01:06:26.738818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:26.742649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 400/803] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 13 01:06:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:26.743014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2cba9-16c9-47c3-aa1d-0450b04cdb5f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:26.743510 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260b1a9-11ec-41fd-be83-61b935c0ac4a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:26.790335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07398b2-c399-4aa9-8e80-47c962bef50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:26.790996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07398b2-c399-4aa9-8e80-47c962bef50c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:26.791315 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07398b2-c399-4aa9-8e80-47c962bef50c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:26.791585 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07398b2-c399-4aa9-8e80-47c962bef50c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:26.800002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07398b2-c399-4aa9-8e80-47c962bef50c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:26.801643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07398b2-c399-4aa9-8e80-47c962bef50c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:26.818429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-d07398b2-c399-4aa9-8e80-47c962bef50c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:26.818429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:26.818429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:26.818429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:26.818429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:26.818429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:26.818429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:26.818429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:26.818429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:26.818429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:26.818429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:26.818429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:26.818429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:26.818429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:26.818429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:26.819430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:26.820317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:26.820317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:26.820317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:26.820317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:26.820317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:26.820317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:26.820317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:26.820317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:26.823203 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 404/804] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:26.825041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07398b2-c399-4aa9-8e80-47c962bef50c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:26.867868 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260b1a9-11ec-41fd-be83-61b935c0ac4a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:26.903398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db8e82-a2c2-4154-943c-8744a669db6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:26.904148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db8e82-a2c2-4154-943c-8744a669db6e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:26.904424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db8e82-a2c2-4154-943c-8744a669db6e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:26.904798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db8e82-a2c2-4154-943c-8744a669db6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:26.916085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db8e82-a2c2-4154-943c-8744a669db6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:26.917566 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db8e82-a2c2-4154-943c-8744a669db6e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:26.927016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e0db8e82-a2c2-4154-943c-8744a669db6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:26.935322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:26.936284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:26.937178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:26.937178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:26.937178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:26.937178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 401/805] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:26.937417 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db8e82-a2c2-4154-943c-8744a669db6e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:26.957353 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07398b2-c399-4aa9-8e80-47c962bef50c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:26.996963 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaea365-a5d6-4624-892f-d177ef6bdb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:26.997570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaea365-a5d6-4624-892f-d177ef6bdb9e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:26.997847 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaea365-a5d6-4624-892f-d177ef6bdb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:26.998116 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaea365-a5d6-4624-892f-d177ef6bdb9e None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:26.998837 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaea365-a5d6-4624-892f-d177ef6bdb9e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:26.999160 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaea365-a5d6-4624-892f-d177ef6bdb9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:27.000585 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaea365-a5d6-4624-892f-d177ef6bdb9e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:27.023598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 405/806] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Sep 13 01:06:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:27.023598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaea365-a5d6-4624-892f-d177ef6bdb9e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:27.025877 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:27.051280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db8e82-a2c2-4154-943c-8744a669db6e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:27.088066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea896ee6-7364-4b44-872b-6e503c16662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:27.088679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea896ee6-7364-4b44-872b-6e503c16662a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:27.088955 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea896ee6-7364-4b44-872b-6e503c16662a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:27.089224 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea896ee6-7364-4b44-872b-6e503c16662a None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:27.090063 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea896ee6-7364-4b44-872b-6e503c16662a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:27.090377 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea896ee6-7364-4b44-872b-6e503c16662a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:27.091900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea896ee6-7364-4b44-872b-6e503c16662a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:27.105385 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 402/807] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:27.106275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea896ee6-7364-4b44-872b-6e503c16662a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:27.137418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaea365-a5d6-4624-892f-d177ef6bdb9e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:27.166806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:27.178467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4601d-71d7-41f3-8506-8e40377cbc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:27.179497 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4601d-71d7-41f3-8506-8e40377cbc19 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:27.180605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4601d-71d7-41f3-8506-8e40377cbc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:27.180605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4601d-71d7-41f3-8506-8e40377cbc19 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:27.181371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4601d-71d7-41f3-8506-8e40377cbc19 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:27.183798 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4601d-71d7-41f3-8506-8e40377cbc19 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-cfd4601d-71d7-41f3-8506-8e40377cbc19 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:27.195774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:27.196778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:27.197626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:27.197626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:27.197626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:27.197626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:27.197626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:27.197626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:27.197626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:27.197626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:27.197626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:27.197626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:27.197626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:27.197626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:27.197626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 01:06:27.197626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:27.197626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 406/808] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Sep 13 01:06:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:27.198536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4601d-71d7-41f3-8506-8e40377cbc19 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:27.217079 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea896ee6-7364-4b44-872b-6e503c16662a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:27.257017 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a74b1a-9fe4-4017-9864-31f3704f9dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:27.257885 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a74b1a-9fe4-4017-9864-31f3704f9dcd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:27.258352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a74b1a-9fe4-4017-9864-31f3704f9dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:27.258629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a74b1a-9fe4-4017-9864-31f3704f9dcd None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:27.259319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a74b1a-9fe4-4017-9864-31f3704f9dcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:27.259712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a74b1a-9fe4-4017-9864-31f3704f9dcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:27.260986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a74b1a-9fe4-4017-9864-31f3704f9dcd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:27.282736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 403/809] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:27.282736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a74b1a-9fe4-4017-9864-31f3704f9dcd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:27.284989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:27.332433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4601d-71d7-41f3-8506-8e40377cbc19 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:27.367273 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881530d1-4ebf-4c4e-b527-ebe4607f9fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:27.367901 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881530d1-4ebf-4c4e-b527-ebe4607f9fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:27.368175 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881530d1-4ebf-4c4e-b527-ebe4607f9fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:27.368444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881530d1-4ebf-4c4e-b527-ebe4607f9fa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:27.379395 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881530d1-4ebf-4c4e-b527-ebe4607f9fa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:27.380848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881530d1-4ebf-4c4e-b527-ebe4607f9fa6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:27.386435 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a74b1a-9fe4-4017-9864-31f3704f9dcd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-881530d1-4ebf-4c4e-b527-ebe4607f9fa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:27.395540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:27.396652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:27.397762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:27.397762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:27.397762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:27.401333 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 407/810] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:27.402067 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881530d1-4ebf-4c4e-b527-ebe4607f9fa6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:27.406956 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:27.423350 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77d612-d6b0-4082-a3cd-6a856eda17e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:27.424023 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77d612-d6b0-4082-a3cd-6a856eda17e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:27.424465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77d612-d6b0-4082-a3cd-6a856eda17e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:27.424651 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77d612-d6b0-4082-a3cd-6a856eda17e1 None admin] PATH_INFO: `/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/e2414e53593b4e2084c895651fd0d0e5/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:27.426756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77d612-d6b0-4082-a3cd-6a856eda17e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe73ceb0a582452b9b636a701adafb6f, user_id=e2414e53593b4e2084c895651fd0d0e5, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:27.428205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77d612-d6b0-4082-a3cd-6a856eda17e1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:27.441162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 404/811] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:06:27 2022] PUT /identity/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/e2414e53593b4e2084c895651fd0d0e5/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:06:27.441970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77d612-d6b0-4082-a3cd-6a856eda17e1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:27.531095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881530d1-4ebf-4c4e-b527-ebe4607f9fa6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:27.553943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:27.559802 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77d612-d6b0-4082-a3cd-6a856eda17e1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:27.571588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caffa0b-e64b-4de9-8973-c8534d236936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:27.572225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caffa0b-e64b-4de9-8973-c8534d236936 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:27.572504 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caffa0b-e64b-4de9-8973-c8534d236936 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:27.572777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caffa0b-e64b-4de9-8973-c8534d236936 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:27.573426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caffa0b-e64b-4de9-8973-c8534d236936 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:27.573728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caffa0b-e64b-4de9-8973-c8534d236936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:27.575183 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caffa0b-e64b-4de9-8973-c8534d236936 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:27.581316 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 408/812] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 13 01:06:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:27.582925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2890fb8-2c4e-4f36-99ce-93b9c7bcba05 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:27.583239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2890fb8-2c4e-4f36-99ce-93b9c7bcba05 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:27.583516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2890fb8-2c4e-4f36-99ce-93b9c7bcba05 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:27.587253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 409/813] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:27.587253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2890fb8-2c4e-4f36-99ce-93b9c7bcba05 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:27.608188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0933d33-1840-48b7-aede-1bff20d075ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:27.608845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0933d33-1840-48b7-aede-1bff20d075ce None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:27.609126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0933d33-1840-48b7-aede-1bff20d075ce None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:27.609990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0933d33-1840-48b7-aede-1bff20d075ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:27.624053 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0933d33-1840-48b7-aede-1bff20d075ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:27.625537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0933d33-1840-48b7-aede-1bff20d075ce None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f0933d33-1840-48b7-aede-1bff20d075ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:27.639050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:27.640100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:27.641066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:27.641066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:27.641066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:27.641066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:27.641066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:27.641066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:27.641066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:27.641066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:27.641066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:06:27.641066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:27.641066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 405/814] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 13 01:06:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:27.641658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0933d33-1840-48b7-aede-1bff20d075ce None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:27.690893 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:27.753931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0933d33-1840-48b7-aede-1bff20d075ce None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:27.793532 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820b860-a3e3-4541-92ad-43ec315e7b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:27.794144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820b860-a3e3-4541-92ad-43ec315e7b3d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:27.794422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820b860-a3e3-4541-92ad-43ec315e7b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:27.794693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820b860-a3e3-4541-92ad-43ec315e7b3d None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:27.795460 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820b860-a3e3-4541-92ad-43ec315e7b3d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:27.795761 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820b860-a3e3-4541-92ad-43ec315e7b3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:27.797122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820b860-a3e3-4541-92ad-43ec315e7b3d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:27.802949 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 406/815] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 13 01:06:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:27.808659 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d529e8-442b-4687-8dbe-07631534f84f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:27.809007 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d529e8-442b-4687-8dbe-07631534f84f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:27.809288 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d529e8-442b-4687-8dbe-07631534f84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:27.812250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2890fb8-2c4e-4f36-99ce-93b9c7bcba05 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:27.829673 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-83d529e8-442b-4687-8dbe-07631534f84f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:27.831330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-83d529e8-442b-4687-8dbe-07631534f84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:27.848171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f7b3c-9737-4ed0-b02a-7b343f082168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:27.848846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f7b3c-9737-4ed0-b02a-7b343f082168 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:27.849125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f7b3c-9737-4ed0-b02a-7b343f082168 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:27.849640 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f7b3c-9737-4ed0-b02a-7b343f082168 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:27.850042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f7b3c-9737-4ed0-b02a-7b343f082168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:27.850347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f7b3c-9737-4ed0-b02a-7b343f082168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:27.851749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f7b3c-9737-4ed0-b02a-7b343f082168 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:27.869068 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 410/816] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:27.869068 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f7b3c-9737-4ed0-b02a-7b343f082168 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:27.919210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 407/817] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:27.919210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d529e8-442b-4687-8dbe-07631534f84f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:27.921069 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:27.954018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:27.994668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f7b3c-9737-4ed0-b02a-7b343f082168 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:28.025447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d529e8-442b-4687-8dbe-07631534f84f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:28.046866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f156dc-f517-4d4f-9f92-a856146a560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:28.047516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f156dc-f517-4d4f-9f92-a856146a560a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:28.047795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f156dc-f517-4d4f-9f92-a856146a560a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:28.048067 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f156dc-f517-4d4f-9f92-a856146a560a None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:28.048822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f156dc-f517-4d4f-9f92-a856146a560a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:28.049128 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f156dc-f517-4d4f-9f92-a856146a560a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:28.051692 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f156dc-f517-4d4f-9f92-a856146a560a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:28.077519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 411/818] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 13 01:06:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:28.078420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f156dc-f517-4d4f-9f92-a856146a560a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:28.083199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403137cf-a8e8-46fb-89f3-ca2c053d8c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:28.083870 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403137cf-a8e8-46fb-89f3-ca2c053d8c00 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:28.084150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403137cf-a8e8-46fb-89f3-ca2c053d8c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:28.084425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403137cf-a8e8-46fb-89f3-ca2c053d8c00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:28.085131 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403137cf-a8e8-46fb-89f3-ca2c053d8c00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:28.086505 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403137cf-a8e8-46fb-89f3-ca2c053d8c00 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:28.113404 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 408/819] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:06:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:06:28.114258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403137cf-a8e8-46fb-89f3-ca2c053d8c00 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:28.207425 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f156dc-f517-4d4f-9f92-a856146a560a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:28.210548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:28.213533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:28.233815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403137cf-a8e8-46fb-89f3-ca2c053d8c00 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:28.261834 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883481bf-a99c-4775-9b56-d1bc204f47a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:28.263275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883481bf-a99c-4775-9b56-d1bc204f47a4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:28.263788 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883481bf-a99c-4775-9b56-d1bc204f47a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:28.264543 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883481bf-a99c-4775-9b56-d1bc204f47a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:28.273325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb5569-4f34-4bb7-a06a-675b894e1032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:28.273955 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb5569-4f34-4bb7-a06a-675b894e1032 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:28.274237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb5569-4f34-4bb7-a06a-675b894e1032 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:28.274578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb5569-4f34-4bb7-a06a-675b894e1032 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:28.276002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883481bf-a99c-4775-9b56-d1bc204f47a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:28.278175 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883481bf-a99c-4775-9b56-d1bc204f47a4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:28.300683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-883481bf-a99c-4775-9b56-d1bc204f47a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:28.300683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:28.300683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:28.300683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:28.300683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:28.300683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:28.300683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:28.300683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:28.300683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:28.300683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:28.300683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:28.300683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:28.300683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:28.300683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:28.300683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:28.301661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:28.302618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:28.302618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:28.302618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:28.302618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:28.302618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:28.302618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:28.302618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:28.302618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:28.304878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 412/820] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:28.305737 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883481bf-a99c-4775-9b56-d1bc204f47a4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:28.360013 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb5569-4f34-4bb7-a06a-675b894e1032 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:28.361491 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb5569-4f34-4bb7-a06a-675b894e1032 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:28.439648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883481bf-a99c-4775-9b56-d1bc204f47a4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:28.473320 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:28.488294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d90c7-7f94-4a79-95c4-f07629546d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:28.489393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d90c7-7f94-4a79-95c4-f07629546d00 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:28.489826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d90c7-7f94-4a79-95c4-f07629546d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:28.490278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d90c7-7f94-4a79-95c4-f07629546d00 None admin] PATH_INFO: `/v3/services/network` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:28.491017 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d90c7-7f94-4a79-95c4-f07629546d00 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:28.492076 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 409/821] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:06:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 01:06:28.492810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d90c7-7f94-4a79-95c4-f07629546d00 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:28.493183 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb5569-4f34-4bb7-a06a-675b894e1032 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-8c1d90c7-7f94-4a79-95c4-f07629546d00 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:28.505247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:28.506521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:28.507631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:28.507631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:28.507631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:28.507631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:28.507631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:28.507631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:28.507631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:28.507631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:28.507631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:28.507631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:28.507631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:28.507631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:28.507631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 01:06:28.507631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:28.510714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 413/822] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:28 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:28.512187 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d90c7-7f94-4a79-95c4-f07629546d00 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:28.547680 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:28.633482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb5569-4f34-4bb7-a06a-675b894e1032 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:28.641451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d90c7-7f94-4a79-95c4-f07629546d00 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:28.672871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b396fc-6391-4ded-8fb6-89d434e0974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:28.673626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b396fc-6391-4ded-8fb6-89d434e0974c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:28.674000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b396fc-6391-4ded-8fb6-89d434e0974c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:28.674961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b396fc-6391-4ded-8fb6-89d434e0974c None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:28.675943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b396fc-6391-4ded-8fb6-89d434e0974c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:28.676348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b396fc-6391-4ded-8fb6-89d434e0974c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:28.677856 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b396fc-6391-4ded-8fb6-89d434e0974c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:28.686180 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8e7ad-b5e1-427a-9ba9-ed4813df0fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:28.687198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e7ad-b5e1-427a-9ba9-ed4813df0fca None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:28.687505 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e7ad-b5e1-427a-9ba9-ed4813df0fca None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:28.687781 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e7ad-b5e1-427a-9ba9-ed4813df0fca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:28.697272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 410/823] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:28.698186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b396fc-6391-4ded-8fb6-89d434e0974c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:28.700749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8e7ad-b5e1-427a-9ba9-ed4813df0fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:28.703453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8e7ad-b5e1-427a-9ba9-ed4813df0fca None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-5df8e7ad-b5e1-427a-9ba9-ed4813df0fca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:28.728413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:28.729392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:28.730329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:28.730329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:28.730329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:28.737732 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 414/824] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:28.737732 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8e7ad-b5e1-427a-9ba9-ed4813df0fca None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:28.760378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:28.823178 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:28.837902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b396fc-6391-4ded-8fb6-89d434e0974c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:28.855671 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8e7ad-b5e1-427a-9ba9-ed4813df0fca None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:28.875149 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e69bb0-5290-4a29-acb1-f717b3e62d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:28.875760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e69bb0-5290-4a29-acb1-f717b3e62d0f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:28.876035 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e69bb0-5290-4a29-acb1-f717b3e62d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:28.876305 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e69bb0-5290-4a29-acb1-f717b3e62d0f None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:28.876930 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e69bb0-5290-4a29-acb1-f717b3e62d0f None admin] RBAC: Adding query filter params (name=network) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:28.877226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e69bb0-5290-4a29-acb1-f717b3e62d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:28.878660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e69bb0-5290-4a29-acb1-f717b3e62d0f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:28.883441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 411/825] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 13 01:06:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:28.887890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e69bb0-5290-4a29-acb1-f717b3e62d0f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:28.902040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be994c-c378-494f-acf8-258cf27d2893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:28.903335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be994c-c378-494f-acf8-258cf27d2893 None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:28.903863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be994c-c378-494f-acf8-258cf27d2893 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:28.904600 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be994c-c378-494f-acf8-258cf27d2893 None admin] PATH_INFO: `/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/da83fb76a0b04aa2bdb91f6c25dc6cc6/roles/e55e17c894314bc6a5772b2de35b4874` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:28.925846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be994c-c378-494f-acf8-258cf27d2893 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe73ceb0a582452b9b636a701adafb6f, user_id=da83fb76a0b04aa2bdb91f6c25dc6cc6, role_id=e55e17c894314bc6a5772b2de35b4874)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:28.928463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be994c-c378-494f-acf8-258cf27d2893 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:28.946588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 415/826] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:06:28 2022] PUT /identity/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/da83fb76a0b04aa2bdb91f6c25dc6cc6/roles/e55e17c894314bc6a5772b2de35b4874 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:06:28.947824 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be994c-c378-494f-acf8-258cf27d2893 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:29.056143 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e69bb0-5290-4a29-acb1-f717b3e62d0f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:29.074309 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:29.087243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be994c-c378-494f-acf8-258cf27d2893 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:29.122839 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:29.134894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfd420-eb4a-411b-9c18-9aeee47caea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:29.135875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfd420-eb4a-411b-9c18-9aeee47caea2 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:29.136695 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfd420-eb4a-411b-9c18-9aeee47caea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:29.137161 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfd420-eb4a-411b-9c18-9aeee47caea2 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:29.138347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfd420-eb4a-411b-9c18-9aeee47caea2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:29.138846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfd420-eb4a-411b-9c18-9aeee47caea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:29.141075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfd420-eb4a-411b-9c18-9aeee47caea2 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:29.148527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 416/827] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 13 01:06:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:29.151770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818da2b-03ff-493e-981f-ecb791a49f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:29.153081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818da2b-03ff-493e-981f-ecb791a49f15 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:29.153558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818da2b-03ff-493e-981f-ecb791a49f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:29.154025 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818da2b-03ff-493e-981f-ecb791a49f15 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:29.155379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfd420-eb4a-411b-9c18-9aeee47caea2 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:29.156761 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818da2b-03ff-493e-981f-ecb791a49f15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:29.162455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818da2b-03ff-493e-981f-ecb791a49f15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:29.164263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818da2b-03ff-493e-981f-ecb791a49f15 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:29.190920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 412/828] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:29.194242 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818da2b-03ff-493e-981f-ecb791a49f15 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:29.294169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfd420-eb4a-411b-9c18-9aeee47caea2 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:29.323325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818da2b-03ff-493e-981f-ecb791a49f15 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:29.363626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b76f42-61a2-4adf-8ba0-572c18c3bbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:29.365037 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b76f42-61a2-4adf-8ba0-572c18c3bbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:29.365529 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b76f42-61a2-4adf-8ba0-572c18c3bbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:29.365993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b76f42-61a2-4adf-8ba0-572c18c3bbc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:29.373732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b76f42-61a2-4adf-8ba0-572c18c3bbc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:29.375416 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b76f42-61a2-4adf-8ba0-572c18c3bbc5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:29.379763 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc2f35-860a-40bd-9cad-b06d126cbb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:29.380384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc2f35-860a-40bd-9cad-b06d126cbb45 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:29.380659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc2f35-860a-40bd-9cad-b06d126cbb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:29.380931 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc2f35-860a-40bd-9cad-b06d126cbb45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:29.381602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc2f35-860a-40bd-9cad-b06d126cbb45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:29.382963 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc2f35-860a-40bd-9cad-b06d126cbb45 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:29.389260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-60b76f42-61a2-4adf-8ba0-572c18c3bbc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:29.389260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:29.389260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:29.389260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:29.389260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:29.389260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:29.389260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:29.389260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:29.389260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:29.389260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:29.389260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:29.389260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:29.389260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:29.389260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:29.389260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:29.390237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:29.391191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:29.391191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:29.391191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:29.391191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:29.391191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:29.391191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:29.391191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:29.391191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:29.394053 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 413/829] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:29.400033 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b76f42-61a2-4adf-8ba0-572c18c3bbc5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:29.437247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:29.463022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 417/830] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:06:29 2022] POST /identity/v3/endpoints => generated 337 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:06:29.538060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b76f42-61a2-4adf-8ba0-572c18c3bbc5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:29.586813 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685dd79-5e1d-46a4-9e5d-5bb5ae59a780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:29.587763 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685dd79-5e1d-46a4-9e5d-5bb5ae59a780 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:29.588230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685dd79-5e1d-46a4-9e5d-5bb5ae59a780 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:29.588698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685dd79-5e1d-46a4-9e5d-5bb5ae59a780 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:29.589672 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685dd79-5e1d-46a4-9e5d-5bb5ae59a780 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:29.590206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685dd79-5e1d-46a4-9e5d-5bb5ae59a780 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:29.591890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685dd79-5e1d-46a4-9e5d-5bb5ae59a780 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:29.606295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 414/831] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:29.613306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc2f35-860a-40bd-9cad-b06d126cbb45 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:29.673852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:29.732988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc2f35-860a-40bd-9cad-b06d126cbb45 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:29.748065 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2ea6e-7ed3-40ee-bc35-e9ff8a5bca49 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:29.748343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2ea6e-7ed3-40ee-bc35-e9ff8a5bca49 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:29.748613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2ea6e-7ed3-40ee-bc35-e9ff8a5bca49 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:29.755453 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 415/832] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:06:29.756979 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101511c-b22c-4b67-92f3-f69300982fc6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:29.757263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101511c-b22c-4b67-92f3-f69300982fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:29.757540 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101511c-b22c-4b67-92f3-f69300982fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:29.773177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e29e66-6fb0-40dd-a0fa-ae85f0c2f2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:29.773791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e29e66-6fb0-40dd-a0fa-ae85f0c2f2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:29.774075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e29e66-6fb0-40dd-a0fa-ae85f0c2f2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:29.774350 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e29e66-6fb0-40dd-a0fa-ae85f0c2f2c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:29.775110 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e29e66-6fb0-40dd-a0fa-ae85f0c2f2c5 None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=fadc83bec6be41979e1aa4d71f8fc2bd) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:29.775421 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e29e66-6fb0-40dd-a0fa-ae85f0c2f2c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:29.776861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e29e66-6fb0-40dd-a0fa-ae85f0c2f2c5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:29.779586 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e101511c-b22c-4b67-92f3-f69300982fc6 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:29.781038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e101511c-b22c-4b67-92f3-f69300982fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:29.783464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 418/833] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:06:29 2022] GET /identity/v3/role_assignments?user.id=fadc83bec6be41979e1aa4d71f8fc2bd&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=3799feb4caa64e568971222375957f54 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:29.856899 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 416/834] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:30.140248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e29e66-6fb0-40dd-a0fa-ae85f0c2f2c5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:30.251942 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e29e66-6fb0-40dd-a0fa-ae85f0c2f2c5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:30.265945 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:30.293555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c70752-c61d-48ed-9ec1-d2181bcffbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:30.294194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c70752-c61d-48ed-9ec1-d2181bcffbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:30.294473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c70752-c61d-48ed-9ec1-d2181bcffbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:30.294747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c70752-c61d-48ed-9ec1-d2181bcffbb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:30.305929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c70752-c61d-48ed-9ec1-d2181bcffbb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-50c70752-c61d-48ed-9ec1-d2181bcffbb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:30.311195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:30.312135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:30.312964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:30.312964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:30.312964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:30.312964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:30.312964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:30.312964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:30.312964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:30.312964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:30.312964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:30.312964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:30.312964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:06:30.312964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:30.312964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 419/835] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:06:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:30.320520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101511c-b22c-4b67-92f3-f69300982fc6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:30.343210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:30.432585 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101511c-b22c-4b67-92f3-f69300982fc6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:30.467470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c6767-3150-475c-9bb7-59d53244ecaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:30.468082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c6767-3150-475c-9bb7-59d53244ecaf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:30.468361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c6767-3150-475c-9bb7-59d53244ecaf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:30.468633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c6767-3150-475c-9bb7-59d53244ecaf None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:30.469296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c6767-3150-475c-9bb7-59d53244ecaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:30.469600 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c6767-3150-475c-9bb7-59d53244ecaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:30.470964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c6767-3150-475c-9bb7-59d53244ecaf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:30.480130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 417/836] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:06:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:30.485630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c70752-c61d-48ed-9ec1-d2181bcffbb7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:30.600611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c70752-c61d-48ed-9ec1-d2181bcffbb7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:30.636335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8030c-f423-476a-98fc-56bcebd0018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:30.636971 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8030c-f423-476a-98fc-56bcebd0018a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:30.637250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8030c-f423-476a-98fc-56bcebd0018a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:30.637529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8030c-f423-476a-98fc-56bcebd0018a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:30.650289 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8030c-f423-476a-98fc-56bcebd0018a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:30.651974 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8030c-f423-476a-98fc-56bcebd0018a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-c9a8030c-f423-476a-98fc-56bcebd0018a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:30.667602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:30.668591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:30.669489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:30.669489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:30.669489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:30.669489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 420/837] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:30.676051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c6767-3150-475c-9bb7-59d53244ecaf None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:30.701983 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d36be-6591-42bc-94fe-2b9da2cc303f None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:30.702270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d36be-6591-42bc-94fe-2b9da2cc303f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:30.702467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d36be-6591-42bc-94fe-2b9da2cc303f None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:30.704242 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 421/838] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:06:30.709707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90978de-d49e-418d-83b5-ecee395d2abf None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:30.709991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90978de-d49e-418d-83b5-ecee395d2abf None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:30.710271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90978de-d49e-418d-83b5-ecee395d2abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:30.730475 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e90978de-d49e-418d-83b5-ecee395d2abf None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:30.731836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e90978de-d49e-418d-83b5-ecee395d2abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:30.751355 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:30.761849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:30.784756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c6767-3150-475c-9bb7-59d53244ecaf None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:30.816693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 422/839] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:30.819729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449457a-e511-4918-948f-9a97095edc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:30.820406 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449457a-e511-4918-948f-9a97095edc15 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:30.820757 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449457a-e511-4918-948f-9a97095edc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:30.821100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449457a-e511-4918-948f-9a97095edc15 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:30.821896 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449457a-e511-4918-948f-9a97095edc15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:30.822273 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449457a-e511-4918-948f-9a97095edc15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:30.823781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449457a-e511-4918-948f-9a97095edc15 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:30.838435 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 418/840] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:30.843962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90978de-d49e-418d-83b5-ecee395d2abf None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:30.948338 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90978de-d49e-418d-83b5-ecee395d2abf None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:30.983997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe597b17-4ccb-475d-9d99-e21e0320be82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:30.984927 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe597b17-4ccb-475d-9d99-e21e0320be82 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:30.985378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe597b17-4ccb-475d-9d99-e21e0320be82 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:30.985823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe597b17-4ccb-475d-9d99-e21e0320be82 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:30.994238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe597b17-4ccb-475d-9d99-e21e0320be82 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:30.995955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe597b17-4ccb-475d-9d99-e21e0320be82 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-fe597b17-4ccb-475d-9d99-e21e0320be82 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:31.008770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:31.009707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:31.010752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:31.010752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:31.010752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:31.010752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:31.010752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:31.010752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:31.010752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:31.010752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:31.010752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 01:06:31.010752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:31.012834 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 423/841] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:06:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:31.019109 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449457a-e511-4918-948f-9a97095edc15 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:31.126730 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449457a-e511-4918-948f-9a97095edc15 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:31.129227 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe597b17-4ccb-475d-9d99-e21e0320be82 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:31.148018 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:31.162946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672db1a5-1d8e-4dde-9a96-f5b72b67db9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:31.163593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672db1a5-1d8e-4dde-9a96-f5b72b67db9a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:31.163886 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672db1a5-1d8e-4dde-9a96-f5b72b67db9a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:31.164146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672db1a5-1d8e-4dde-9a96-f5b72b67db9a None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:31.164867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672db1a5-1d8e-4dde-9a96-f5b72b67db9a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:31.165176 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672db1a5-1d8e-4dde-9a96-f5b72b67db9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:31.166606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672db1a5-1d8e-4dde-9a96-f5b72b67db9a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:31.175587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:31.186576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 419/842] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Sep 13 01:06:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:31.192344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672db1a5-1d8e-4dde-9a96-f5b72b67db9a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:31.246593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe597b17-4ccb-475d-9d99-e21e0320be82 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:31.289806 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ac1be-d9f2-452c-a7d1-c7b722ce28c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:31.290850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ac1be-d9f2-452c-a7d1-c7b722ce28c7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:31.291360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ac1be-d9f2-452c-a7d1-c7b722ce28c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:31.291838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ac1be-d9f2-452c-a7d1-c7b722ce28c7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:31.292640 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ac1be-d9f2-452c-a7d1-c7b722ce28c7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:31.294217 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ac1be-d9f2-452c-a7d1-c7b722ce28c7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-728ac1be-d9f2-452c-a7d1-c7b722ce28c7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:31.304378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:31.305391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:31.306250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:31.306250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:31.306250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:31.306250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:31.306250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:31.306250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:31.306250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:31.306250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:31.306250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:31.306250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:31.306250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:31.306250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:31.306250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 01:06:31.306250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:31.314501 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 424/843] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:06:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:31.316413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ac1be-d9f2-452c-a7d1-c7b722ce28c7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:31.324455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672db1a5-1d8e-4dde-9a96-f5b72b67db9a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:31.365045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524f80a-2660-48f0-9818-909a4e653073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:31.366064 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524f80a-2660-48f0-9818-909a4e653073 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:31.366554 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524f80a-2660-48f0-9818-909a4e653073 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:31.367095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524f80a-2660-48f0-9818-909a4e653073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:31.428774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:31.452823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ac1be-d9f2-452c-a7d1-c7b722ce28c7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:31.454960 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:31.464585 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524f80a-2660-48f0-9818-909a4e653073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:31.466863 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524f80a-2660-48f0-9818-909a4e653073 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:31.490041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be34ad-b572-4c97-bccf-69dac72ae349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:31.490649 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be34ad-b572-4c97-bccf-69dac72ae349 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:31.490994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be34ad-b572-4c97-bccf-69dac72ae349 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:31.491309 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be34ad-b572-4c97-bccf-69dac72ae349 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:31.492272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be34ad-b572-4c97-bccf-69dac72ae349 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:31.492272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be34ad-b572-4c97-bccf-69dac72ae349 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:31.493592 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be34ad-b572-4c97-bccf-69dac72ae349 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:31.499453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 425/844] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:06:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:31.499453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a0493-8da4-4521-92a6-51a591ee7086 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:31.499658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a0493-8da4-4521-92a6-51a591ee7086 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:31.499935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a0493-8da4-4521-92a6-51a591ee7086 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:31.501437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 426/845] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:31.505659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a0493-8da4-4521-92a6-51a591ee7086 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:31.579245 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 420/846] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:06:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 01:06:31.585765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7190e8-d72a-4424-9206-b48ca4ca89d3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:31.586047 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7190e8-d72a-4424-9206-b48ca4ca89d3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:31.586317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7190e8-d72a-4424-9206-b48ca4ca89d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:31.605211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0a7190e8-d72a-4424-9206-b48ca4ca89d3 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:31.606216 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0a7190e8-d72a-4424-9206-b48ca4ca89d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:31.612686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a0493-8da4-4521-92a6-51a591ee7086 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:31.649246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90c64-31e3-4bd7-be20-ee9f0391c002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:31.650186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90c64-31e3-4bd7-be20-ee9f0391c002 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:31.651142 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90c64-31e3-4bd7-be20-ee9f0391c002 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:31.651621 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90c64-31e3-4bd7-be20-ee9f0391c002 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:31.652827 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a90c64-31e3-4bd7-be20-ee9f0391c002 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:31.653346 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a90c64-31e3-4bd7-be20-ee9f0391c002 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:31.655647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a90c64-31e3-4bd7-be20-ee9f0391c002 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:31.662378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 427/847] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:06:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:31.663943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90c64-31e3-4bd7-be20-ee9f0391c002 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:31.687106 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 421/848] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:31.707016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:31.791872 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90c64-31e3-4bd7-be20-ee9f0391c002 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:31.832915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787c89f-9426-48e8-ab33-531953b159b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:31.833601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787c89f-9426-48e8-ab33-531953b159b4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:31.833882 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787c89f-9426-48e8-ab33-531953b159b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:31.834150 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787c89f-9426-48e8-ab33-531953b159b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:31.846658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787c89f-9426-48e8-ab33-531953b159b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:31.848482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787c89f-9426-48e8-ab33-531953b159b4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-c787c89f-9426-48e8-ab33-531953b159b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:31.864994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:31.866010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:31.866913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:31.866913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:31.866913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:31.866913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 428/849] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:31.872006 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7190e8-d72a-4424-9206-b48ca4ca89d3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:31.914644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:31.954695 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787c89f-9426-48e8-ab33-531953b159b4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:31.986727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7190e8-d72a-4424-9206-b48ca4ca89d3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:32.023541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c129911-be13-4810-a307-c3a26ce9f6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:32.024155 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c129911-be13-4810-a307-c3a26ce9f6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:32.024433 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c129911-be13-4810-a307-c3a26ce9f6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:32.024707 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c129911-be13-4810-a307-c3a26ce9f6b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:32.025354 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c129911-be13-4810-a307-c3a26ce9f6b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:32.025657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c129911-be13-4810-a307-c3a26ce9f6b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:32.026283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:32.027030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c129911-be13-4810-a307-c3a26ce9f6b6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:32.039983 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 422/850] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:32.046415 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c129911-be13-4810-a307-c3a26ce9f6b6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:32.083770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787c89f-9426-48e8-ab33-531953b159b4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:32.129824 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667e811-8876-4aec-afe7-7542c14a50af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:32.130462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667e811-8876-4aec-afe7-7542c14a50af None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:32.130738 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667e811-8876-4aec-afe7-7542c14a50af None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:32.131009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667e811-8876-4aec-afe7-7542c14a50af None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:32.142365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667e811-8876-4aec-afe7-7542c14a50af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:32.145400 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-1667e811-8876-4aec-afe7-7542c14a50af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:32.150254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:32.151826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:32.152851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:32.152851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:32.152851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:32.152851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:32.152851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:32.152851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:32.152851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:32.152851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:32.152851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:32.152851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:32.152851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:06:32.152851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:32.155907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 429/851] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:06:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:32.163114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c129911-be13-4810-a307-c3a26ce9f6b6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:32.164315 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667e811-8876-4aec-afe7-7542c14a50af None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:32.197618 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece58cdd-62ce-47b3-b8f4-1ea37074d3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:32.198263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece58cdd-62ce-47b3-b8f4-1ea37074d3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:32.198542 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece58cdd-62ce-47b3-b8f4-1ea37074d3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:32.198816 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece58cdd-62ce-47b3-b8f4-1ea37074d3d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:32.207536 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece58cdd-62ce-47b3-b8f4-1ea37074d3d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:32.209719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece58cdd-62ce-47b3-b8f4-1ea37074d3d8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:32.222261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-ece58cdd-62ce-47b3-b8f4-1ea37074d3d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:32.222261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:32.222261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:32.222261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:32.222261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:32.222261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:32.222261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:32.222261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:32.222261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:32.222261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:32.222261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:32.222261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:32.222261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:32.222261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:32.222261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:32.223270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:32.224153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:32.224153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:32.224153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:32.224153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:32.224153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:32.224153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:32.224153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:32.224153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:32.224153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 423/852] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:32.225176 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb38ff9-e452-44e1-b83b-283e09daaf2c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:32.225176 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb38ff9-e452-44e1-b83b-283e09daaf2c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:32.225176 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb38ff9-e452-44e1-b83b-283e09daaf2c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:32.226527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 424/853] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:32.231170 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb38ff9-e452-44e1-b83b-283e09daaf2c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:32.288231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667e811-8876-4aec-afe7-7542c14a50af None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:32.307552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:32.325118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c20cc-a490-4206-b571-cbda55b6e8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:32.325976 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c20cc-a490-4206-b571-cbda55b6e8ff None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:32.326254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c20cc-a490-4206-b571-cbda55b6e8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:32.326522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c20cc-a490-4206-b571-cbda55b6e8ff None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:32.327210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c20cc-a490-4206-b571-cbda55b6e8ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:32.327518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c20cc-a490-4206-b571-cbda55b6e8ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:32.328883 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c20cc-a490-4206-b571-cbda55b6e8ff None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:32.341771 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 430/854] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:06:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:32.341771 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f84101-7621-403e-9129-7be656333253 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:32.341771 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f84101-7621-403e-9129-7be656333253 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:32.341771 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f84101-7621-403e-9129-7be656333253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:32.343362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb38ff9-e452-44e1-b83b-283e09daaf2c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:32.360535 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f3f84101-7621-403e-9129-7be656333253 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:32.362355 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f3f84101-7621-403e-9129-7be656333253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:32.379372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc8b37-7b84-43af-a0f7-79d0e63f584b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:32.380340 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc8b37-7b84-43af-a0f7-79d0e63f584b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:32.380802 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc8b37-7b84-43af-a0f7-79d0e63f584b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:32.381275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc8b37-7b84-43af-a0f7-79d0e63f584b None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:32.382129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc8b37-7b84-43af-a0f7-79d0e63f584b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:32.382589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc8b37-7b84-43af-a0f7-79d0e63f584b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:32.384326 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc8b37-7b84-43af-a0f7-79d0e63f584b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:32.398139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 425/855] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:32.399362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc8b37-7b84-43af-a0f7-79d0e63f584b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:32.409506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:32.447247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 431/856] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:32.447247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f84101-7621-403e-9129-7be656333253 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:32.519533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc8b37-7b84-43af-a0f7-79d0e63f584b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:32.555329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd21c4-4471-4871-8eba-3490abef27c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:32.556227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd21c4-4471-4871-8eba-3490abef27c6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:32.556663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd21c4-4471-4871-8eba-3490abef27c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:32.557124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd21c4-4471-4871-8eba-3490abef27c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:32.571362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd21c4-4471-4871-8eba-3490abef27c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:32.573017 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd21c4-4471-4871-8eba-3490abef27c6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:32.573621 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f84101-7621-403e-9129-7be656333253 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:32.588323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-4fdd21c4-4471-4871-8eba-3490abef27c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:32.593372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:32.594333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:32.595606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:32.595606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:32.595606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:32.597771 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 426/857] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:32.602770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd21c4-4471-4871-8eba-3490abef27c6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:32.623440 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b06a3-5a7c-4f8d-8fe8-d1405996e26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:32.624079 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b06a3-5a7c-4f8d-8fe8-d1405996e26c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:32.624355 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b06a3-5a7c-4f8d-8fe8-d1405996e26c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:32.624626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b06a3-5a7c-4f8d-8fe8-d1405996e26c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:32.625448 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b06a3-5a7c-4f8d-8fe8-d1405996e26c None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=e2414e53593b4e2084c895651fd0d0e5) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:32.625762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b06a3-5a7c-4f8d-8fe8-d1405996e26c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:32.628402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b06a3-5a7c-4f8d-8fe8-d1405996e26c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:32.639146 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 432/858] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:06:32 2022] GET /identity/v3/role_assignments?user.id=e2414e53593b4e2084c895651fd0d0e5&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=3799feb4caa64e568971222375957f54 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:32.683350 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:32.732747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd21c4-4471-4871-8eba-3490abef27c6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:32.733767 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b06a3-5a7c-4f8d-8fe8-d1405996e26c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:32.780961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f178c85-b6e9-4f6b-aed1-c62a97d0620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:32.781591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f178c85-b6e9-4f6b-aed1-c62a97d0620b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:32.781874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f178c85-b6e9-4f6b-aed1-c62a97d0620b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:32.782146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f178c85-b6e9-4f6b-aed1-c62a97d0620b None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:32.784062 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f178c85-b6e9-4f6b-aed1-c62a97d0620b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:32.785764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f178c85-b6e9-4f6b-aed1-c62a97d0620b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:32.788617 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f178c85-b6e9-4f6b-aed1-c62a97d0620b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:32.804962 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 427/859] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:32.811016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f178c85-b6e9-4f6b-aed1-c62a97d0620b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:32.870936 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b06a3-5a7c-4f8d-8fe8-d1405996e26c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:32.914818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86c0d6-9f06-4da1-b134-8a8624b2c93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:32.915481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86c0d6-9f06-4da1-b134-8a8624b2c93c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:32.915761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86c0d6-9f06-4da1-b134-8a8624b2c93c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:32.916036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86c0d6-9f06-4da1-b134-8a8624b2c93c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:32.916622 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86c0d6-9f06-4da1-b134-8a8624b2c93c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:32.917983 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86c0d6-9f06-4da1-b134-8a8624b2c93c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-df86c0d6-9f06-4da1-b134-8a8624b2c93c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:32.929647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:32.930703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:32.931669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:32.931669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:32.931669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:32.931669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:32.931669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:32.931669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:32.931669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:32.931669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:32.931669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:32.931669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:32.931669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:32.931669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:32.931669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 01:06:32.931669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:32.931669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 433/860] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Sep 13 01:06:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:32.935575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f178c85-b6e9-4f6b-aed1-c62a97d0620b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:32.936589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86c0d6-9f06-4da1-b134-8a8624b2c93c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:32.957776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:32.978793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ef412-26b9-470c-a80d-355f2b492285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:32.979785 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:32.981296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ef412-26b9-470c-a80d-355f2b492285 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:32.981784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ef412-26b9-470c-a80d-355f2b492285 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:32.982323 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ef412-26b9-470c-a80d-355f2b492285 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:32.991595 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ef412-26b9-470c-a80d-355f2b492285 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:32.993340 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ef412-26b9-470c-a80d-355f2b492285 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-647ef412-26b9-470c-a80d-355f2b492285 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:33.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:33.008911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:33.009891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:33.009891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:33.009891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:33.009891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:33.009891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:33.009891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:33.009891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:33.009891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:33.009891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 01:06:33.009891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:33.013456 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 428/861] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 13 01:06:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:33.023181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ef412-26b9-470c-a80d-355f2b492285 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:33.046457 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86c0d6-9f06-4da1-b134-8a8624b2c93c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:33.084103 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3b9dc-6e90-43e0-98c6-837df6328ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:33.084837 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3b9dc-6e90-43e0-98c6-837df6328ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:33.085118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3b9dc-6e90-43e0-98c6-837df6328ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:33.085391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3b9dc-6e90-43e0-98c6-837df6328ce8 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:33.086020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3b9dc-6e90-43e0-98c6-837df6328ce8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:33.086321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3b9dc-6e90-43e0-98c6-837df6328ce8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:33.087783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3b9dc-6e90-43e0-98c6-837df6328ce8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:33.098101 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 434/862] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 13 01:06:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:33.099442 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3b9dc-6e90-43e0-98c6-837df6328ce8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:33.152658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ef412-26b9-470c-a80d-355f2b492285 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:33.191677 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba7c6-1887-47dd-a438-7d484602b2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:33.192440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba7c6-1887-47dd-a438-7d484602b2dc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:33.192841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba7c6-1887-47dd-a438-7d484602b2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:33.193219 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba7c6-1887-47dd-a438-7d484602b2dc None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:33.194058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba7c6-1887-47dd-a438-7d484602b2dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:33.194467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba7c6-1887-47dd-a438-7d484602b2dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:33.196796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba7c6-1887-47dd-a438-7d484602b2dc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:33.204826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3b9dc-6e90-43e0-98c6-837df6328ce8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:33.207286 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:33.218023 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 429/863] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Sep 13 01:06:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:33.223869 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba7c6-1887-47dd-a438-7d484602b2dc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:33.248422 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1762753-9387-4a88-b90f-86e3258fb8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:33.249035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762753-9387-4a88-b90f-86e3258fb8cc None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:33.249315 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762753-9387-4a88-b90f-86e3258fb8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:33.249591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762753-9387-4a88-b90f-86e3258fb8cc None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:33.250338 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1762753-9387-4a88-b90f-86e3258fb8cc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:33.250523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1762753-9387-4a88-b90f-86e3258fb8cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:33.251981 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1762753-9387-4a88-b90f-86e3258fb8cc None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:33.263334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 435/864] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 13 01:06:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:33.271964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:33.358982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba7c6-1887-47dd-a438-7d484602b2dc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:33.400704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89070b0b-2c99-487b-a04c-5d9cc1ace987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:33.401615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89070b0b-2c99-487b-a04c-5d9cc1ace987 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:33.402066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89070b0b-2c99-487b-a04c-5d9cc1ace987 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:33.402487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89070b0b-2c99-487b-a04c-5d9cc1ace987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:33.479682 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89070b0b-2c99-487b-a04c-5d9cc1ace987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:33.481370 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89070b0b-2c99-487b-a04c-5d9cc1ace987 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:33.518763 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:33.595170 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 430/865] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:06:33 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 01:06:33.597641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1762753-9387-4a88-b90f-86e3258fb8cc None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:33.712265 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1762753-9387-4a88-b90f-86e3258fb8cc None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:33.747767 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0a371-6968-41db-8966-14568a78f9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:33.748717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0a371-6968-41db-8966-14568a78f9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:33.749143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0a371-6968-41db-8966-14568a78f9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:33.749554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0a371-6968-41db-8966-14568a78f9c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:33.761273 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0a371-6968-41db-8966-14568a78f9c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:33.762904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0a371-6968-41db-8966-14568a78f9c3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-24a0a371-6968-41db-8966-14568a78f9c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:33.777934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:33.784135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:33.785024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:33.785024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:33.785024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:33.785024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 436/866] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:33.788606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89070b0b-2c99-487b-a04c-5d9cc1ace987 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:33.899690 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89070b0b-2c99-487b-a04c-5d9cc1ace987 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:33.931679 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700b1b3-a2d3-4bbe-b38d-123a49bd8c7f None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:33.932009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700b1b3-a2d3-4bbe-b38d-123a49bd8c7f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:33.932240 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700b1b3-a2d3-4bbe-b38d-123a49bd8c7f None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:33.933847 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 437/867] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:06:33.937942 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3260fe-816b-4585-838b-0aedee99970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:33.938774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc1b6c-477c-4be8-9c6d-ac6f8a2efaad None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:33.939080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc1b6c-477c-4be8-9c6d-ac6f8a2efaad None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:33.939202 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3260fe-816b-4585-838b-0aedee99970b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:33.939366 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc1b6c-477c-4be8-9c6d-ac6f8a2efaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:33.940035 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3260fe-816b-4585-838b-0aedee99970b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:33.940597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3260fe-816b-4585-838b-0aedee99970b None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:33.941465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3260fe-816b-4585-838b-0aedee99970b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:33.942073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3260fe-816b-4585-838b-0aedee99970b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:33.943842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3260fe-816b-4585-838b-0aedee99970b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:33.946836 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:33.960390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 431/868] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:33.960664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-69dc1b6c-477c-4be8-9c6d-ac6f8a2efaad None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:33.965347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-69dc1b6c-477c-4be8-9c6d-ac6f8a2efaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:33.967454 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3260fe-816b-4585-838b-0aedee99970b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:33.977791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:34.047212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 438/869] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:34.102500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3260fe-816b-4585-838b-0aedee99970b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:34.143389 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dd414-0768-4349-a084-69938d2f426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:34.144027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dd414-0768-4349-a084-69938d2f426b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:34.144308 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dd414-0768-4349-a084-69938d2f426b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:34.144578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dd414-0768-4349-a084-69938d2f426b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:34.151469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505dd414-0768-4349-a084-69938d2f426b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:34.152915 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505dd414-0768-4349-a084-69938d2f426b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:34.164623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-505dd414-0768-4349-a084-69938d2f426b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:34.164623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:34.164623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:34.164623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:34.164623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:34.164623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:34.164623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:34.164623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:34.164623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:34.164623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:34.164623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:34.164623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:34.164623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:34.164623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:34.164623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:34.165523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:34.166425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:34.166425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:34.166425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:34.166425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:34.166425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:34.166425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:34.166425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:34.166425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:34.166425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 432/870] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:34.173087 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc1b6c-477c-4be8-9c6d-ac6f8a2efaad None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:34.279874 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc1b6c-477c-4be8-9c6d-ac6f8a2efaad None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:34.316332 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecf636-0aa4-4fc6-b883-dd447b1ffcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:34.317463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecf636-0aa4-4fc6-b883-dd447b1ffcee None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:34.317961 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecf636-0aa4-4fc6-b883-dd447b1ffcee None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:34.318426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecf636-0aa4-4fc6-b883-dd447b1ffcee None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:34.319341 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecf636-0aa4-4fc6-b883-dd447b1ffcee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:34.319853 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecf636-0aa4-4fc6-b883-dd447b1ffcee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:34.321467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecf636-0aa4-4fc6-b883-dd447b1ffcee None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:34.334419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 439/871] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:34.340597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dd414-0768-4349-a084-69938d2f426b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:34.348674 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecf636-0aa4-4fc6-b883-dd447b1ffcee None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:34.362121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:34.417583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:34.477074 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dd414-0768-4349-a084-69938d2f426b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:34.478140 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecf636-0aa4-4fc6-b883-dd447b1ffcee None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:34.515275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dd41c-8f3f-4452-a267-d68d7be92659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:34.516264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dd41c-8f3f-4452-a267-d68d7be92659 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:34.516739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dd41c-8f3f-4452-a267-d68d7be92659 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:34.517118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dd41c-8f3f-4452-a267-d68d7be92659 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:34.517526 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c192433-5074-410b-83ae-ddb75ec14763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:34.518238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75dd41c-8f3f-4452-a267-d68d7be92659 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:34.518566 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c192433-5074-410b-83ae-ddb75ec14763 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:34.518993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c192433-5074-410b-83ae-ddb75ec14763 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:34.519532 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c192433-5074-410b-83ae-ddb75ec14763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:34.519978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75dd41c-8f3f-4452-a267-d68d7be92659 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:34.520646 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c192433-5074-410b-83ae-ddb75ec14763 None admin] RBAC: Adding query filter params (role.id=e55e17c894314bc6a5772b2de35b4874, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=da83fb76a0b04aa2bdb91f6c25dc6cc6) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:34.521140 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c192433-5074-410b-83ae-ddb75ec14763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:34.522698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c192433-5074-410b-83ae-ddb75ec14763 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:34.529996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 433/872] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:06:34 2022] GET /identity/v3/role_assignments?user.id=da83fb76a0b04aa2bdb91f6c25dc6cc6&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=e55e17c894314bc6a5772b2de35b4874 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:34.545044 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 440/873] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 13 01:06:34 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:06:35.000133 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1276e-56e8-47b6-9faf-bf6edefc95c6 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:35.000324 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1276e-56e8-47b6-9faf-bf6edefc95c6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:35.000601 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1276e-56e8-47b6-9faf-bf6edefc95c6 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:35.002737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 434/874] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:35.008275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e8a84-7a1e-49df-98d2-16c22f1c33d5 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:35.008567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e8a84-7a1e-49df-98d2-16c22f1c33d5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:35.008845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e8a84-7a1e-49df-98d2-16c22f1c33d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:35.027811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bf7e8a84-7a1e-49df-98d2-16c22f1c33d5 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:35.029008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bf7e8a84-7a1e-49df-98d2-16c22f1c33d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:35.103764 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:35.120359 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 441/875] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:35 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:35.395008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1276e-56e8-47b6-9faf-bf6edefc95c6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:35.483565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfeb83-2724-42f2-8b99-45960b2f8798 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:35.484086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfeb83-2724-42f2-8b99-45960b2f8798 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:35.484086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfeb83-2724-42f2-8b99-45960b2f8798 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:35.486949 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 442/876] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:35.491161 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787a571-bc1f-49ac-870f-9f849f918504 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:35.491447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787a571-bc1f-49ac-870f-9f849f918504 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:35.491726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787a571-bc1f-49ac-870f-9f849f918504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:35.509596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1276e-56e8-47b6-9faf-bf6edefc95c6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:35.513852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4787a571-bc1f-49ac-870f-9f849f918504 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:35.515330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4787a571-bc1f-49ac-870f-9f849f918504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:35.532956 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:35.554838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fcfd7-a636-4cc5-9727-19d6afb00dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:35.555867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fcfd7-a636-4cc5-9727-19d6afb00dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:35.556371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fcfd7-a636-4cc5-9727-19d6afb00dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:35.556862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fcfd7-a636-4cc5-9727-19d6afb00dc1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:35.557661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fcfd7-a636-4cc5-9727-19d6afb00dc1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:35.559365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fcfd7-a636-4cc5-9727-19d6afb00dc1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-b56fcfd7-a636-4cc5-9727-19d6afb00dc1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:35.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:35.570768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:35.571733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:35.571733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:35.571733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:35.571733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:35.571733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:35.571733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:35.571733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:35.571733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:35.571733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:35.571733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:35.571733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:35.571733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:35.571733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 01:06:35.571733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:35.574279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 435/877] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 13 01:06:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:35.582545 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fcfd7-a636-4cc5-9727-19d6afb00dc1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:35.604747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 443/878] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:35 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:35.688126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fcfd7-a636-4cc5-9727-19d6afb00dc1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:35.723207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfbe58-3488-450d-8244-a85442539754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:35.724100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfbe58-3488-450d-8244-a85442539754 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:35.724539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfbe58-3488-450d-8244-a85442539754 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:35.724968 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfbe58-3488-450d-8244-a85442539754 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:35.725751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfbe58-3488-450d-8244-a85442539754 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:35.726212 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfbe58-3488-450d-8244-a85442539754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:35.727764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfbe58-3488-450d-8244-a85442539754 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:35.732806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 436/879] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 13 01:06:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:35.738746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787a571-bc1f-49ac-870f-9f849f918504 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:35.845111 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787a571-bc1f-49ac-870f-9f849f918504 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:35.870633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:35.876668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfbe58-3488-450d-8244-a85442539754 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:35.886705 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510cfd7-d17d-41a2-a1e9-0e23a4193bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:35.887587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510cfd7-d17d-41a2-a1e9-0e23a4193bef None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:35.888378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510cfd7-d17d-41a2-a1e9-0e23a4193bef None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:35.888823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510cfd7-d17d-41a2-a1e9-0e23a4193bef None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:35.889942 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510cfd7-d17d-41a2-a1e9-0e23a4193bef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:35.890692 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510cfd7-d17d-41a2-a1e9-0e23a4193bef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:35.892515 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510cfd7-d17d-41a2-a1e9-0e23a4193bef None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:35.899630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 444/880] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 13 01:06:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:35.937122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:35.996779 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfbe58-3488-450d-8244-a85442539754 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:36.036571 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7254d7-e532-4652-912b-9bbdfc8ff2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:36.037475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7254d7-e532-4652-912b-9bbdfc8ff2f2 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:36.037907 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7254d7-e532-4652-912b-9bbdfc8ff2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:36.038443 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7254d7-e532-4652-912b-9bbdfc8ff2f2 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:36.039351 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7254d7-e532-4652-912b-9bbdfc8ff2f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:36.040944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7254d7-e532-4652-912b-9bbdfc8ff2f2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:36.061022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 437/881] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 13 01:06:35 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:06:36.891532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c85d1-135d-437f-a2fd-b0b8b165a6ef None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:36.892086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c85d1-135d-437f-a2fd-b0b8b165a6ef None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:36.892266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c85d1-135d-437f-a2fd-b0b8b165a6ef None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:36.894530 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 445/882] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:36.896108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c90d6-2610-4657-af2a-ba011bf4a918 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:36.896510 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c90d6-2610-4657-af2a-ba011bf4a918 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:36.896678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c90d6-2610-4657-af2a-ba011bf4a918 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:36.898247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 438/883] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:36.900734 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65593635-808b-4c6d-aeb7-c4f4e50707c9 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:36.901127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65593635-808b-4c6d-aeb7-c4f4e50707c9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:36.901493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65593635-808b-4c6d-aeb7-c4f4e50707c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:36.904416 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04111edf-f033-4dab-a3b1-4a00c352b5ce None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:36.904712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04111edf-f033-4dab-a3b1-4a00c352b5ce None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:36.904993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04111edf-f033-4dab-a3b1-4a00c352b5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:36.921190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-65593635-808b-4c6d-aeb7-c4f4e50707c9 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:36.922609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-65593635-808b-4c6d-aeb7-c4f4e50707c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:36.922854 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-04111edf-f033-4dab-a3b1-4a00c352b5ce None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:36.924617 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-04111edf-f033-4dab-a3b1-4a00c352b5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:37.003412 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 446/884] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:37.003795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 439/885] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:37.275357 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65593635-808b-4c6d-aeb7-c4f4e50707c9 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:37.280293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04111edf-f033-4dab-a3b1-4a00c352b5ce None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:37.319439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:37.390850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65593635-808b-4c6d-aeb7-c4f4e50707c9 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:37.406346 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:37.411060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04111edf-f033-4dab-a3b1-4a00c352b5ce None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:37.430711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6567-60a1-4452-9a66-39afc0a55d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:37.431548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6567-60a1-4452-9a66-39afc0a55d0b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:37.431888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6567-60a1-4452-9a66-39afc0a55d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:37.432228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6567-60a1-4452-9a66-39afc0a55d0b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:37.443563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef6567-60a1-4452-9a66-39afc0a55d0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-39ef6567-60a1-4452-9a66-39afc0a55d0b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:37.448892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:37.449859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:37.450992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:37.450992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:37.450992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:37.450992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:37.450992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:37.450992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:37.450992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:37.450992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:37.450992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:37.450992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:37.450992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 01:06:37.450992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:37.450992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 447/886] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Sep 13 01:06:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:37.457043 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6567-60a1-4452-9a66-39afc0a55d0b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:37.458003 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32db6e4-019c-4922-a747-88af66f31c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:37.458646 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32db6e4-019c-4922-a747-88af66f31c01 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:37.458927 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32db6e4-019c-4922-a747-88af66f31c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:37.459240 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32db6e4-019c-4922-a747-88af66f31c01 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:37.459835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32db6e4-019c-4922-a747-88af66f31c01 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:37.461208 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32db6e4-019c-4922-a747-88af66f31c01 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f32db6e4-019c-4922-a747-88af66f31c01 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:37.471687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:37.473073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:37.473903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:37.473903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:37.473903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:37.473903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:37.473903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:37.473903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:37.473903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:37.473903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:37.473903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:37.473903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:37.473903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:37.473903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:37.473903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 01:06:37.473903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:37.473903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 440/887] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:06:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:37.478967 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32db6e4-019c-4922-a747-88af66f31c01 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:37.577504 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6567-60a1-4452-9a66-39afc0a55d0b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:37.582831 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:37.586393 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32db6e4-019c-4922-a747-88af66f31c01 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:37.619283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f5b15-b962-4be9-870f-66340fc099b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:37.620364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f5b15-b962-4be9-870f-66340fc099b8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:37.620934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f5b15-b962-4be9-870f-66340fc099b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:37.621493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f5b15-b962-4be9-870f-66340fc099b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:37.622374 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f5b15-b962-4be9-870f-66340fc099b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:37.622959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f5b15-b962-4be9-870f-66340fc099b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:37.623319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1d669-f2e0-47a7-9507-e94640cfec4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:37.623929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d669-f2e0-47a7-9507-e94640cfec4a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:37.624210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d669-f2e0-47a7-9507-e94640cfec4a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:37.624484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d669-f2e0-47a7-9507-e94640cfec4a None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:37.625114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1d669-f2e0-47a7-9507-e94640cfec4a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:37.625479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1d669-f2e0-47a7-9507-e94640cfec4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:37.625792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f5b15-b962-4be9-870f-66340fc099b8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:37.626885 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1d669-f2e0-47a7-9507-e94640cfec4a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:37.639785 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 441/889] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:06:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:37.639785 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1d669-f2e0-47a7-9507-e94640cfec4a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:37.640284 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 448/889] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 13 01:06:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:37.641461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f5b15-b962-4be9-870f-66340fc099b8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:37.680586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:37.753418 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1d669-f2e0-47a7-9507-e94640cfec4a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:37.753990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f5b15-b962-4be9-870f-66340fc099b8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:37.791001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a78542-f638-4fdf-b6de-361c50cda60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:37.791654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1af678-dd4b-46b5-91ad-e7d529d55931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:37.791780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a78542-f638-4fdf-b6de-361c50cda60c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:37.791982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a78542-f638-4fdf-b6de-361c50cda60c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:37.792249 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a78542-f638-4fdf-b6de-361c50cda60c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:37.793173 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1af678-dd4b-46b5-91ad-e7d529d55931 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:37.793665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1af678-dd4b-46b5-91ad-e7d529d55931 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:37.794229 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1af678-dd4b-46b5-91ad-e7d529d55931 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:37.795552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1af678-dd4b-46b5-91ad-e7d529d55931 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:37.796063 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1af678-dd4b-46b5-91ad-e7d529d55931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:37.797632 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1af678-dd4b-46b5-91ad-e7d529d55931 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:37.808408 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a78542-f638-4fdf-b6de-361c50cda60c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:37.808408 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a78542-f638-4fdf-b6de-361c50cda60c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:37.808681 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 442/890] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:06:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:37.809528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1af678-dd4b-46b5-91ad-e7d529d55931 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-26a78542-f638-4fdf-b6de-361c50cda60c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:37.826667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:37.827777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:37.828682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:37.828682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:37.828682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:37.833562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 449/891] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:37.834487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a78542-f638-4fdf-b6de-361c50cda60c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:37.842650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:37.922144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1af678-dd4b-46b5-91ad-e7d529d55931 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:37.933872 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:37.948793 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a78542-f638-4fdf-b6de-361c50cda60c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:37.962173 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b8d6f-8e51-4073-92af-e596de2b346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:37.963158 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b8d6f-8e51-4073-92af-e596de2b346d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:37.963649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b8d6f-8e51-4073-92af-e596de2b346d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:37.964198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b8d6f-8e51-4073-92af-e596de2b346d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:37.965237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b8d6f-8e51-4073-92af-e596de2b346d None admin] RBAC: Adding query filter params (interface=public, service_id=9feb63d20a1d450bbcaceb01c8dae6ae, region_id=RegionOne) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:37.965785 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b8d6f-8e51-4073-92af-e596de2b346d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:37.967576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b8d6f-8e51-4073-92af-e596de2b346d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:37.982219 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 443/892] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 13 01:06:37 2022] GET /identity/v3/endpoints?service_id=9feb63d20a1d450bbcaceb01c8dae6ae&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:37.983700 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b8d6f-8e51-4073-92af-e596de2b346d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:37.990045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39bff7-bf91-4e2b-90e9-4188ad14dc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:37.990676 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39bff7-bf91-4e2b-90e9-4188ad14dc08 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:37.990950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39bff7-bf91-4e2b-90e9-4188ad14dc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:37.991269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39bff7-bf91-4e2b-90e9-4188ad14dc08 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:37.991978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39bff7-bf91-4e2b-90e9-4188ad14dc08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:37.992281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39bff7-bf91-4e2b-90e9-4188ad14dc08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:37.993694 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39bff7-bf91-4e2b-90e9-4188ad14dc08 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:38.013287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 450/893] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:38.014428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39bff7-bf91-4e2b-90e9-4188ad14dc08 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:38.088224 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:38.099612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b8d6f-8e51-4073-92af-e596de2b346d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:38.129999 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39bff7-bf91-4e2b-90e9-4188ad14dc08 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:38.138902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d771a-b18d-49ae-93c2-c8924b445cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:38.139903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d771a-b18d-49ae-93c2-c8924b445cad None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:38.140188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d771a-b18d-49ae-93c2-c8924b445cad None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:38.140465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d771a-b18d-49ae-93c2-c8924b445cad None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:38.141395 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d771a-b18d-49ae-93c2-c8924b445cad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:38.143732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d771a-b18d-49ae-93c2-c8924b445cad None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:38.159107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 444/894] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 13 01:06:37 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:06:38.159107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d642d5c-b7ef-41af-afd5-0a967b12af9c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:38.159107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d642d5c-b7ef-41af-afd5-0a967b12af9c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:38.159107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d642d5c-b7ef-41af-afd5-0a967b12af9c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:38.159107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 445/895] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:38.159107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d95cfc-0008-4c25-b942-0eae8d663655 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:38.159107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d95cfc-0008-4c25-b942-0eae8d663655 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:38.159695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d95cfc-0008-4c25-b942-0eae8d663655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:38.179307 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-26d95cfc-0008-4c25-b942-0eae8d663655 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:38.180546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-26d95cfc-0008-4c25-b942-0eae8d663655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:38.181959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefcedc-499f-4161-8375-fb57fa096998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:38.183124 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefcedc-499f-4161-8375-fb57fa096998 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:38.184544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefcedc-499f-4161-8375-fb57fa096998 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:38.185063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefcedc-499f-4161-8375-fb57fa096998 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:38.194563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefcedc-499f-4161-8375-fb57fa096998 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:38.196077 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefcedc-499f-4161-8375-fb57fa096998 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-caefcedc-499f-4161-8375-fb57fa096998 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:38.209688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:38.210908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:38.212138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:38.212138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:38.212138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:38.212138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:38.212138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:38.212138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:38.212138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:38.212138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:38.212138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 01:06:38.212138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:38.212138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 451/896] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 13 01:06:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:38.217698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefcedc-499f-4161-8375-fb57fa096998 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:38.233461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:38.279479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 446/897] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:38.342198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d4c7-8ea2-46eb-a468-0cb884d35f85 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:38.342371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d4c7-8ea2-46eb-a468-0cb884d35f85 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:38.342654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d4c7-8ea2-46eb-a468-0cb884d35f85 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:38.344059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 447/898] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:06:38.349559 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db597e8-95ca-47bf-bcf5-6bd5ba2fea11 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:38.349848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db597e8-95ca-47bf-bcf5-6bd5ba2fea11 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:38.350097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db597e8-95ca-47bf-bcf5-6bd5ba2fea11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:38.354378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefcedc-499f-4161-8375-fb57fa096998 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:38.370200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1db597e8-95ca-47bf-bcf5-6bd5ba2fea11 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:38.371421 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1db597e8-95ca-47bf-bcf5-6bd5ba2fea11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:38.395892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2c88b-0a90-4940-82f2-863e513bf9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:38.396846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2c88b-0a90-4940-82f2-863e513bf9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:38.396846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2c88b-0a90-4940-82f2-863e513bf9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:38.397104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2c88b-0a90-4940-82f2-863e513bf9d7 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:38.397751 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2c88b-0a90-4940-82f2-863e513bf9d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:38.398058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2c88b-0a90-4940-82f2-863e513bf9d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:38.399542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2c88b-0a90-4940-82f2-863e513bf9d7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:38.421931 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 452/899] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Sep 13 01:06:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:38.430567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2c88b-0a90-4940-82f2-863e513bf9d7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:38.471247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 448/900] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:38.510025 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:38.546239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db597e8-95ca-47bf-bcf5-6bd5ba2fea11 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:38.547887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2c88b-0a90-4940-82f2-863e513bf9d7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:38.562701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:38.594273 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9653e1-89c8-4fe7-9f0c-226a9d48c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:38.595461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9653e1-89c8-4fe7-9f0c-226a9d48c171 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:38.595951 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9653e1-89c8-4fe7-9f0c-226a9d48c171 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:38.596866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9653e1-89c8-4fe7-9f0c-226a9d48c171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:38.652616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db597e8-95ca-47bf-bcf5-6bd5ba2fea11 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:38.692740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6470e4-a040-4871-ac0d-7360802e312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:38.693413 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6470e4-a040-4871-ac0d-7360802e312a None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:38.693703 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6470e4-a040-4871-ac0d-7360802e312a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:38.693965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6470e4-a040-4871-ac0d-7360802e312a None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:38.694620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6470e4-a040-4871-ac0d-7360802e312a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:38.695054 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9653e1-89c8-4fe7-9f0c-226a9d48c171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:38.696017 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6470e4-a040-4871-ac0d-7360802e312a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:38.696914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9653e1-89c8-4fe7-9f0c-226a9d48c171 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:38.715454 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 449/901] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 13 01:06:38 2022] POST /identity/v3/services => generated 241 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:06:38.758865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6470e4-a040-4871-ac0d-7360802e312a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:38.795429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:38.840288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 453/902] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:06:38 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 01:06:38.846455 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9653e1-89c8-4fe7-9f0c-226a9d48c171 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:38.874141 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:38.921566 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6470e4-a040-4871-ac0d-7360802e312a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:38.963777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb1971-8383-4a46-bef0-a8dda645bb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:38.965269 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb1971-8383-4a46-bef0-a8dda645bb9b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:38.965621 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb1971-8383-4a46-bef0-a8dda645bb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:38.965968 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb1971-8383-4a46-bef0-a8dda645bb9b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:38.966639 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb1971-8383-4a46-bef0-a8dda645bb9b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:38.968304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb1971-8383-4a46-bef0-a8dda645bb9b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-d5bb1971-8383-4a46-bef0-a8dda645bb9b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:38.978846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:38.979891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:38.981095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:38.981095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:38.981095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:38.981095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:38.981095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:38.981095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:38.981095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:38.981095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:38.981095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:38.981095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:38.981095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:38.981095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:38.981095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 01:06:38.981095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:38.981095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 450/903] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Sep 13 01:06:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:38.986464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb1971-8383-4a46-bef0-a8dda645bb9b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:38.988811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9653e1-89c8-4fe7-9f0c-226a9d48c171 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:39.026269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfcacb-bf5b-4776-9b7e-7dbb0d19d1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:39.027247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfcacb-bf5b-4776-9b7e-7dbb0d19d1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:39.027735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfcacb-bf5b-4776-9b7e-7dbb0d19d1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:39.028189 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfcacb-bf5b-4776-9b7e-7dbb0d19d1c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:39.040425 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfcacb-bf5b-4776-9b7e-7dbb0d19d1c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:39.042405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfcacb-bf5b-4776-9b7e-7dbb0d19d1c4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-4fbfcacb-bf5b-4776-9b7e-7dbb0d19d1c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:39.059867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:39.060869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:39.061769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:39.061769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:39.061769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:39.063855 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 454/904] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:39.072061 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfcacb-bf5b-4776-9b7e-7dbb0d19d1c4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:39.093170 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:39.107605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb1971-8383-4a46-bef0-a8dda645bb9b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:39.146319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58943db8-e270-47fd-9215-cfc6716d00c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:39.146942 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58943db8-e270-47fd-9215-cfc6716d00c8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:39.147253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58943db8-e270-47fd-9215-cfc6716d00c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:39.147528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58943db8-e270-47fd-9215-cfc6716d00c8 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:39.148337 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58943db8-e270-47fd-9215-cfc6716d00c8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:39.148651 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58943db8-e270-47fd-9215-cfc6716d00c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:39.150041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58943db8-e270-47fd-9215-cfc6716d00c8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:39.151376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:39.162336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 451/905] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 13 01:06:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:39.163378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58943db8-e270-47fd-9215-cfc6716d00c8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:39.203606 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfcacb-bf5b-4776-9b7e-7dbb0d19d1c4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:39.240682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c24ed-85d1-431c-8699-22e094864fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:39.241669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c24ed-85d1-431c-8699-22e094864fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:39.242153 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c24ed-85d1-431c-8699-22e094864fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:39.242626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c24ed-85d1-431c-8699-22e094864fa5 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:39.243514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c24ed-85d1-431c-8699-22e094864fa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:39.244036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c24ed-85d1-431c-8699-22e094864fa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:39.245615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c24ed-85d1-431c-8699-22e094864fa5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:39.258819 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 455/906] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:39.264203 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c24ed-85d1-431c-8699-22e094864fa5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:39.285397 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58943db8-e270-47fd-9215-cfc6716d00c8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:39.330758 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890e8cf-d5a7-4fc6-abf5-8d1238c749ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:39.331408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890e8cf-d5a7-4fc6-abf5-8d1238c749ed None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:39.331689 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890e8cf-d5a7-4fc6-abf5-8d1238c749ed None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:39.331965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890e8cf-d5a7-4fc6-abf5-8d1238c749ed None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:39.333029 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890e8cf-d5a7-4fc6-abf5-8d1238c749ed None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:39.333349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890e8cf-d5a7-4fc6-abf5-8d1238c749ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:39.335057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890e8cf-d5a7-4fc6-abf5-8d1238c749ed None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:39.346629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 452/907] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 13 01:06:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:39.348033 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890e8cf-d5a7-4fc6-abf5-8d1238c749ed None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:39.360649 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:39.388928 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c24ed-85d1-431c-8699-22e094864fa5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:39.429762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f57dbd-1ee8-4555-92d3-565f5f9d1dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:39.431017 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:39.431445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f57dbd-1ee8-4555-92d3-565f5f9d1dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:39.433239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f57dbd-1ee8-4555-92d3-565f5f9d1dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:39.433754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f57dbd-1ee8-4555-92d3-565f5f9d1dd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:39.447290 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f57dbd-1ee8-4555-92d3-565f5f9d1dd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:39.448833 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f57dbd-1ee8-4555-92d3-565f5f9d1dd1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:39.461628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a1f57dbd-1ee8-4555-92d3-565f5f9d1dd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:39.461628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:39.461628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:39.461628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:39.461628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:39.461628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:39.461628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:39.461628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:39.461628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:39.461628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:39.461628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:39.461628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:39.461628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:39.461628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:39.461628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:39.462558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:39.463860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:39.463860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:39.463860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:39.463860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:39.463860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:39.463860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:39.463860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:39.463860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:39.467623 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 456/908] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:39.468928 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f57dbd-1ee8-4555-92d3-565f5f9d1dd1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:39.480904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890e8cf-d5a7-4fc6-abf5-8d1238c749ed None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:39.517273 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea41dfa-599a-494b-a6c2-d7d246802f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:39.518343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea41dfa-599a-494b-a6c2-d7d246802f1a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:39.518873 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea41dfa-599a-494b-a6c2-d7d246802f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:39.519408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea41dfa-599a-494b-a6c2-d7d246802f1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:39.520324 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea41dfa-599a-494b-a6c2-d7d246802f1a None admin] RBAC: Adding query filter params (interface=public, service_id=042ef1149ff649a2b0698bc2d3a3d3c5, region_id=RegionOne) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:39.520838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea41dfa-599a-494b-a6c2-d7d246802f1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:39.522408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea41dfa-599a-494b-a6c2-d7d246802f1a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:39.532899 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 453/909] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 13 01:06:39 2022] GET /identity/v3/endpoints?service_id=042ef1149ff649a2b0698bc2d3a3d3c5&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:39.534779 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea41dfa-599a-494b-a6c2-d7d246802f1a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:39.581264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f57dbd-1ee8-4555-92d3-565f5f9d1dd1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:39.618562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc4586-0514-44c0-956c-90502802f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:39.618898 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc4586-0514-44c0-956c-90502802f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:39.619250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc4586-0514-44c0-956c-90502802f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:39.619530 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc4586-0514-44c0-956c-90502802f6f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:39.620224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc4586-0514-44c0-956c-90502802f6f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:39.620534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc4586-0514-44c0-956c-90502802f6f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:39.621966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc4586-0514-44c0-956c-90502802f6f1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:39.630229 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:39.641599 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 457/910] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:39.642911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc4586-0514-44c0-956c-90502802f6f1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:39.645289 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea41dfa-599a-494b-a6c2-d7d246802f1a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:39.672093 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:39.682083 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbd9f3-d513-44d1-a663-3bfe79365734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:39.683155 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbd9f3-d513-44d1-a663-3bfe79365734 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:39.683645 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbd9f3-d513-44d1-a663-3bfe79365734 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:39.684119 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbd9f3-d513-44d1-a663-3bfe79365734 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:39.684963 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbd9f3-d513-44d1-a663-3bfe79365734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:39.686585 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbd9f3-d513-44d1-a663-3bfe79365734 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:39.699161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 454/911] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 13 01:06:39 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:06:39.762500 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc4586-0514-44c0-956c-90502802f6f1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:39.802351 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa399f-a249-4a9a-9a8b-7c4b0843c7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:39.803039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa399f-a249-4a9a-9a8b-7c4b0843c7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:39.803349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa399f-a249-4a9a-9a8b-7c4b0843c7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:39.803624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa399f-a249-4a9a-9a8b-7c4b0843c7d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:39.804364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa399f-a249-4a9a-9a8b-7c4b0843c7d4 None admin] RBAC: Adding query filter params (role.id=063ead59de26487aade9d571bde678c5, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=da83fb76a0b04aa2bdb91f6c25dc6cc6) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:39.804681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa399f-a249-4a9a-9a8b-7c4b0843c7d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:39.806128 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa399f-a249-4a9a-9a8b-7c4b0843c7d4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:39.818608 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 458/912] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:06:39 2022] GET /identity/v3/role_assignments?user.id=da83fb76a0b04aa2bdb91f6c25dc6cc6&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=063ead59de26487aade9d571bde678c5 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:40.472177 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d7b51-b544-4645-8e70-22125198db8f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:40.473167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d7b51-b544-4645-8e70-22125198db8f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:40.473647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d7b51-b544-4645-8e70-22125198db8f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:40.475511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 455/913] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:40.480589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126ff79-28d8-4aad-bcab-f17d8e25bfd4 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:40.481019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126ff79-28d8-4aad-bcab-f17d8e25bfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:40.481190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126ff79-28d8-4aad-bcab-f17d8e25bfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:40.500170 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b126ff79-28d8-4aad-bcab-f17d8e25bfd4 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:40.501373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b126ff79-28d8-4aad-bcab-f17d8e25bfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:40.561891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:40.573508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 459/914] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:40.845447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d7b51-b544-4645-8e70-22125198db8f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:40.955238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d7b51-b544-4645-8e70-22125198db8f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:40.989948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58446e5-09ea-4dea-b773-776ec85df219 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:40.990222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58446e5-09ea-4dea-b773-776ec85df219 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:40.990493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58446e5-09ea-4dea-b773-776ec85df219 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:40.991669 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca5458-9277-4f68-9312-721af57076c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:40.992079 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 460/915] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:40.992647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca5458-9277-4f68-9312-721af57076c8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:40.993074 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca5458-9277-4f68-9312-721af57076c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:40.993507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca5458-9277-4f68-9312-721af57076c8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:40.994241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca5458-9277-4f68-9312-721af57076c8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:40.995970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca5458-9277-4f68-9312-721af57076c8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:40.997106 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5dfa5-fe0d-4588-a149-3a868d5f85c6 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:40.997387 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5dfa5-fe0d-4588-a149-3a868d5f85c6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:40.997659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5dfa5-fe0d-4588-a149-3a868d5f85c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-13ca5458-9277-4f68-9312-721af57076c8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:41.006961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:41.008228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:41.009230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:41.009230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:41.009230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:41.009230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:41.009230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:41.009230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:41.009230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:41.009230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:41.009230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:41.009230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:41.009230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:41.009230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:41.009230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 01:06:41.009230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:41.011455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 456/916] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:06:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:41.019143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-35e5dfa5-fe0d-4588-a149-3a868d5f85c6 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:41.019318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca5458-9277-4f68-9312-721af57076c8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:41.019402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-35e5dfa5-fe0d-4588-a149-3a868d5f85c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:41.082921 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:41.104036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 461/917] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:41.135776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca5458-9277-4f68-9312-721af57076c8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:41.171988 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11faf0-0b6a-4b9d-b5e3-ee07a9f47e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:41.172930 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11faf0-0b6a-4b9d-b5e3-ee07a9f47e78 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:41.173411 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11faf0-0b6a-4b9d-b5e3-ee07a9f47e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:41.173993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11faf0-0b6a-4b9d-b5e3-ee07a9f47e78 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:41.174844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11faf0-0b6a-4b9d-b5e3-ee07a9f47e78 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:41.175375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11faf0-0b6a-4b9d-b5e3-ee07a9f47e78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:41.176940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11faf0-0b6a-4b9d-b5e3-ee07a9f47e78 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:41.182359 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 457/918] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:06:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:41.188214 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5dfa5-fe0d-4588-a149-3a868d5f85c6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:41.295243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5dfa5-fe0d-4588-a149-3a868d5f85c6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:41.319389 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:41.332536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c996f-ee24-401c-b805-4ed808d2d577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:41.333149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c996f-ee24-401c-b805-4ed808d2d577 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:41.333431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c996f-ee24-401c-b805-4ed808d2d577 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:41.333706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c996f-ee24-401c-b805-4ed808d2d577 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:41.334337 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c996f-ee24-401c-b805-4ed808d2d577 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:41.334642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c996f-ee24-401c-b805-4ed808d2d577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:41.336040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c996f-ee24-401c-b805-4ed808d2d577 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:41.341418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 462/919] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 13 01:06:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:41.347044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11faf0-0b6a-4b9d-b5e3-ee07a9f47e78 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:41.388332 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c996f-ee24-401c-b805-4ed808d2d577 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:41.459872 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11faf0-0b6a-4b9d-b5e3-ee07a9f47e78 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:41.480679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:41.505438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f85cd-0d86-4c5c-bb29-46df46057278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:41.506302 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f85cd-0d86-4c5c-bb29-46df46057278 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:41.506590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f85cd-0d86-4c5c-bb29-46df46057278 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:41.506868 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f85cd-0d86-4c5c-bb29-46df46057278 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:41.508054 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f85cd-0d86-4c5c-bb29-46df46057278 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:41.509951 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f85cd-0d86-4c5c-bb29-46df46057278 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:41.526453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c996f-ee24-401c-b805-4ed808d2d577 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:41.539560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 458/920] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:06:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:06:41.586140 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28554a3-6f1e-4bd3-ad15-cdaaaada0562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:41.587232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28554a3-6f1e-4bd3-ad15-cdaaaada0562 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:41.587691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28554a3-6f1e-4bd3-ad15-cdaaaada0562 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:41.588202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28554a3-6f1e-4bd3-ad15-cdaaaada0562 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:41.588971 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28554a3-6f1e-4bd3-ad15-cdaaaada0562 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:41.590569 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28554a3-6f1e-4bd3-ad15-cdaaaada0562 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-e28554a3-6f1e-4bd3-ad15-cdaaaada0562 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:41.601264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:41.602345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:41.603253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:41.603253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:41.603253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:41.603253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:41.603253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:41.603253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:41.603253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:41.603253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:41.603253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:41.603253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:41.603253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:41.603253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:41.603253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 01:06:41.603253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:41.606008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 463/921] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 13 01:06:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:41.612513 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f85cd-0d86-4c5c-bb29-46df46057278 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:41.732745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f85cd-0d86-4c5c-bb29-46df46057278 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:41.771455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafc1a7-3f6e-442d-9c3b-1fa0f96e3577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:41.772131 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafc1a7-3f6e-442d-9c3b-1fa0f96e3577 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:41.772411 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafc1a7-3f6e-442d-9c3b-1fa0f96e3577 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:41.772676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafc1a7-3f6e-442d-9c3b-1fa0f96e3577 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:41.773313 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafc1a7-3f6e-442d-9c3b-1fa0f96e3577 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:41.773613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafc1a7-3f6e-442d-9c3b-1fa0f96e3577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:41.774983 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafc1a7-3f6e-442d-9c3b-1fa0f96e3577 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:41.780437 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 459/922] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 13 01:06:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:41.786897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28554a3-6f1e-4bd3-ad15-cdaaaada0562 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:41.840031 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:41.898939 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28554a3-6f1e-4bd3-ad15-cdaaaada0562 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:41.940900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa522e4-5d35-4207-a9b4-d7d6b2e3ddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:41.941913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa522e4-5d35-4207-a9b4-d7d6b2e3ddc7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:41.942465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa522e4-5d35-4207-a9b4-d7d6b2e3ddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:41.942942 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa522e4-5d35-4207-a9b4-d7d6b2e3ddc7 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:41.943860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa522e4-5d35-4207-a9b4-d7d6b2e3ddc7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:41.944404 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa522e4-5d35-4207-a9b4-d7d6b2e3ddc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:41.946034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa522e4-5d35-4207-a9b4-d7d6b2e3ddc7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:41.952957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 464/923] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 13 01:06:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:41.961649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafc1a7-3f6e-442d-9c3b-1fa0f96e3577 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:42.002457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:42.030562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54294e6b-6e35-4376-a6e3-e7e724f8d6da None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:42.030891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54294e6b-6e35-4376-a6e3-e7e724f8d6da None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:42.031164 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54294e6b-6e35-4376-a6e3-e7e724f8d6da None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:42.032760 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 465/924] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:06:42.038447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28298a-bd72-4557-b2e8-386fbb974188 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:42.038727 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28298a-bd72-4557-b2e8-386fbb974188 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:42.039002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28298a-bd72-4557-b2e8-386fbb974188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:42.059200 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1d28298a-bd72-4557-b2e8-386fbb974188 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:42.060410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1d28298a-bd72-4557-b2e8-386fbb974188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:42.067844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafc1a7-3f6e-442d-9c3b-1fa0f96e3577 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:42.102318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e587f89-13ec-4727-bd2a-0e70c19ed42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:42.102923 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e587f89-13ec-4727-bd2a-0e70c19ed42d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:42.103232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e587f89-13ec-4727-bd2a-0e70c19ed42d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:42.103506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e587f89-13ec-4727-bd2a-0e70c19ed42d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:42.104203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e587f89-13ec-4727-bd2a-0e70c19ed42d None admin] RBAC: Adding query filter params (interface=public, service_id=15a90f79dfa646cab130c072281ec83f, region_id=RegionOne) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:42.104508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e587f89-13ec-4727-bd2a-0e70c19ed42d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:42.105861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e587f89-13ec-4727-bd2a-0e70c19ed42d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:42.116539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 460/925] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 13 01:06:41 2022] GET /identity/v3/endpoints?service_id=15a90f79dfa646cab130c072281ec83f&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:42.117741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544bf8d6-8531-48c8-a171-e9fc0b196b80 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:42.118016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544bf8d6-8531-48c8-a171-e9fc0b196b80 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:42.118291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544bf8d6-8531-48c8-a171-e9fc0b196b80 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:42.119759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 461/926] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:42.120284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544bf8d6-8531-48c8-a171-e9fc0b196b80 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:42.135629 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 466/927] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:42.136872 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bb4ef-1e29-4eeb-966a-41ffe12f4ba8 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:42.137165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bb4ef-1e29-4eeb-966a-41ffe12f4ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:42.137440 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bb4ef-1e29-4eeb-966a-41ffe12f4ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:42.165475 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0b6bb4ef-1e29-4eeb-966a-41ffe12f4ba8 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:42.167227 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0b6bb4ef-1e29-4eeb-966a-41ffe12f4ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:42.211713 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:42.247091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544bf8d6-8531-48c8-a171-e9fc0b196b80 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:42.249718 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:42.263527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 467/928] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:42.285988 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f438e-5ad5-438d-9447-e5943870fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:42.286702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f438e-5ad5-438d-9447-e5943870fd51 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:42.286980 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f438e-5ad5-438d-9447-e5943870fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:42.287275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f438e-5ad5-438d-9447-e5943870fd51 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:42.287875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f438e-5ad5-438d-9447-e5943870fd51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:42.289278 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f438e-5ad5-438d-9447-e5943870fd51 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:42.295805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 462/929] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 13 01:06:42 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:06:42.407206 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bb4ef-1e29-4eeb-966a-41ffe12f4ba8 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:42.525707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bb4ef-1e29-4eeb-966a-41ffe12f4ba8 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:42.534986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f438e-5ad5-438d-9447-e5943870fd51 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:42.567895 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e8742-8ed6-4d85-b492-b99b5a8d3b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:42.569965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e8742-8ed6-4d85-b492-b99b5a8d3b50 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:42.570738 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e8742-8ed6-4d85-b492-b99b5a8d3b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:42.571271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e8742-8ed6-4d85-b492-b99b5a8d3b50 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:42.572080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e8742-8ed6-4d85-b492-b99b5a8d3b50 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:42.574875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e8742-8ed6-4d85-b492-b99b5a8d3b50 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-828e8742-8ed6-4d85-b492-b99b5a8d3b50 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:42.587445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:42.588485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:42.589431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:42.589431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:42.589431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:42.589431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:42.589431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:42.589431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:42.589431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:42.589431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:42.589431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:42.589431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:42.589431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:42.589431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:42.589431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 01:06:42.589431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:42.595124 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 468/930] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Sep 13 01:06:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:42.599433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e8742-8ed6-4d85-b492-b99b5a8d3b50 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:42.636842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:42.656103 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f438e-5ad5-438d-9447-e5943870fd51 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:42.693017 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d4fb6-eb67-4d5f-bd7c-5627e705acba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:42.693748 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d4fb6-eb67-4d5f-bd7c-5627e705acba None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:42.694035 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d4fb6-eb67-4d5f-bd7c-5627e705acba None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:42.694312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d4fb6-eb67-4d5f-bd7c-5627e705acba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:42.705699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d4fb6-eb67-4d5f-bd7c-5627e705acba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:42.710151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e8742-8ed6-4d85-b492-b99b5a8d3b50 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-802d4fb6-eb67-4d5f-bd7c-5627e705acba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:42.711287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:42.712256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:42.713120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:42.713120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:42.713120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:42.713120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:42.713120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:42.713120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:42.713120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:42.713120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:42.713120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:42.713120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:42.713120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 01:06:42.713120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:42.713120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 463/931] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Sep 13 01:06:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:42.719791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d4fb6-eb67-4d5f-bd7c-5627e705acba None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:42.749034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501fdab-0c92-4844-b5cc-3b89547cde44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:42.750744 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501fdab-0c92-4844-b5cc-3b89547cde44 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:42.751281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501fdab-0c92-4844-b5cc-3b89547cde44 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:42.752292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501fdab-0c92-4844-b5cc-3b89547cde44 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:42.753211 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501fdab-0c92-4844-b5cc-3b89547cde44 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:42.753737 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501fdab-0c92-4844-b5cc-3b89547cde44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:42.755133 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:42.755582 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501fdab-0c92-4844-b5cc-3b89547cde44 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:42.760913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 469/932] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 13 01:06:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:42.766603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501fdab-0c92-4844-b5cc-3b89547cde44 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:42.841372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d4fb6-eb67-4d5f-bd7c-5627e705acba None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:42.881308 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192904c-5a14-4d25-b19f-ff55d3a82566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:42.882319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192904c-5a14-4d25-b19f-ff55d3a82566 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:42.882805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192904c-5a14-4d25-b19f-ff55d3a82566 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:42.883343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192904c-5a14-4d25-b19f-ff55d3a82566 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:42.884216 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192904c-5a14-4d25-b19f-ff55d3a82566 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:42.884720 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192904c-5a14-4d25-b19f-ff55d3a82566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:42.886464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192904c-5a14-4d25-b19f-ff55d3a82566 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:42.893462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:42.901391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501fdab-0c92-4844-b5cc-3b89547cde44 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:42.901987 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 464/933] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 13 01:06:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:42.903105 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192904c-5a14-4d25-b19f-ff55d3a82566 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:42.947096 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14b34f-6a5d-443e-a389-bdb05a8f05a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:42.947713 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14b34f-6a5d-443e-a389-bdb05a8f05a8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:42.948048 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14b34f-6a5d-443e-a389-bdb05a8f05a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:42.948325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14b34f-6a5d-443e-a389-bdb05a8f05a8 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:42.948965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14b34f-6a5d-443e-a389-bdb05a8f05a8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:42.949260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14b34f-6a5d-443e-a389-bdb05a8f05a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:42.951614 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14b34f-6a5d-443e-a389-bdb05a8f05a8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:42.959286 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 470/934] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 13 01:06:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:42.965467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14b34f-6a5d-443e-a389-bdb05a8f05a8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:43.015812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:43.030171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192904c-5a14-4d25-b19f-ff55d3a82566 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:43.068892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df83e9-39cd-4e14-b80a-ce9cd6210a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:43.069524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df83e9-39cd-4e14-b80a-ce9cd6210a8e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:43.069799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df83e9-39cd-4e14-b80a-ce9cd6210a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:43.070453 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df83e9-39cd-4e14-b80a-ce9cd6210a8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:43.083098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14b34f-6a5d-443e-a389-bdb05a8f05a8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:43.083309 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df83e9-39cd-4e14-b80a-ce9cd6210a8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:43.084770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df83e9-39cd-4e14-b80a-ce9cd6210a8e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e5df83e9-39cd-4e14-b80a-ce9cd6210a8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:43.100781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:43.101874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:43.103180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:43.103180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:43.103180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:43.103180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 465/935] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:43.107310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df83e9-39cd-4e14-b80a-ce9cd6210a8e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:43.123334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1a134-c378-46dd-b09b-db1c98423f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:43.124265 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1a134-c378-46dd-b09b-db1c98423f25 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:43.124692 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1a134-c378-46dd-b09b-db1c98423f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:43.125234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1a134-c378-46dd-b09b-db1c98423f25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:43.126080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1a134-c378-46dd-b09b-db1c98423f25 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:43.127734 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1a134-c378-46dd-b09b-db1c98423f25 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:43.155465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 471/936] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:06:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:06:43.225123 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df83e9-39cd-4e14-b80a-ce9cd6210a8e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:43.272183 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbca39-05ad-4adf-af0e-59f88377b8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:43.272805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbca39-05ad-4adf-af0e-59f88377b8ae None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:43.273084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbca39-05ad-4adf-af0e-59f88377b8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:43.273357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbca39-05ad-4adf-af0e-59f88377b8ae None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:43.274065 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbca39-05ad-4adf-af0e-59f88377b8ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:43.274376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbca39-05ad-4adf-af0e-59f88377b8ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:43.279357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbca39-05ad-4adf-af0e-59f88377b8ae None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:43.280620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:43.295820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 466/937] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:43.304338 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1a134-c378-46dd-b09b-db1c98423f25 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:43.325948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:43.425179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1a134-c378-46dd-b09b-db1c98423f25 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:43.462716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f76aae-05a6-4762-b0a2-3e60f167dab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:43.463377 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f76aae-05a6-4762-b0a2-3e60f167dab6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:43.463652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f76aae-05a6-4762-b0a2-3e60f167dab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:43.463920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f76aae-05a6-4762-b0a2-3e60f167dab6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:43.472257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f76aae-05a6-4762-b0a2-3e60f167dab6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:43.473710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f76aae-05a6-4762-b0a2-3e60f167dab6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-b0f76aae-05a6-4762-b0a2-3e60f167dab6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:43.485372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:43.486392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:43.488152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:43.488152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:43.488152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:43.488152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:43.488152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:43.488152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:43.488152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:43.488152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:43.488152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 01:06:43.488152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:43.488152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 472/938] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 13 01:06:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:43.492512 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbca39-05ad-4adf-af0e-59f88377b8ae None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:43.601825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbca39-05ad-4adf-af0e-59f88377b8ae None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:43.641966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33534f-7463-439b-bb6d-af4920d007cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:43.642625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33534f-7463-439b-bb6d-af4920d007cd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:43.642913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33534f-7463-439b-bb6d-af4920d007cd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:43.643203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33534f-7463-439b-bb6d-af4920d007cd None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:43.643943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33534f-7463-439b-bb6d-af4920d007cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:43.644254 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33534f-7463-439b-bb6d-af4920d007cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:43.645686 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33534f-7463-439b-bb6d-af4920d007cd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:43.663962 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 467/939] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Sep 13 01:06:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:43.669432 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f76aae-05a6-4762-b0a2-3e60f167dab6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:43.753453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:43.776688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f76aae-05a6-4762-b0a2-3e60f167dab6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:43.812815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86591b-18f4-4844-b272-05cd985f931e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:43.813490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86591b-18f4-4844-b272-05cd985f931e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:43.813770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86591b-18f4-4844-b272-05cd985f931e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:43.814045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86591b-18f4-4844-b272-05cd985f931e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:43.827730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86591b-18f4-4844-b272-05cd985f931e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:43.829229 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86591b-18f4-4844-b272-05cd985f931e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-9b86591b-18f4-4844-b272-05cd985f931e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:43.846102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:43.847281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:43.848171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:43.848171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:43.848171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:43.848171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 473/940] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:43.856137 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33534f-7463-439b-bb6d-af4920d007cd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:43.916631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:43.934154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4944d-b3ee-4e98-a0ef-b37d2617b01f None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:43.934698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4944d-b3ee-4e98-a0ef-b37d2617b01f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:43.935179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4944d-b3ee-4e98-a0ef-b37d2617b01f None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:43.936975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 474/941] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:43.945127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a52234-7c01-4a37-ade2-6500f9f61723 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:43.945691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a52234-7c01-4a37-ade2-6500f9f61723 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:43.946199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a52234-7c01-4a37-ade2-6500f9f61723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:43.965877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33534f-7463-439b-bb6d-af4920d007cd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:43.968635 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-69a52234-7c01-4a37-ade2-6500f9f61723 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:43.970076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-69a52234-7c01-4a37-ade2-6500f9f61723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:44.003841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25207701-9e51-4a67-978c-a083bf9aa98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:44.004464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25207701-9e51-4a67-978c-a083bf9aa98d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:44.004745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25207701-9e51-4a67-978c-a083bf9aa98d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:44.005018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25207701-9e51-4a67-978c-a083bf9aa98d None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:44.005675 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25207701-9e51-4a67-978c-a083bf9aa98d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:44.005979 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25207701-9e51-4a67-978c-a083bf9aa98d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:44.007659 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25207701-9e51-4a67-978c-a083bf9aa98d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:44.024713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 468/942] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:44.026066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25207701-9e51-4a67-978c-a083bf9aa98d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:44.067092 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 475/943] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:44.144532 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25207701-9e51-4a67-978c-a083bf9aa98d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:44.159907 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:44.183845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89913e-eacd-4501-b64f-10ace1da7551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:44.184586 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89913e-eacd-4501-b64f-10ace1da7551 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:44.184816 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89913e-eacd-4501-b64f-10ace1da7551 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:44.185097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89913e-eacd-4501-b64f-10ace1da7551 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:44.193011 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89913e-eacd-4501-b64f-10ace1da7551 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:44.194455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89913e-eacd-4501-b64f-10ace1da7551 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:44.206405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-ae89913e-eacd-4501-b64f-10ace1da7551 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:44.206405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:44.206405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:44.206405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:44.206405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:44.206405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:44.206405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:44.206405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:44.206405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:44.206405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:44.206405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:44.206405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:44.206405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:44.206405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:44.206405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:44.207363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:44.208255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:44.208255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:44.208255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:44.208255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:44.208255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:44.208255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:44.208255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:44.208255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:44.208255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 469/944] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:44.215013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a52234-7c01-4a37-ade2-6500f9f61723 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:44.276754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:44.320744 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a52234-7c01-4a37-ade2-6500f9f61723 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:44.356225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a0f42-2171-4e01-9c7e-725112b07a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:44.357171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a0f42-2171-4e01-9c7e-725112b07a85 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:44.357656 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a0f42-2171-4e01-9c7e-725112b07a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:44.358131 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a0f42-2171-4e01-9c7e-725112b07a85 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:44.359099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a0f42-2171-4e01-9c7e-725112b07a85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:44.359615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a0f42-2171-4e01-9c7e-725112b07a85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:44.361843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a0f42-2171-4e01-9c7e-725112b07a85 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:44.368612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89913e-eacd-4501-b64f-10ace1da7551 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:44.375264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 476/945] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:44.382915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a0f42-2171-4e01-9c7e-725112b07a85 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:44.506935 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89913e-eacd-4501-b64f-10ace1da7551 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:44.514199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a0f42-2171-4e01-9c7e-725112b07a85 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:44.537228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:44.547504 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd20053-dbf3-4367-a556-93a3c565820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:44.548455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd20053-dbf3-4367-a556-93a3c565820d None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:44.549374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd20053-dbf3-4367-a556-93a3c565820d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:44.550146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd20053-dbf3-4367-a556-93a3c565820d None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:44.551506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd20053-dbf3-4367-a556-93a3c565820d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:44.553093 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd20053-dbf3-4367-a556-93a3c565820d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:44.554934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1a0f4-b4f3-430e-9742-054b8230709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:44.555906 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1a0f4-b4f3-430e-9742-054b8230709c None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:44.556192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1a0f4-b4f3-430e-9742-054b8230709c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:44.556467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1a0f4-b4f3-430e-9742-054b8230709c None admin] PATH_INFO: `/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/da83fb76a0b04aa2bdb91f6c25dc6cc6/roles/063ead59de26487aade9d571bde678c5` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:44.556772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: WARNING keystone.server.flask.common [None req-edd20053-dbf3-4367-a556-93a3c565820d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 01:06:44.558762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1a0f4-b4f3-430e-9742-054b8230709c None admin] RBAC: Authorizing `identity:create_grant(project_id=fe73ceb0a582452b9b636a701adafb6f, user_id=da83fb76a0b04aa2bdb91f6c25dc6cc6, role_id=063ead59de26487aade9d571bde678c5)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:44.560277 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1a0f4-b4f3-430e-9742-054b8230709c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:44.577732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.sql.core [None req-edd20053-dbf3-4367-a556-93a3c565820d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 01:06:44.577732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 01:06:44.577732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [parameters: {'id': '44d0e668c6ce414e8efe76c06411365f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 01:06:44.577732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81466) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 01:06:44.583265 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 477/946] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:06:44 2022] PUT /identity/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/da83fb76a0b04aa2bdb91f6c25dc6cc6/roles/063ead59de26487aade9d571bde678c5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:06:44.585917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-edd20053-dbf3-4367-a556-93a3c565820d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 44d0e668c6ce414e8efe76c06411365f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 44d0e668c6ce414e8efe76c06411365f. Sep 13 01:06:44.585917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:44.585917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 01:06:44.585917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 01:06:44.585917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 01:06:44.585917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 01:06:44.585917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 01:06:44.585917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 01:06:44.585917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 01:06:44.585917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application conn.query(q) Sep 13 01:06:44.585917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 01:06:44.585917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 01:06:44.585917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result.read() Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 13 01:06:44.587917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application next(self.gen) Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application yield resource Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application next(self.gen) Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise self.value Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application session.commit() Sep 13 01:06:44.590194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.session.flush() Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application compat.raise_( Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 01:06:44.595857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 01:06:44.596833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 01:06:44.596833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 01:06:44.596833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 01:06:44.596833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 01:06:44.596833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 01:06:44.596833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 01:06:44.596833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 01:06:44.596833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 01:06:44.596833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 01:06:44.596833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 01:06:44.596833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 01:06:44.596833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 01:06:44.596833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 01:06:44.596833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 01:06:44.596833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application conn.query(q) Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result.read() Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 01:06:44.597656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 01:06:44.598555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 01:06:44.598555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 01:06:44.598555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 01:06:44.598555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 01:06:44.598555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 01:06:44.598555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 01:06:44.598555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 01:06:44.598555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 01:06:44.598555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [parameters: {'id': '44d0e668c6ce414e8efe76c06411365f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 01:06:44.598555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 01:06:44.598555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:44.598555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:44.598555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:44.598555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:44.598555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:44.599458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:44.600494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:44.600494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 13 01:06:44.600494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 13 01:06:44.600494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:44.600494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:44.600494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 13 01:06:44.600494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 13 01:06:44.600494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 44d0e668c6ce414e8efe76c06411365f. Sep 13 01:06:44.600494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:44.600494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 470/947] 10.222.0.20 () {60 vars in 1140 bytes} [Tue Sep 13 01:06:44 2022] POST /identity/v3/projects => generated 262 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:44.601062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1a0f4-b4f3-430e-9742-054b8230709c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:44.673122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bc221-95dd-44e1-8cc2-be95745707b4 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:44.674343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bc221-95dd-44e1-8cc2-be95745707b4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:44.674562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bc221-95dd-44e1-8cc2-be95745707b4 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:44.685105 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 471/948] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:06:44.686472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086f8f7-11c1-4d47-a85a-ac63ca1423e6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:44.686760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086f8f7-11c1-4d47-a85a-ac63ca1423e6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:44.687034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086f8f7-11c1-4d47-a85a-ac63ca1423e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:44.713805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a086f8f7-11c1-4d47-a85a-ac63ca1423e6 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:44.715792 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a086f8f7-11c1-4d47-a85a-ac63ca1423e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:44.747429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:44.754111 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1a0f4-b4f3-430e-9742-054b8230709c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:44.800488 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2a0aa-da03-4dc4-b0f1-5b2fffd0ed03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:44.801460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2a0aa-da03-4dc4-b0f1-5b2fffd0ed03 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:44.801746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2a0aa-da03-4dc4-b0f1-5b2fffd0ed03 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:44.802292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2a0aa-da03-4dc4-b0f1-5b2fffd0ed03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:44.806673 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 472/949] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:44.809566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2a0aa-da03-4dc4-b0f1-5b2fffd0ed03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:44.811027 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2a0aa-da03-4dc4-b0f1-5b2fffd0ed03 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:44.822950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-1dd2a0aa-da03-4dc4-b0f1-5b2fffd0ed03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:44.822950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:44.822950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:44.822950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:44.822950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:44.822950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:44.822950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:44.822950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:44.822950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:44.822950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:44.822950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:44.822950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:44.822950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:44.822950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:44.822950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:44.823948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:44.825403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:44.825403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:44.825403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:44.825403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:44.825403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:44.825403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:44.825403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:44.825403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:44.829181 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 478/950] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:44.832148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086f8f7-11c1-4d47-a85a-ac63ca1423e6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:44.934484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086f8f7-11c1-4d47-a85a-ac63ca1423e6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:44.972437 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcb8c4-5654-45cb-a9a7-1baf0b8fac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:44.973359 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcb8c4-5654-45cb-a9a7-1baf0b8fac51 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:44.973825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcb8c4-5654-45cb-a9a7-1baf0b8fac51 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:44.974280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcb8c4-5654-45cb-a9a7-1baf0b8fac51 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:44.975157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcb8c4-5654-45cb-a9a7-1baf0b8fac51 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:44.975669 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcb8c4-5654-45cb-a9a7-1baf0b8fac51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:44.977447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcb8c4-5654-45cb-a9a7-1baf0b8fac51 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:44.999180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 473/951] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 13 01:06:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:45.099155 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2a0aa-da03-4dc4-b0f1-5b2fffd0ed03 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:45.149524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:45.220803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2a0aa-da03-4dc4-b0f1-5b2fffd0ed03 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:45.258779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3616847-1df3-4cad-8a8f-870892b82f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:45.259455 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3616847-1df3-4cad-8a8f-870892b82f97 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:45.259859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3616847-1df3-4cad-8a8f-870892b82f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:45.260138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3616847-1df3-4cad-8a8f-870892b82f97 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:45.260721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3616847-1df3-4cad-8a8f-870892b82f97 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:45.262253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3616847-1df3-4cad-8a8f-870892b82f97 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a3616847-1df3-4cad-8a8f-870892b82f97 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:45.277201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:45.278349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:45.279405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:45.279405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:45.279405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:45.279405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:45.279405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:45.279405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:45.279405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:45.279405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:45.279405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:45.279405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:45.279405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:45.279405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:45.279405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 01:06:45.279405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:45.282575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 479/952] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 13 01:06:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:45.288541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcb8c4-5654-45cb-a9a7-1baf0b8fac51 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:45.317289 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:45.412069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcb8c4-5654-45cb-a9a7-1baf0b8fac51 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:45.448370 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763db83c-33eb-4cb3-ac07-5119480c9ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:45.448984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763db83c-33eb-4cb3-ac07-5119480c9ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:45.449268 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763db83c-33eb-4cb3-ac07-5119480c9ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:45.449543 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763db83c-33eb-4cb3-ac07-5119480c9ce5 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:45.450447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763db83c-33eb-4cb3-ac07-5119480c9ce5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:45.450750 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763db83c-33eb-4cb3-ac07-5119480c9ce5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:45.452162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763db83c-33eb-4cb3-ac07-5119480c9ce5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:45.457595 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 474/953] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 13 01:06:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:45.463534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3616847-1df3-4cad-8a8f-870892b82f97 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:45.492431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cb1e8-32f1-4236-b790-b2d842b1ba29 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:45.492729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cb1e8-32f1-4236-b790-b2d842b1ba29 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:45.492982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cb1e8-32f1-4236-b790-b2d842b1ba29 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:45.494572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 475/954] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:06:45.499595 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f06430-8352-4948-8835-f69cff775793 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:45.499879 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f06430-8352-4948-8835-f69cff775793 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:45.500151 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f06430-8352-4948-8835-f69cff775793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:45.518213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-02f06430-8352-4948-8835-f69cff775793 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:45.519428 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-02f06430-8352-4948-8835-f69cff775793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:45.588895 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3616847-1df3-4cad-8a8f-870892b82f97 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:45.599376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:45.606700 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 476/955] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:45.628410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d43b76-f569-47d3-9c3c-76e575a9dc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:45.629023 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d43b76-f569-47d3-9c3c-76e575a9dc69 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:45.629301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d43b76-f569-47d3-9c3c-76e575a9dc69 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:45.629577 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d43b76-f569-47d3-9c3c-76e575a9dc69 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:45.630209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d43b76-f569-47d3-9c3c-76e575a9dc69 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:45.630510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d43b76-f569-47d3-9c3c-76e575a9dc69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:45.631914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d43b76-f569-47d3-9c3c-76e575a9dc69 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:45.637063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 480/956] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 13 01:06:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:45.643878 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f06430-8352-4948-8835-f69cff775793 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:45.663471 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:45.744788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f06430-8352-4948-8835-f69cff775793 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:45.781843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd116c8-92bf-4330-9d0c-6961ee93e231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:45.782453 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd116c8-92bf-4330-9d0c-6961ee93e231 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:45.782728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd116c8-92bf-4330-9d0c-6961ee93e231 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:45.787117 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd116c8-92bf-4330-9d0c-6961ee93e231 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:45.787117 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd116c8-92bf-4330-9d0c-6961ee93e231 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:45.787117 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd116c8-92bf-4330-9d0c-6961ee93e231 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:45.808198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 477/957] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:06:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:06:45.902212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d43b76-f569-47d3-9c3c-76e575a9dc69 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:46.019037 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d43b76-f569-47d3-9c3c-76e575a9dc69 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:46.066159 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7b7e0-f0c9-4ff1-9b29-f7d23fbff85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:46.066790 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b7e0-f0c9-4ff1-9b29-f7d23fbff85e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:46.067077 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b7e0-f0c9-4ff1-9b29-f7d23fbff85e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:46.067360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b7e0-f0c9-4ff1-9b29-f7d23fbff85e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:46.067940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7b7e0-f0c9-4ff1-9b29-f7d23fbff85e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:46.069367 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7b7e0-f0c9-4ff1-9b29-f7d23fbff85e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-47c7b7e0-f0c9-4ff1-9b29-f7d23fbff85e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:46.080201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:46.081230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:46.082100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:46.082100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:46.082100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:46.082100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:46.082100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:46.082100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:46.082100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:46.082100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:46.082100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:46.082100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:46.082100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:46.082100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:46.082100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 01:06:46.082100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:46.082100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 481/958] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:46.087663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd116c8-92bf-4330-9d0c-6961ee93e231 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:46.158226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:46.193190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd116c8-92bf-4330-9d0c-6961ee93e231 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:46.227852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd86a6c-60b3-47f6-b2b6-21120ed0b29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:46.228460 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd86a6c-60b3-47f6-b2b6-21120ed0b29d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:46.228735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd86a6c-60b3-47f6-b2b6-21120ed0b29d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:46.229000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd86a6c-60b3-47f6-b2b6-21120ed0b29d None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:46.229620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd86a6c-60b3-47f6-b2b6-21120ed0b29d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:46.229918 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd86a6c-60b3-47f6-b2b6-21120ed0b29d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:46.231368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd86a6c-60b3-47f6-b2b6-21120ed0b29d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:46.236562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 478/959] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 13 01:06:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:46.242060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7b7e0-f0c9-4ff1-9b29-f7d23fbff85e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:46.274184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:46.351469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7b7e0-f0c9-4ff1-9b29-f7d23fbff85e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:46.391197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca858a-5ef5-431c-a769-2d83a3d816c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:46.391818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca858a-5ef5-431c-a769-2d83a3d816c4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:46.392104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca858a-5ef5-431c-a769-2d83a3d816c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:46.392439 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca858a-5ef5-431c-a769-2d83a3d816c4 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:46.393076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca858a-5ef5-431c-a769-2d83a3d816c4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:46.393382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca858a-5ef5-431c-a769-2d83a3d816c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:46.394763 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca858a-5ef5-431c-a769-2d83a3d816c4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:46.399944 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 482/960] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 13 01:06:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:46.971371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df6bf2-7640-4ad7-8373-bec6630ef189 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:46.971916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df6bf2-7640-4ad7-8373-bec6630ef189 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:46.971916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df6bf2-7640-4ad7-8373-bec6630ef189 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:46.973588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 479/961] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:46.978853 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e85c5-69f7-4be1-8451-04a8feb2fdb4 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:46.979296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e85c5-69f7-4be1-8451-04a8feb2fdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:46.979502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e85c5-69f7-4be1-8451-04a8feb2fdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:46.998331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a95e85c5-69f7-4be1-8451-04a8feb2fdb4 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:46.999548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a95e85c5-69f7-4be1-8451-04a8feb2fdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:47.070556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 483/962] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:47.338895 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df6bf2-7640-4ad7-8373-bec6630ef189 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:47.364054 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a8d73-4734-431a-ae33-a66185b5c288 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:47.364664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a8d73-4734-431a-ae33-a66185b5c288 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:47.365179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a8d73-4734-431a-ae33-a66185b5c288 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:47.366985 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 484/963] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:47.372096 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a31855-b20a-4a0a-87a6-f88480de7f4e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:47.372596 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a31855-b20a-4a0a-87a6-f88480de7f4e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:47.373076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a31855-b20a-4a0a-87a6-f88480de7f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:47.392711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e7a31855-b20a-4a0a-87a6-f88480de7f4e None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:47.394385 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e7a31855-b20a-4a0a-87a6-f88480de7f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:47.412018 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:47.455330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df6bf2-7640-4ad7-8373-bec6630ef189 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:47.486678 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 485/964] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:47.498617 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8b962-b05a-401e-8e62-aca3a72fa6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:47.499564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8b962-b05a-401e-8e62-aca3a72fa6ab None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:47.500040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8b962-b05a-401e-8e62-aca3a72fa6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:47.500504 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8b962-b05a-401e-8e62-aca3a72fa6ab None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:47.503364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:47.512806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8b962-b05a-401e-8e62-aca3a72fa6ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-79a8b962-b05a-401e-8e62-aca3a72fa6ab None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:47.518381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:47.519502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:47.520368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:47.520368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:47.520368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:47.520368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:47.520368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:47.520368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:47.520368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:47.520368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:47.520368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:47.520368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:47.520368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 01:06:47.520368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:47.520368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 480/965] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Sep 13 01:06:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:47.525708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a31855-b20a-4a0a-87a6-f88480de7f4e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:47.636804 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a31855-b20a-4a0a-87a6-f88480de7f4e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:47.673245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f2e9f-2468-48db-b886-b5ce50e3d4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:47.673971 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f2e9f-2468-48db-b886-b5ce50e3d4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:47.674252 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f2e9f-2468-48db-b886-b5ce50e3d4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:47.674705 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f2e9f-2468-48db-b886-b5ce50e3d4c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:47.675396 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f2e9f-2468-48db-b886-b5ce50e3d4c3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:47.675702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f2e9f-2468-48db-b886-b5ce50e3d4c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:47.677138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f2e9f-2468-48db-b886-b5ce50e3d4c3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:47.685789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 486/966] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 13 01:06:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:47.692266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8b962-b05a-401e-8e62-aca3a72fa6ab None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:47.795450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8b962-b05a-401e-8e62-aca3a72fa6ab None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:47.802573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f2e9f-2468-48db-b886-b5ce50e3d4c3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:47.820006 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:47.835139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416e491-ed0d-44b1-a8c6-f747f52f20f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:47.836085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416e491-ed0d-44b1-a8c6-f747f52f20f1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:47.836372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416e491-ed0d-44b1-a8c6-f747f52f20f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:47.836646 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416e491-ed0d-44b1-a8c6-f747f52f20f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:47.849112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416e491-ed0d-44b1-a8c6-f747f52f20f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:47.851100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416e491-ed0d-44b1-a8c6-f747f52f20f1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0416e491-ed0d-44b1-a8c6-f747f52f20f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:47.867978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:47.868953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:47.869906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:47.869906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:47.869906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:47.869906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 481/967] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:47.875097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416e491-ed0d-44b1-a8c6-f747f52f20f1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:47.922205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f2e9f-2468-48db-b886-b5ce50e3d4c3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:47.926293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:47.964002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e27ad7-acec-4256-902c-9e49478cd588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:47.965069 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e27ad7-acec-4256-902c-9e49478cd588 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:47.965606 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e27ad7-acec-4256-902c-9e49478cd588 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:47.966157 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e27ad7-acec-4256-902c-9e49478cd588 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:47.967199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e27ad7-acec-4256-902c-9e49478cd588 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:47.969090 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e27ad7-acec-4256-902c-9e49478cd588 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:47.972915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: WARNING keystone.server.flask.common [None req-27e27ad7-acec-4256-902c-9e49478cd588 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 01:06:47.988082 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.sql.core [None req-27e27ad7-acec-4256-902c-9e49478cd588 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 01:06:47.988082 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 01:06:47.988082 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [parameters: {'user_id': '9accdc6748444940a15f3005dcaa132b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 01:06:47.988082 dv-cinder-856941-3-smb devstack@keystone.service[81467]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81467) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 01:06:47.988957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416e491-ed0d-44b1-a8c6-f747f52f20f1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:48.013890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-27e27ad7-acec-4256-902c-9e49478cd588 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 01:06:48.013890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:48.013890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 01:06:48.013890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 01:06:48.013890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 01:06:48.013890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 01:06:48.013890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 01:06:48.013890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 01:06:48.013890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 01:06:48.013890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application conn.query(q) Sep 13 01:06:48.013890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 01:06:48.013890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 01:06:48.013890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 01:06:48.013890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application result.read() Sep 13 01:06:48.013890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 01:06:48.014864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application next(self.gen) Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application yield resource Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application next(self.gen) Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise self.value Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application session.commit() Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 01:06:48.015915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self.session.flush() Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application compat.raise_( Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 01:06:48.016830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 01:06:48.018173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application conn.query(q) Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application result.read() Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 01:06:48.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 01:06:48.020709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 01:06:48.020709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 01:06:48.020709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 01:06:48.020709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 01:06:48.020709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 01:06:48.020709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 01:06:48.020709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [parameters: {'user_id': '9accdc6748444940a15f3005dcaa132b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 01:06:48.020709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 01:06:48.020709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:48.020709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:48.020709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:48.020709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:48.020709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:48.020709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:48.020709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 13 01:06:48.021526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 13 01:06:48.022473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 13 01:06:48.022473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 13 01:06:48.022473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 01:06:48.022473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 01:06:48.022473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 01:06:48.022473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:48.022473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 487/968] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Sep 13 01:06:47 2022] POST /identity/v3/users => generated 160 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:48.027338 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e27ad7-acec-4256-902c-9e49478cd588 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:48.037253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec16ca-933d-4624-8a0c-03c2fc637915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:48.037962 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec16ca-933d-4624-8a0c-03c2fc637915 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:48.038377 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec16ca-933d-4624-8a0c-03c2fc637915 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:48.038727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec16ca-933d-4624-8a0c-03c2fc637915 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:48.039545 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec16ca-933d-4624-8a0c-03c2fc637915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:48.039924 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec16ca-933d-4624-8a0c-03c2fc637915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:48.041670 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec16ca-933d-4624-8a0c-03c2fc637915 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:48.061127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 482/969] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:48.067601 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec16ca-933d-4624-8a0c-03c2fc637915 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:48.124016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:48.151896 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e27ad7-acec-4256-902c-9e49478cd588 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:48.177580 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec16ca-933d-4624-8a0c-03c2fc637915 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:48.186900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:48.189691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a4918-b23e-4300-bd25-40395537c431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:48.190766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a4918-b23e-4300-bd25-40395537c431 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:48.190991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a4918-b23e-4300-bd25-40395537c431 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:48.191300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a4918-b23e-4300-bd25-40395537c431 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:48.199603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a4918-b23e-4300-bd25-40395537c431 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:48.201499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a4918-b23e-4300-bd25-40395537c431 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-853a4918-b23e-4300-bd25-40395537c431 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:48.213413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:48.214430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:48.215431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:48.215431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:48.215431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:48.215431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:48.215431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:48.215431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:48.215431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:48.215431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:48.215431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 01:06:48.215431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:48.215431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 488/970] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:06:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:48.216059 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ba5b5-fbdd-4b28-967b-9ce246f6324c None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:48.216137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ba5b5-fbdd-4b28-967b-9ce246f6324c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:48.216559 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ba5b5-fbdd-4b28-967b-9ce246f6324c None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:48.220753 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 489/971] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:48.221716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ba5b5-fbdd-4b28-967b-9ce246f6324c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:48.226438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e207572-d16f-4a68-b7be-6c89c03d31dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:48.227097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e207572-d16f-4a68-b7be-6c89c03d31dc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:48.228167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e207572-d16f-4a68-b7be-6c89c03d31dc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:48.228167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e207572-d16f-4a68-b7be-6c89c03d31dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:48.235210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e207572-d16f-4a68-b7be-6c89c03d31dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:48.237235 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e207572-d16f-4a68-b7be-6c89c03d31dc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-4e207572-d16f-4a68-b7be-6c89c03d31dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:48.250080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:48.251034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:48.252507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:48.252507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:48.252507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:48.252507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:48.252507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:48.252507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:48.252507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:48.252507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:48.252507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 01:06:48.252507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:48.252507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 483/972] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 13 01:06:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:48.253216 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3cfdc-bc71-431b-a884-1f2c9cfa4406 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:48.253216 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3cfdc-bc71-431b-a884-1f2c9cfa4406 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:48.253349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3cfdc-bc71-431b-a884-1f2c9cfa4406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:48.275044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fba3cfdc-bc71-431b-a884-1f2c9cfa4406 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:48.276317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fba3cfdc-bc71-431b-a884-1f2c9cfa4406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:48.337164 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ba5b5-fbdd-4b28-967b-9ce246f6324c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:48.346860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 484/973] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:48.347645 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3cfdc-bc71-431b-a884-1f2c9cfa4406 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:48.392793 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c875ce4-24c2-4989-9e10-be7a2a69d765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:48.394234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c875ce4-24c2-4989-9e10-be7a2a69d765 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:48.395140 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c875ce4-24c2-4989-9e10-be7a2a69d765 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:48.395605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c875ce4-24c2-4989-9e10-be7a2a69d765 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:48.396781 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c875ce4-24c2-4989-9e10-be7a2a69d765 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:48.397283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c875ce4-24c2-4989-9e10-be7a2a69d765 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:48.399912 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c875ce4-24c2-4989-9e10-be7a2a69d765 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:48.416239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:48.452623 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 490/974] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 13 01:06:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:48.464342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:48.472518 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3cfdc-bc71-431b-a884-1f2c9cfa4406 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:48.512599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d8159-177f-4a7a-b02c-50e88d02a821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:48.513506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d8159-177f-4a7a-b02c-50e88d02a821 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:48.513941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d8159-177f-4a7a-b02c-50e88d02a821 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:48.514399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d8159-177f-4a7a-b02c-50e88d02a821 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:48.515357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d8159-177f-4a7a-b02c-50e88d02a821 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:48.515828 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d8159-177f-4a7a-b02c-50e88d02a821 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:48.517557 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d8159-177f-4a7a-b02c-50e88d02a821 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:48.540248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 485/975] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Sep 13 01:06:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:48.545914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c875ce4-24c2-4989-9e10-be7a2a69d765 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:48.631219 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d8159-177f-4a7a-b02c-50e88d02a821 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:48.663538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c875ce4-24c2-4989-9e10-be7a2a69d765 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:48.702530 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d07912-3bd3-4380-abbb-0eacf5591db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:48.703222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d07912-3bd3-4380-abbb-0eacf5591db3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:48.703458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d07912-3bd3-4380-abbb-0eacf5591db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:48.703787 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d07912-3bd3-4380-abbb-0eacf5591db3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:48.750039 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d8159-177f-4a7a-b02c-50e88d02a821 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:48.772985 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:48.781212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d07912-3bd3-4380-abbb-0eacf5591db3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:48.782668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d07912-3bd3-4380-abbb-0eacf5591db3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:48.788375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7d22f-ace0-4dda-87ef-1a2d6b349ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:48.789015 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d22f-ace0-4dda-87ef-1a2d6b349ded None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:48.789298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d22f-ace0-4dda-87ef-1a2d6b349ded None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:48.789575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d22f-ace0-4dda-87ef-1a2d6b349ded None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:48.790162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7d22f-ace0-4dda-87ef-1a2d6b349ded None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:48.791551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7d22f-ace0-4dda-87ef-1a2d6b349ded None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f8f7d22f-ace0-4dda-87ef-1a2d6b349ded None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:48.800371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:48.801516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:48.802353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:48.802353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:48.802353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:48.802353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:48.802353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:48.802353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:48.802353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:48.802353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:48.802353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:48.802353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:48.802353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:48.802353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:48.802353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 01:06:48.802353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:48.802353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 486/976] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 13 01:06:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:48.803315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaca028-bda1-4c23-b26d-84678c7773ff None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:48.803315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaca028-bda1-4c23-b26d-84678c7773ff None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:48.803468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaca028-bda1-4c23-b26d-84678c7773ff None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:48.804832 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 487/977] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:48.807820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaca028-bda1-4c23-b26d-84678c7773ff None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:48.826941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:48.883626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 491/978] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:06:48 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 01:06:48.883626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b59db-8885-4fda-a7c9-6cc0b932137b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:48.883626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b59db-8885-4fda-a7c9-6cc0b932137b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:48.883626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b59db-8885-4fda-a7c9-6cc0b932137b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:48.902723 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6f0b59db-8885-4fda-a7c9-6cc0b932137b None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:48.904257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6f0b59db-8885-4fda-a7c9-6cc0b932137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:48.914325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaca028-bda1-4c23-b26d-84678c7773ff None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:48.948485 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e700d-d62e-4b3f-a940-ee9b88cf0264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:48.949086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e700d-d62e-4b3f-a940-ee9b88cf0264 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:48.949361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e700d-d62e-4b3f-a940-ee9b88cf0264 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:48.949635 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e700d-d62e-4b3f-a940-ee9b88cf0264 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:48.950508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e700d-d62e-4b3f-a940-ee9b88cf0264 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:48.950808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e700d-d62e-4b3f-a940-ee9b88cf0264 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:48.952197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e700d-d62e-4b3f-a940-ee9b88cf0264 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:48.956796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 488/979] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 13 01:06:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:48.957504 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e700d-d62e-4b3f-a940-ee9b88cf0264 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:48.971016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 492/980] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:48.971894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b59db-8885-4fda-a7c9-6cc0b932137b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:48.998772 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:49.050701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:49.070946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e700d-d62e-4b3f-a940-ee9b88cf0264 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:49.093718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b59db-8885-4fda-a7c9-6cc0b932137b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:49.107708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cb26f-eab6-4aab-9438-1707066fd97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:49.108351 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cb26f-eab6-4aab-9438-1707066fd97a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:49.108629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cb26f-eab6-4aab-9438-1707066fd97a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:49.108927 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cb26f-eab6-4aab-9438-1707066fd97a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:49.121449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cb26f-eab6-4aab-9438-1707066fd97a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:49.122893 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cb26f-eab6-4aab-9438-1707066fd97a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:49.129130 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cb90f-3336-4f73-8256-355904c74625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:49.130129 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cb90f-3336-4f73-8256-355904c74625 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:49.130407 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cb90f-3336-4f73-8256-355904c74625 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:49.130674 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cb90f-3336-4f73-8256-355904c74625 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:49.131706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cb90f-3336-4f73-8256-355904c74625 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:49.132011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cb90f-3336-4f73-8256-355904c74625 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:49.133511 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cb90f-3336-4f73-8256-355904c74625 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-410cb26f-eab6-4aab-9438-1707066fd97a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:49.137374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:49.138291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:49.139619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:49.139619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:49.139619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:49.143828 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 489/981] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:49.144376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 493/982] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 13 01:06:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:49.145343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cb26f-eab6-4aab-9438-1707066fd97a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:49.145537 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cb90f-3336-4f73-8256-355904c74625 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:49.242051 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:49.254152 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cb26f-eab6-4aab-9438-1707066fd97a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:49.255839 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cb90f-3336-4f73-8256-355904c74625 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:49.287632 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976619a-16b5-42e7-be84-28d2101337e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:49.288233 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976619a-16b5-42e7-be84-28d2101337e8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:49.288513 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976619a-16b5-42e7-be84-28d2101337e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:49.288783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976619a-16b5-42e7-be84-28d2101337e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:49.289417 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976619a-16b5-42e7-be84-28d2101337e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:49.289716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976619a-16b5-42e7-be84-28d2101337e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:49.289810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea936d83-f905-401e-b403-70e2f585a38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:49.290410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea936d83-f905-401e-b403-70e2f585a38f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:49.290687 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea936d83-f905-401e-b403-70e2f585a38f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:49.290958 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea936d83-f905-401e-b403-70e2f585a38f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:49.291200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976619a-16b5-42e7-be84-28d2101337e8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:49.291694 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea936d83-f905-401e-b403-70e2f585a38f None admin] RBAC: Adding query filter params (interface=admin, service_id=15a90f79dfa646cab130c072281ec83f, region_id=RegionOne) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:49.292001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea936d83-f905-401e-b403-70e2f585a38f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:49.292602 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:49.293412 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea936d83-f905-401e-b403-70e2f585a38f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:49.299114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 494/983] 10.222.0.20 () {56 vars in 1249 bytes} [Tue Sep 13 01:06:49 2022] GET /identity/v3/endpoints?service_id=15a90f79dfa646cab130c072281ec83f&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:49.299849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea936d83-f905-401e-b403-70e2f585a38f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:49.307353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 490/984] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:49.308228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976619a-16b5-42e7-be84-28d2101337e8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:49.398783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea936d83-f905-401e-b403-70e2f585a38f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:49.404952 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976619a-16b5-42e7-be84-28d2101337e8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:49.434470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2e582-fc3b-42c3-ab81-752f944443fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:49.435095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2e582-fc3b-42c3-ab81-752f944443fa None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:49.435387 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2e582-fc3b-42c3-ab81-752f944443fa None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:49.435664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2e582-fc3b-42c3-ab81-752f944443fa None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:49.436316 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2e582-fc3b-42c3-ab81-752f944443fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:49.437697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2e582-fc3b-42c3-ab81-752f944443fa None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:49.444317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36920199-9ca2-416b-962f-678384f701a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:49.444924 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36920199-9ca2-416b-962f-678384f701a4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:49.445212 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36920199-9ca2-416b-962f-678384f701a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:49.445485 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36920199-9ca2-416b-962f-678384f701a4 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:49.446085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36920199-9ca2-416b-962f-678384f701a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:49.447560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36920199-9ca2-416b-962f-678384f701a4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:49.454799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 491/985] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 13 01:06:49 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:06:49.455477 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36920199-9ca2-416b-962f-678384f701a4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:49.459172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 495/986] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 13 01:06:49 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:06:49.528826 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:49.579197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36920199-9ca2-416b-962f-678384f701a4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:49.627858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656487b3-a601-4592-81b6-7dc29967d4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:49.628521 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656487b3-a601-4592-81b6-7dc29967d4ff None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:49.628804 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656487b3-a601-4592-81b6-7dc29967d4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:49.629078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656487b3-a601-4592-81b6-7dc29967d4ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:49.636897 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656487b3-a601-4592-81b6-7dc29967d4ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:49.638366 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656487b3-a601-4592-81b6-7dc29967d4ff None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:49.650862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-656487b3-a601-4592-81b6-7dc29967d4ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:49.650862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:49.650862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:49.650862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:49.650862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:49.650862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:49.650862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:49.650862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:49.650862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:49.650862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:49.650862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:49.650862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:49.650862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:06:49.650862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:06:49.650862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:49.651996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:49.653094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:06:49.653094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:06:49.653094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:06:49.653094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:06:49.653094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:06:49.653094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:06:49.653094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:06:49.653094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:49.658579 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 492/987] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:49.658733 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2e582-fc3b-42c3-ab81-752f944443fa None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:49.677336 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:49.770036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2e582-fc3b-42c3-ab81-752f944443fa None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:49.804365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8dfdf-c693-46e0-bc1b-72ae49d016ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:49.804899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8dfdf-c693-46e0-bc1b-72ae49d016ba None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:49.805179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8dfdf-c693-46e0-bc1b-72ae49d016ba None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:49.805450 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8dfdf-c693-46e0-bc1b-72ae49d016ba None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:49.806142 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8dfdf-c693-46e0-bc1b-72ae49d016ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:49.806451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8dfdf-c693-46e0-bc1b-72ae49d016ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:49.807925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8dfdf-c693-46e0-bc1b-72ae49d016ba None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:49.825910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 496/988] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:06:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:49.827152 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656487b3-a601-4592-81b6-7dc29967d4ff None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:49.927134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656487b3-a601-4592-81b6-7dc29967d4ff None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:49.941739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:49.962602 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9340c-72fa-4d5f-91a1-64a5d0dff137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:49.963400 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9340c-72fa-4d5f-91a1-64a5d0dff137 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:49.963784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9340c-72fa-4d5f-91a1-64a5d0dff137 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:49.964182 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9340c-72fa-4d5f-91a1-64a5d0dff137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:49.965014 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9340c-72fa-4d5f-91a1-64a5d0dff137 None admin] RBAC: Adding query filter params (role.id=063ead59de26487aade9d571bde678c5, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=da83fb76a0b04aa2bdb91f6c25dc6cc6) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:49.965428 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9340c-72fa-4d5f-91a1-64a5d0dff137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:49.967881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9340c-72fa-4d5f-91a1-64a5d0dff137 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:49.979106 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 493/989] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:06:49 2022] GET /identity/v3/role_assignments?user.id=da83fb76a0b04aa2bdb91f6c25dc6cc6&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=063ead59de26487aade9d571bde678c5 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:51.660589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efe7cd-d273-429a-a064-c7435bc8e327 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:51.661107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efe7cd-d273-429a-a064-c7435bc8e327 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:51.661223 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efe7cd-d273-429a-a064-c7435bc8e327 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:51.662552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 497/990] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:51.667852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e931938-7c38-44cc-ac8a-1f89ee8c5879 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:51.668265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e931938-7c38-44cc-ac8a-1f89ee8c5879 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:51.668383 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e931938-7c38-44cc-ac8a-1f89ee8c5879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:51.678683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dc935-de60-4761-a6b4-22c93ea7ea42 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:51.678935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dc935-de60-4761-a6b4-22c93ea7ea42 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:51.679197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dc935-de60-4761-a6b4-22c93ea7ea42 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:51.680688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 498/991] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:06:51.685456 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516641a-560a-4ae1-ad54-261682dd0576 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:51.685868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516641a-560a-4ae1-ad54-261682dd0576 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:51.686151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516641a-560a-4ae1-ad54-261682dd0576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:51.686574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5e931938-7c38-44cc-ac8a-1f89ee8c5879 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:51.687788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5e931938-7c38-44cc-ac8a-1f89ee8c5879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:51.704555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a516641a-560a-4ae1-ad54-261682dd0576 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:51.706355 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a516641a-560a-4ae1-ad54-261682dd0576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:51.764079 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 494/992] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:51.774881 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 499/993] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:52.036171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e931938-7c38-44cc-ac8a-1f89ee8c5879 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:52.044275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516641a-560a-4ae1-ad54-261682dd0576 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:52.047309 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:52.147962 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e931938-7c38-44cc-ac8a-1f89ee8c5879 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:52.159099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:52.159640 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516641a-560a-4ae1-ad54-261682dd0576 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:52.185203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a23da-8ff6-40c6-a862-289a1d6fa0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:52.185835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a23da-8ff6-40c6-a862-289a1d6fa0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:52.186109 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a23da-8ff6-40c6-a862-289a1d6fa0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:52.186380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a23da-8ff6-40c6-a862-289a1d6fa0b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:52.186960 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a23da-8ff6-40c6-a862-289a1d6fa0b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:52.188373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a23da-8ff6-40c6-a862-289a1d6fa0b3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:52.196232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab203fed-595a-4dc5-98af-ca45dd61457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:52.196859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab203fed-595a-4dc5-98af-ca45dd61457a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:52.197138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab203fed-595a-4dc5-98af-ca45dd61457a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:52.197409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab203fed-595a-4dc5-98af-ca45dd61457a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:52.197988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab203fed-595a-4dc5-98af-ca45dd61457a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-104a23da-8ff6-40c6-a862-289a1d6fa0b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:52.198082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:52.203293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:52.204199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:52.204199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:52.204199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:52.204199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:52.204199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:52.204199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:52.204199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:52.204199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:52.204199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:52.204199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:52.204199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:52.204199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:52.204199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 01:06:52.204199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:52.204199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 495/994] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 13 01:06:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:52.205047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab203fed-595a-4dc5-98af-ca45dd61457a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:52.205120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c366aa-0aee-49bc-816e-8333d21f85b3 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:52.205120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c366aa-0aee-49bc-816e-8333d21f85b3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:52.205120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c366aa-0aee-49bc-816e-8333d21f85b3 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:52.205120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 496/995] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:52.205363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c366aa-0aee-49bc-816e-8333d21f85b3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-ab203fed-595a-4dc5-98af-ca45dd61457a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:52.212684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:52.213843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:52.214698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:52.214698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:52.214698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:52.214698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:52.214698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:52.214698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:52.214698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:52.214698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:52.214698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:52.214698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:52.214698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:52.214698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:52.214698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 01:06:52.214698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:52.214698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 500/996] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:52.216765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0a418-0995-40ab-8b2e-48456d03a0c3 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:52.216765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0a418-0995-40ab-8b2e-48456d03a0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:52.216765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0a418-0995-40ab-8b2e-48456d03a0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:52.235202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5fb0a418-0995-40ab-8b2e-48456d03a0c3 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:52.237544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5fb0a418-0995-40ab-8b2e-48456d03a0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:52.298983 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:52.306566 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c366aa-0aee-49bc-816e-8333d21f85b3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:52.306701 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 501/997] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:52.307549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0a418-0995-40ab-8b2e-48456d03a0c3 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:52.349820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579fae6-9624-4f5a-8920-f15bb6b878ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:52.350543 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579fae6-9624-4f5a-8920-f15bb6b878ae None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:52.350817 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579fae6-9624-4f5a-8920-f15bb6b878ae None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:52.351108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579fae6-9624-4f5a-8920-f15bb6b878ae None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:52.351749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579fae6-9624-4f5a-8920-f15bb6b878ae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:52.352055 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579fae6-9624-4f5a-8920-f15bb6b878ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:52.353698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579fae6-9624-4f5a-8920-f15bb6b878ae None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:52.359663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 497/998] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 13 01:06:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:52.365823 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579fae6-9624-4f5a-8920-f15bb6b878ae None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:52.401320 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:52.411960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0a418-0995-40ab-8b2e-48456d03a0c3 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:52.451078 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72821f5-02cb-4c62-afb2-2749c379f7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:52.452082 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72821f5-02cb-4c62-afb2-2749c379f7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:52.452372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72821f5-02cb-4c62-afb2-2749c379f7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:52.452655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72821f5-02cb-4c62-afb2-2749c379f7a0 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:52.453603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72821f5-02cb-4c62-afb2-2749c379f7a0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:52.454075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72821f5-02cb-4c62-afb2-2749c379f7a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:52.455559 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72821f5-02cb-4c62-afb2-2749c379f7a0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:52.460977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 502/999] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 13 01:06:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:52.466514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72821f5-02cb-4c62-afb2-2749c379f7a0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:52.476907 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579fae6-9624-4f5a-8920-f15bb6b878ae None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:52.514712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a4207-b6ea-4e92-89c7-cd879e8f8c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:52.515369 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a4207-b6ea-4e92-89c7-cd879e8f8c6e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:52.515651 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a4207-b6ea-4e92-89c7-cd879e8f8c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:52.515978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a4207-b6ea-4e92-89c7-cd879e8f8c6e None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:52.516623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a4207-b6ea-4e92-89c7-cd879e8f8c6e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:52.516931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a4207-b6ea-4e92-89c7-cd879e8f8c6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:52.518515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a4207-b6ea-4e92-89c7-cd879e8f8c6e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:52.523649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 498/1000] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 13 01:06:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:52.529473 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a4207-b6ea-4e92-89c7-cd879e8f8c6e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:52.536155 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:52.579481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72821f5-02cb-4c62-afb2-2749c379f7a0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:52.613470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03adb62-9afe-4327-b6b3-7e5f6d687c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:52.614073 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03adb62-9afe-4327-b6b3-7e5f6d687c4b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:52.614354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03adb62-9afe-4327-b6b3-7e5f6d687c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:52.614629 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03adb62-9afe-4327-b6b3-7e5f6d687c4b None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:52.615286 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03adb62-9afe-4327-b6b3-7e5f6d687c4b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:52.615593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03adb62-9afe-4327-b6b3-7e5f6d687c4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:52.616964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03adb62-9afe-4327-b6b3-7e5f6d687c4b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:52.627141 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 503/1001] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 13 01:06:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:52.627141 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03adb62-9afe-4327-b6b3-7e5f6d687c4b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:52.631967 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:52.635285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a4207-b6ea-4e92-89c7-cd879e8f8c6e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:52.668994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af635f3d-f526-4a18-8d8d-51014bad037e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:52.669637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af635f3d-f526-4a18-8d8d-51014bad037e None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:52.669856 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af635f3d-f526-4a18-8d8d-51014bad037e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:52.670133 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af635f3d-f526-4a18-8d8d-51014bad037e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:52.670800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af635f3d-f526-4a18-8d8d-51014bad037e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:52.672187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af635f3d-f526-4a18-8d8d-51014bad037e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:52.689665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 499/1002] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:06:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:06:52.690566 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af635f3d-f526-4a18-8d8d-51014bad037e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:52.729641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03adb62-9afe-4327-b6b3-7e5f6d687c4b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:52.758687 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:52.779525 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e35083-c4e5-4ea5-a7a3-81a4d9fc98cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:52.780260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e35083-c4e5-4ea5-a7a3-81a4d9fc98cf None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:52.780605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e35083-c4e5-4ea5-a7a3-81a4d9fc98cf None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:52.780943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e35083-c4e5-4ea5-a7a3-81a4d9fc98cf None admin] PATH_INFO: `/v3/services/image` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:52.781637 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e35083-c4e5-4ea5-a7a3-81a4d9fc98cf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:52.783389 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e35083-c4e5-4ea5-a7a3-81a4d9fc98cf None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-75e35083-c4e5-4ea5-a7a3-81a4d9fc98cf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:52.793308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:52.794400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:52.795301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:52.795301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:52.795301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:52.795301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:52.795301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:52.795301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:52.795301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:52.795301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:52.795301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:52.795301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:52.795301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:52.795301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:52.795301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 01:06:52.795301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:52.800588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 504/1003] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Sep 13 01:06:52 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:52.801577 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e35083-c4e5-4ea5-a7a3-81a4d9fc98cf None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:52.824999 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af635f3d-f526-4a18-8d8d-51014bad037e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:52.864708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb85f34-633e-46f0-a9b6-686c6387a777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:52.865243 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb85f34-633e-46f0-a9b6-686c6387a777 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:52.865522 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb85f34-633e-46f0-a9b6-686c6387a777 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:52.865792 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb85f34-633e-46f0-a9b6-686c6387a777 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:52.866492 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb85f34-633e-46f0-a9b6-686c6387a777 None admin] RBAC: Adding query filter params (interface=public, service_id=a44b6d6d113e46fb81c50bd4bcdabe4e, region_id=RegionOne) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:52.866797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb85f34-633e-46f0-a9b6-686c6387a777 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:52.868185 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb85f34-633e-46f0-a9b6-686c6387a777 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:52.873953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 500/1004] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 13 01:06:52 2022] GET /identity/v3/endpoints?service_id=a44b6d6d113e46fb81c50bd4bcdabe4e&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:52.881125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb85f34-633e-46f0-a9b6-686c6387a777 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:52.911661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:52.927680 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e35083-c4e5-4ea5-a7a3-81a4d9fc98cf None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:52.967916 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0161a-e247-4114-a84e-1d3c843bdeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:52.968537 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0161a-e247-4114-a84e-1d3c843bdeb4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:52.968800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0161a-e247-4114-a84e-1d3c843bdeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:52.969075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0161a-e247-4114-a84e-1d3c843bdeb4 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:52.969704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0161a-e247-4114-a84e-1d3c843bdeb4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:52.970008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0161a-e247-4114-a84e-1d3c843bdeb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:52.972185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0161a-e247-4114-a84e-1d3c843bdeb4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:52.977259 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 505/1005] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:52.982599 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0161a-e247-4114-a84e-1d3c843bdeb4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:52.994965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb85f34-633e-46f0-a9b6-686c6387a777 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:53.030342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa346804-f7f8-4ca2-b282-e227c24e727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:53.030946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa346804-f7f8-4ca2-b282-e227c24e727c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:53.031260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa346804-f7f8-4ca2-b282-e227c24e727c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:53.031524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa346804-f7f8-4ca2-b282-e227c24e727c None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:53.032212 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa346804-f7f8-4ca2-b282-e227c24e727c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:53.034678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa346804-f7f8-4ca2-b282-e227c24e727c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:53.040600 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:53.041727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 501/1006] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 13 01:06:52 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:06:53.100591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0161a-e247-4114-a84e-1d3c843bdeb4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:53.137862 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b60c1e-db64-413e-992a-8817b71f17f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:53.138402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60c1e-db64-413e-992a-8817b71f17f4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:53.138807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60c1e-db64-413e-992a-8817b71f17f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:53.139058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60c1e-db64-413e-992a-8817b71f17f4 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:53.139729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b60c1e-db64-413e-992a-8817b71f17f4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:53.140033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b60c1e-db64-413e-992a-8817b71f17f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:53.141422 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b60c1e-db64-413e-992a-8817b71f17f4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:53.151133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 506/1007] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:54.884602 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079f2b2-bf45-4c2d-9fdb-e513c91f0ec8 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:54.885167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079f2b2-bf45-4c2d-9fdb-e513c91f0ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:54.885167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079f2b2-bf45-4c2d-9fdb-e513c91f0ec8 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:54.886527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 502/1008] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:54.891642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f875c-1d89-4a33-bb94-f508b4a978fa None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:54.892530 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f875c-1d89-4a33-bb94-f508b4a978fa None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:54.892735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f875c-1d89-4a33-bb94-f508b4a978fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:54.910817 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-518f875c-1d89-4a33-bb94-f508b4a978fa None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:54.912081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-518f875c-1d89-4a33-bb94-f508b4a978fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:54.979963 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 507/1009] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:55.222164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7abd37-4b7e-4622-89ca-57b2688e6657 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:55.222369 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7abd37-4b7e-4622-89ca-57b2688e6657 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:55.222638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7abd37-4b7e-4622-89ca-57b2688e6657 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:55.224221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 503/1010] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:55.229912 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6100774-453f-4958-aa35-d09e8ae8ff31 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:55.230237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6100774-453f-4958-aa35-d09e8ae8ff31 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:55.230482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6100774-453f-4958-aa35-d09e8ae8ff31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:55.249417 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7abd37-4b7e-4622-89ca-57b2688e6657 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:55.250204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e6100774-453f-4958-aa35-d09e8ae8ff31 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:55.251652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e6100774-453f-4958-aa35-d09e8ae8ff31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:55.289803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:55.325577 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 508/1011] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:55 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:55.338610 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b69d2a-2ce4-4aed-81ff-fc9b9795b96d None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:55.338900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b69d2a-2ce4-4aed-81ff-fc9b9795b96d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:55.339516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b69d2a-2ce4-4aed-81ff-fc9b9795b96d None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:55.340888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 509/1012] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:06:55.348055 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ec38f-404c-4976-a64d-f6fac78e308b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:55.348336 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ec38f-404c-4976-a64d-f6fac78e308b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:55.348608 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ec38f-404c-4976-a64d-f6fac78e308b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:55.349241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:55.365012 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7abd37-4b7e-4622-89ca-57b2688e6657 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:55.370893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a95ec38f-404c-4976-a64d-f6fac78e308b None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:55.372506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a95ec38f-404c-4976-a64d-f6fac78e308b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:55.399081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc55b2b-3905-4d97-b022-51f4203c9a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:55.399722 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc55b2b-3905-4d97-b022-51f4203c9a87 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:55.399996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc55b2b-3905-4d97-b022-51f4203c9a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:55.400265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc55b2b-3905-4d97-b022-51f4203c9a87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:55.401397 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc55b2b-3905-4d97-b022-51f4203c9a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:55.402824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc55b2b-3905-4d97-b022-51f4203c9a87 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:55.407222 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 504/1013] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:55.410138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc55b2b-3905-4d97-b022-51f4203c9a87 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:55.455848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 510/1014] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:55 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:55.518333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc55b2b-3905-4d97-b022-51f4203c9a87 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:55.551750 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265d4b3-a1e4-4019-a063-70da2a82d6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:55.552344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265d4b3-a1e4-4019-a063-70da2a82d6de None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:55.552620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265d4b3-a1e4-4019-a063-70da2a82d6de None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:55.552886 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265d4b3-a1e4-4019-a063-70da2a82d6de None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:55.553518 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265d4b3-a1e4-4019-a063-70da2a82d6de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:55.554931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265d4b3-a1e4-4019-a063-70da2a82d6de None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:55.591094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 505/1015] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 13 01:06:55 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:06:55.597688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ec38f-404c-4976-a64d-f6fac78e308b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:55.706985 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ec38f-404c-4976-a64d-f6fac78e308b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:55.708641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:55.729578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265d4b3-a1e4-4019-a063-70da2a82d6de None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:55.740966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:55.746537 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433d2ce-37ec-42f1-b0bb-23abc9b97a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:55.747243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433d2ce-37ec-42f1-b0bb-23abc9b97a54 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:55.747903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433d2ce-37ec-42f1-b0bb-23abc9b97a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:55.748196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433d2ce-37ec-42f1-b0bb-23abc9b97a54 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:55.748799 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433d2ce-37ec-42f1-b0bb-23abc9b97a54 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:55.750204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433d2ce-37ec-42f1-b0bb-23abc9b97a54 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a433d2ce-37ec-42f1-b0bb-23abc9b97a54 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:55.759858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:55.760935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:55.761822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:55.761822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:55.761822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:55.761822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:55.761822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:55.761822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:55.761822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:55.761822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:55.761822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:55.761822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:55.761822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:55.761822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:55.761822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 01:06:55.761822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:55.761822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 511/1016] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:06:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:55.767908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433d2ce-37ec-42f1-b0bb-23abc9b97a54 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:55.861734 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265d4b3-a1e4-4019-a063-70da2a82d6de None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:55.888999 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433d2ce-37ec-42f1-b0bb-23abc9b97a54 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:55.898241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4637b0e-8beb-4917-8c2b-f3a05c6ae640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:55.898862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4637b0e-8beb-4917-8c2b-f3a05c6ae640 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:55.899171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4637b0e-8beb-4917-8c2b-f3a05c6ae640 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:55.899449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4637b0e-8beb-4917-8c2b-f3a05c6ae640 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:55.900110 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4637b0e-8beb-4917-8c2b-f3a05c6ae640 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:55.901486 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4637b0e-8beb-4917-8c2b-f3a05c6ae640 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:55.919372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 506/1017] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 13 01:06:55 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:06:55.939778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21932350-9bd9-4d6d-9000-bd0bc7bda9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:55.940447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21932350-9bd9-4d6d-9000-bd0bc7bda9ba None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:55.940723 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21932350-9bd9-4d6d-9000-bd0bc7bda9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:55.940933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21932350-9bd9-4d6d-9000-bd0bc7bda9ba None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:55.941582 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21932350-9bd9-4d6d-9000-bd0bc7bda9ba None admin] RBAC: Adding query filter params (name=compute) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:55.941930 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21932350-9bd9-4d6d-9000-bd0bc7bda9ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:55.943583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21932350-9bd9-4d6d-9000-bd0bc7bda9ba None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:55.955052 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 512/1018] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 13 01:06:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:55.956961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4637b0e-8beb-4917-8c2b-f3a05c6ae640 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:56.028231 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:56.068054 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4637b0e-8beb-4917-8c2b-f3a05c6ae640 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:56.106901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f8fb1-267e-49cc-b028-30bcdc774cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:56.107563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f8fb1-267e-49cc-b028-30bcdc774cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:56.107847 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f8fb1-267e-49cc-b028-30bcdc774cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:56.108129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f8fb1-267e-49cc-b028-30bcdc774cc1 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:56.108768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f8fb1-267e-49cc-b028-30bcdc774cc1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:56.109076 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f8fb1-267e-49cc-b028-30bcdc774cc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:56.110449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f8fb1-267e-49cc-b028-30bcdc774cc1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:56.115926 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 507/1019] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 13 01:06:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:56.121245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21932350-9bd9-4d6d-9000-bd0bc7bda9ba None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:56.153137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:56.227529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21932350-9bd9-4d6d-9000-bd0bc7bda9ba None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:56.261304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c87c72-77f6-4212-830f-33a54778a36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:56.261904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c87c72-77f6-4212-830f-33a54778a36f None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:56.262177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c87c72-77f6-4212-830f-33a54778a36f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:56.262441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c87c72-77f6-4212-830f-33a54778a36f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:56.263126 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c87c72-77f6-4212-830f-33a54778a36f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:56.264499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c87c72-77f6-4212-830f-33a54778a36f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:56.291094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 513/1020] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:06:56 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:06:57.883783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617f12a-218b-4dd4-b360-46d87a9a3fe9 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:57.884339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617f12a-218b-4dd4-b360-46d87a9a3fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:57.884339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617f12a-218b-4dd4-b360-46d87a9a3fe9 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:57.885696 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 508/1021] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:57.890861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37c346-a202-4706-9be9-c7abf980f4fb None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:57.891263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37c346-a202-4706-9be9-c7abf980f4fb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:57.891438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37c346-a202-4706-9be9-c7abf980f4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:57.910001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8c37c346-a202-4706-9be9-c7abf980f4fb None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:57.911195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8c37c346-a202-4706-9be9-c7abf980f4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:57.986273 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 514/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:58.133930 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8e2b8-1d82-4706-8e17-fe181dbaf71f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:58.134121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8e2b8-1d82-4706-8e17-fe181dbaf71f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:58.134399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8e2b8-1d82-4706-8e17-fe181dbaf71f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:58.135920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 509/1023] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:06:58.140885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfd331-325b-43f2-bad4-68f43b0ad075 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:58.141178 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfd331-325b-43f2-bad4-68f43b0ad075 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:58.141456 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfd331-325b-43f2-bad4-68f43b0ad075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:58.160797 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-d7dfd331-325b-43f2-bad4-68f43b0ad075 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:58.161984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d7dfd331-325b-43f2-bad4-68f43b0ad075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:58.164151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:58.233678 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 515/1024] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:06:58.262140 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8e2b8-1d82-4706-8e17-fe181dbaf71f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:58.367502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8e2b8-1d82-4706-8e17-fe181dbaf71f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:58.397141 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:58.403135 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102b3f3-e7be-44e8-b898-de26489d70f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:58.403759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102b3f3-e7be-44e8-b898-de26489d70f4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:58.404034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102b3f3-e7be-44e8-b898-de26489d70f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:58.404303 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102b3f3-e7be-44e8-b898-de26489d70f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:58.405403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102b3f3-e7be-44e8-b898-de26489d70f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:58.406819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102b3f3-e7be-44e8-b898-de26489d70f4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:58.411108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 510/1025] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:06:58.415729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfd331-325b-43f2-bad4-68f43b0ad075 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:58.508405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102b3f3-e7be-44e8-b898-de26489d70f4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:58.525206 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfd331-325b-43f2-bad4-68f43b0ad075 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:58.562133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741000a5-9971-4a56-b6c4-7936b5a65a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:58.562746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741000a5-9971-4a56-b6c4-7936b5a65a6d None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:58.563025 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741000a5-9971-4a56-b6c4-7936b5a65a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:58.563328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741000a5-9971-4a56-b6c4-7936b5a65a6d None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:58.564273 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741000a5-9971-4a56-b6c4-7936b5a65a6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:58.565765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741000a5-9971-4a56-b6c4-7936b5a65a6d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:58.576654 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:58.588836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 516/1026] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:06:58 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:06:58.589965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953de9e-8105-4acb-888c-4db03cf1bfb6 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:58.590258 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953de9e-8105-4acb-888c-4db03cf1bfb6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:58.590538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953de9e-8105-4acb-888c-4db03cf1bfb6 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:58.592129 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 517/1027] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:06:58.598364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518093a-4ba3-4875-b28c-004ca8face3b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:58.598655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518093a-4ba3-4875-b28c-004ca8face3b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:58.598933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518093a-4ba3-4875-b28c-004ca8face3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:58.618846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5518093a-4ba3-4875-b28c-004ca8face3b None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:06:58.620434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5518093a-4ba3-4875-b28c-004ca8face3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:06:58.620648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102b3f3-e7be-44e8-b898-de26489d70f4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:58.663218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bba90-1440-4b28-b95a-6c7941cd16f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:58.663788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bba90-1440-4b28-b95a-6c7941cd16f5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:58.664069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bba90-1440-4b28-b95a-6c7941cd16f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:58.664344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bba90-1440-4b28-b95a-6c7941cd16f5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:58.664947 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bba90-1440-4b28-b95a-6c7941cd16f5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:58.666347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bba90-1440-4b28-b95a-6c7941cd16f5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-9b1bba90-1440-4b28-b95a-6c7941cd16f5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:58.676843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:58.677973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:58.678916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:58.678916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:58.678916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:58.678916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:58.678916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:58.678916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:58.678916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:58.678916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:58.678916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:58.678916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:58.678916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:06:58.678916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:06:58.678916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 01:06:58.678916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:58.678916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 511/1028] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Sep 13 01:06:58 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:58.684384 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bba90-1440-4b28-b95a-6c7941cd16f5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:58.707111 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 518/1029] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:06:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:06:58.760486 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:58.804797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bba90-1440-4b28-b95a-6c7941cd16f5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:58.840385 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822dbae-6881-4a50-ada1-1f778a2b6adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:58.841388 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822dbae-6881-4a50-ada1-1f778a2b6adf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:58.841822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822dbae-6881-4a50-ada1-1f778a2b6adf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:58.842252 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822dbae-6881-4a50-ada1-1f778a2b6adf None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:58.842890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822dbae-6881-4a50-ada1-1f778a2b6adf None admin] RBAC: Adding query filter params (name=image) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:58.843241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822dbae-6881-4a50-ada1-1f778a2b6adf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:58.844636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822dbae-6881-4a50-ada1-1f778a2b6adf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:58.850189 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 512/1030] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:58.856195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518093a-4ba3-4875-b28c-004ca8face3b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:58.956724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518093a-4ba3-4875-b28c-004ca8face3b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:58.980153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822dbae-6881-4a50-ada1-1f778a2b6adf None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:58.980681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:58.994374 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d184a-db90-4d54-ac17-0e0457a6d600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:58.994982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d184a-db90-4d54-ac17-0e0457a6d600 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:58.995285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d184a-db90-4d54-ac17-0e0457a6d600 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:58.995555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d184a-db90-4d54-ac17-0e0457a6d600 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:58.996204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d184a-db90-4d54-ac17-0e0457a6d600 None admin] RBAC: Adding query filter params (type=image) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:58.996475 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d184a-db90-4d54-ac17-0e0457a6d600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:58.997916 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d184a-db90-4d54-ac17-0e0457a6d600 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:59.003089 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 519/1031] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:59.008647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d184a-db90-4d54-ac17-0e0457a6d600 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:59.091200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822dbae-6881-4a50-ada1-1f778a2b6adf None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:59.115998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d184a-db90-4d54-ac17-0e0457a6d600 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:59.121891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:59.131282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06613fde-c48b-4d04-a440-dddf4d1113ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:59.131902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06613fde-c48b-4d04-a440-dddf4d1113ef None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:59.132242 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06613fde-c48b-4d04-a440-dddf4d1113ef None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:59.132776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06613fde-c48b-4d04-a440-dddf4d1113ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:59.143104 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06613fde-c48b-4d04-a440-dddf4d1113ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-06613fde-c48b-4d04-a440-dddf4d1113ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:06:59.148057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:59.149188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:59.150247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:59.150247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:59.150247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:59.150247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:59.150247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:06:59.150247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:06:59.150247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:06:59.150247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:06:59.150247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:06:59.150247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:06:59.150247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 01:06:59.150247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:06:59.151360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 513/1032] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Sep 13 01:06:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:59.155789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77180a35-2a8d-424c-a871-ab2644edb2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:59.156418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77180a35-2a8d-424c-a871-ab2644edb2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:59.156526 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06613fde-c48b-4d04-a440-dddf4d1113ef None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:59.156690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77180a35-2a8d-424c-a871-ab2644edb2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:59.156958 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77180a35-2a8d-424c-a871-ab2644edb2f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:59.158184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77180a35-2a8d-424c-a871-ab2644edb2f7 None admin] RBAC: Adding query filter params (interface=public, service_id=4cb25df5c7664a588c6958c5fdf23638, region_id=RegionOne) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:59.158485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77180a35-2a8d-424c-a871-ab2644edb2f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:59.159865 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77180a35-2a8d-424c-a871-ab2644edb2f7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:59.167026 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 520/1033] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 13 01:06:59 2022] GET /identity/v3/endpoints?service_id=4cb25df5c7664a588c6958c5fdf23638&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:59.172532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77180a35-2a8d-424c-a871-ab2644edb2f7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:59.228879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:59.274870 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06613fde-c48b-4d04-a440-dddf4d1113ef None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:59.277096 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77180a35-2a8d-424c-a871-ab2644edb2f7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:59.310632 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5f4cb-405d-407e-b183-d682dc4d311c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:59.311419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5f4cb-405d-407e-b183-d682dc4d311c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:59.311922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5f4cb-405d-407e-b183-d682dc4d311c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:59.312299 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5f4cb-405d-407e-b183-d682dc4d311c None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:59.312996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5f4cb-405d-407e-b183-d682dc4d311c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:59.313357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1647fdd-8872-43f5-bb45-25683ae8e98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:59.314718 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1647fdd-8872-43f5-bb45-25683ae8e98b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:59.315168 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1647fdd-8872-43f5-bb45-25683ae8e98b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:59.315443 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1647fdd-8872-43f5-bb45-25683ae8e98b None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:59.315533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5f4cb-405d-407e-b183-d682dc4d311c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:59.316103 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1647fdd-8872-43f5-bb45-25683ae8e98b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:59.316403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1647fdd-8872-43f5-bb45-25683ae8e98b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:59.317750 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1647fdd-8872-43f5-bb45-25683ae8e98b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:59.322704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 521/1034] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 13 01:06:59 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:06:59.340270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 514/1035] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 13 01:06:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:59.341668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5f4cb-405d-407e-b183-d682dc4d311c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:59.461651 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5f4cb-405d-407e-b183-d682dc4d311c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:59.481121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:59.502546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2e5d8-c8ac-492e-a829-d89cb2e8645b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:59.503396 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2e5d8-c8ac-492e-a829-d89cb2e8645b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:59.503736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2e5d8-c8ac-492e-a829-d89cb2e8645b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:59.504076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2e5d8-c8ac-492e-a829-d89cb2e8645b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:59.515278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2e5d8-c8ac-492e-a829-d89cb2e8645b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:59.516769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2e5d8-c8ac-492e-a829-d89cb2e8645b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-36b2e5d8-c8ac-492e-a829-d89cb2e8645b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:06:59.533801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:59.534838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:06:59.535774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:06:59.535774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:06:59.535774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:59.535774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 522/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:06:59.540740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1647fdd-8872-43f5-bb45-25683ae8e98b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:59.594031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:06:59.646341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1647fdd-8872-43f5-bb45-25683ae8e98b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:59.679776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055c14a-b04c-4c5e-b93a-4f234d086eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:59.680382 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055c14a-b04c-4c5e-b93a-4f234d086eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:59.680658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055c14a-b04c-4c5e-b93a-4f234d086eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:59.680926 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055c14a-b04c-4c5e-b93a-4f234d086eb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:59.681560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055c14a-b04c-4c5e-b93a-4f234d086eb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:06:59.681865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055c14a-b04c-4c5e-b93a-4f234d086eb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:59.683253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055c14a-b04c-4c5e-b93a-4f234d086eb3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:59.700365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 515/1037] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:06:59.701557 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2e5d8-c8ac-492e-a829-d89cb2e8645b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:59.802601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2e5d8-c8ac-492e-a829-d89cb2e8645b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:59.836562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c95e63-c480-44b4-b5fc-233cca78a0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:06:59.837182 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c95e63-c480-44b4-b5fc-233cca78a0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:06:59.837465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c95e63-c480-44b4-b5fc-233cca78a0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:06:59.837739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c95e63-c480-44b4-b5fc-233cca78a0d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:06:59.846021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c95e63-c480-44b4-b5fc-233cca78a0d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:06:59.847489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c95e63-c480-44b4-b5fc-233cca78a0d4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-28c95e63-c480-44b4-b5fc-233cca78a0d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:06:59.858583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:06:59.859581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:06:59.864300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:06:59.864300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:06:59.864300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:06:59.864300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:06:59.864300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:06:59.864300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:06:59.864300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:06:59.864300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:06:59.864300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:06:59.864300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:06:59.864300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 523/1038] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 13 01:06:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:06:59.868121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055c14a-b04c-4c5e-b93a-4f234d086eb3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:06:59.969628 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055c14a-b04c-4c5e-b93a-4f234d086eb3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:06:59.981136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:00.007313 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8327a-e337-432a-b868-51b301e8488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:00.008013 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8327a-e337-432a-b868-51b301e8488d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:00.008363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8327a-e337-432a-b868-51b301e8488d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:00.008780 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8327a-e337-432a-b868-51b301e8488d None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:00.009583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8327a-e337-432a-b868-51b301e8488d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:00.009989 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8327a-e337-432a-b868-51b301e8488d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:00.011591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8327a-e337-432a-b868-51b301e8488d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:00.034053 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 516/1039] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 13 01:06:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:00.035735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c95e63-c480-44b4-b5fc-233cca78a0d4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:00.066148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:00.140358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c95e63-c480-44b4-b5fc-233cca78a0d4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:00.174303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f219a24-a594-4be8-b136-13320a7c02a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:00.174911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f219a24-a594-4be8-b136-13320a7c02a5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:00.175236 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f219a24-a594-4be8-b136-13320a7c02a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:00.175514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f219a24-a594-4be8-b136-13320a7c02a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:00.246810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f219a24-a594-4be8-b136-13320a7c02a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:00.248461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f219a24-a594-4be8-b136-13320a7c02a5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:00.276053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:00.354365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 524/1040] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:07:00 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 01:07:00.355543 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8327a-e337-432a-b868-51b301e8488d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:00.465876 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8327a-e337-432a-b868-51b301e8488d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:00.499844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e62ef-1ac1-4c48-a1aa-d8977b1d913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:00.500479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e62ef-1ac1-4c48-a1aa-d8977b1d913a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:00.500759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e62ef-1ac1-4c48-a1aa-d8977b1d913a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:00.501621 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e62ef-1ac1-4c48-a1aa-d8977b1d913a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:00.511875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e62ef-1ac1-4c48-a1aa-d8977b1d913a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:00.513424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e62ef-1ac1-4c48-a1aa-d8977b1d913a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-504e62ef-1ac1-4c48-a1aa-d8977b1d913a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:07:00.528478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:00.529447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:07:00.531006 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:07:00.531006 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:07:00.531006 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:00.531006 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 517/1041] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:07:00.535680 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f219a24-a594-4be8-b136-13320a7c02a5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:00.638643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f219a24-a594-4be8-b136-13320a7c02a5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:00.665762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:00.675235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ad110-b8ff-48b5-8043-7d59a1865e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:00.675843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ad110-b8ff-48b5-8043-7d59a1865e1f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:00.676115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ad110-b8ff-48b5-8043-7d59a1865e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:00.676380 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ad110-b8ff-48b5-8043-7d59a1865e1f None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:00.677008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ad110-b8ff-48b5-8043-7d59a1865e1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:00.677306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ad110-b8ff-48b5-8043-7d59a1865e1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:00.678665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ad110-b8ff-48b5-8043-7d59a1865e1f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:00.695941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 525/1042] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:00.697080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e62ef-1ac1-4c48-a1aa-d8977b1d913a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:00.720468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:00.805270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e62ef-1ac1-4c48-a1aa-d8977b1d913a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:00.838783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9adb3-8812-4736-af5a-6150b9cf5693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:00.839436 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9adb3-8812-4736-af5a-6150b9cf5693 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:00.839712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9adb3-8812-4736-af5a-6150b9cf5693 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:00.839982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9adb3-8812-4736-af5a-6150b9cf5693 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:00.847300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9adb3-8812-4736-af5a-6150b9cf5693 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:00.848730 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9adb3-8812-4736-af5a-6150b9cf5693 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:00.859731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-9ac9adb3-8812-4736-af5a-6150b9cf5693 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:07:00.859731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:00.859731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:00.859731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:00.859731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:00.859731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:00.859731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:00.859731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:00.859731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:00.859731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:00.859731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:00.859731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:00.859731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:07:00.859731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:07:00.859731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:00.860860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:00.861800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:07:00.861800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:07:00.861800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:07:00.861800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:07:00.861800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:07:00.861800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:07:00.861800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:07:00.861800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:00.861800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 518/1043] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:07:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:07:00.866109 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c526c-f56b-40f0-8f7b-f428b5a1c2d5 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:00.866389 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c526c-f56b-40f0-8f7b-f428b5a1c2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:00.866660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c526c-f56b-40f0-8f7b-f428b5a1c2d5 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:00.867873 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9adb3-8812-4736-af5a-6150b9cf5693 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:00.868346 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 526/1044] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:07:00.873114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536918f2-e048-4eb1-92ba-14da7df769b4 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:00.873400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536918f2-e048-4eb1-92ba-14da7df769b4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:00.873673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536918f2-e048-4eb1-92ba-14da7df769b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:00.892182 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-536918f2-e048-4eb1-92ba-14da7df769b4 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:00.893285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-536918f2-e048-4eb1-92ba-14da7df769b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:00.964406 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:00.971110 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 527/1045] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:07:00.990410 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9adb3-8812-4736-af5a-6150b9cf5693 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:01.024612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853414f1-44c7-411c-8caf-af10bfd7d85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:01.025213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853414f1-44c7-411c-8caf-af10bfd7d85e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:01.025486 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853414f1-44c7-411c-8caf-af10bfd7d85e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:01.025753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853414f1-44c7-411c-8caf-af10bfd7d85e None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:01.026439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853414f1-44c7-411c-8caf-af10bfd7d85e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:01.026740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853414f1-44c7-411c-8caf-af10bfd7d85e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:01.028187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853414f1-44c7-411c-8caf-af10bfd7d85e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:01.041153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 519/1046] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:07:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:01.048701 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536918f2-e048-4eb1-92ba-14da7df769b4 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:01.154653 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536918f2-e048-4eb1-92ba-14da7df769b4 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:01.172374 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:01.192100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6db291-1892-429b-94ef-1f8f52eeffce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:01.192706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6db291-1892-429b-94ef-1f8f52eeffce None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:01.192986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6db291-1892-429b-94ef-1f8f52eeffce None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:01.193260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6db291-1892-429b-94ef-1f8f52eeffce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:01.193993 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6db291-1892-429b-94ef-1f8f52eeffce None admin] RBAC: Adding query filter params (role.id=063ead59de26487aade9d571bde678c5, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=fadc83bec6be41979e1aa4d71f8fc2bd) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:01.194303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6db291-1892-429b-94ef-1f8f52eeffce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:01.195768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6db291-1892-429b-94ef-1f8f52eeffce None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:01.206563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 528/1047] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:07:01 2022] GET /identity/v3/role_assignments?user.id=fadc83bec6be41979e1aa4d71f8fc2bd&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=063ead59de26487aade9d571bde678c5 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:01.246855 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853414f1-44c7-411c-8caf-af10bfd7d85e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:01.355605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853414f1-44c7-411c-8caf-af10bfd7d85e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:01.391982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e45bf-71de-4fa0-bf18-8023a64815de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:01.392866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e45bf-71de-4fa0-bf18-8023a64815de None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:01.393145 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e45bf-71de-4fa0-bf18-8023a64815de None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:01.393414 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e45bf-71de-4fa0-bf18-8023a64815de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:01.402286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:01.407020 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e45bf-71de-4fa0-bf18-8023a64815de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-2c6e45bf-71de-4fa0-bf18-8023a64815de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:07:01.412551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:01.413592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:01.414480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:01.414480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:01.414480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:01.414480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:01.414480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:07:01.414480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:07:01.414480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:07:01.414480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:07:01.414480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:07:01.414480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:07:01.414480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:01.414480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:01.420795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 520/1048] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:07:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:07:01.422016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6db291-1892-429b-94ef-1f8f52eeffce None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:01.533087 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f767d9-a618-4d3c-8759-d620e45dabf2 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:01.533438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f767d9-a618-4d3c-8759-d620e45dabf2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:01.533774 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f767d9-a618-4d3c-8759-d620e45dabf2 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:01.534783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6db291-1892-429b-94ef-1f8f52eeffce None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:01.538857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 521/1049] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:07:01.540350 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db87581-26a7-47a6-a18e-ccb7f44114c6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:01.540637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db87581-26a7-47a6-a18e-ccb7f44114c6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:01.540912 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db87581-26a7-47a6-a18e-ccb7f44114c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:01.559712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2db87581-26a7-47a6-a18e-ccb7f44114c6 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:01.560903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2db87581-26a7-47a6-a18e-ccb7f44114c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:01.571936 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629db47-310b-48ce-b613-79d55502db14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:01.572877 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629db47-310b-48ce-b613-79d55502db14 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:01.573168 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629db47-310b-48ce-b613-79d55502db14 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:01.573742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629db47-310b-48ce-b613-79d55502db14 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:01.574415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629db47-310b-48ce-b613-79d55502db14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:01.574725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629db47-310b-48ce-b613-79d55502db14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:01.576940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629db47-310b-48ce-b613-79d55502db14 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:01.587002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 529/1050] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:07:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:01.593368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629db47-310b-48ce-b613-79d55502db14 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:01.638227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 522/1051] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:07:01.644088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:01.707950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629db47-310b-48ce-b613-79d55502db14 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:01.743376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153c8ca-9cd8-4e56-bd05-ba69f663b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:01.744004 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153c8ca-9cd8-4e56-bd05-ba69f663b86d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:01.744278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153c8ca-9cd8-4e56-bd05-ba69f663b86d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:01.744547 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153c8ca-9cd8-4e56-bd05-ba69f663b86d None admin] PATH_INFO: `/v3/users/d7f03f36562a4add9e7203f9961cb45d` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:01.758278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153c8ca-9cd8-4e56-bd05-ba69f663b86d None admin] RBAC: Authorizing `identity:get_user(user_id=d7f03f36562a4add9e7203f9961cb45d)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:01.759748 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153c8ca-9cd8-4e56-bd05-ba69f663b86d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:01.766041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 530/1052] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:07:01 2022] GET /identity/v3/users/d7f03f36562a4add9e7203f9961cb45d => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:07:01.767712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db87581-26a7-47a6-a18e-ccb7f44114c6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:01.867474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db87581-26a7-47a6-a18e-ccb7f44114c6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:01.896227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:01.902723 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36954d3f-b261-49f7-94e9-a46299f3a520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:01.903361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36954d3f-b261-49f7-94e9-a46299f3a520 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:01.903638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36954d3f-b261-49f7-94e9-a46299f3a520 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:01.903906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36954d3f-b261-49f7-94e9-a46299f3a520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:01.915396 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153c8ca-9cd8-4e56-bd05-ba69f663b86d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:01.980576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36954d3f-b261-49f7-94e9-a46299f3a520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:01.981967 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36954d3f-b261-49f7-94e9-a46299f3a520 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:02.020759 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153c8ca-9cd8-4e56-bd05-ba69f663b86d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:02.022269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:02.056530 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6575fd-286f-4544-adae-02d95e9a1470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:02.057271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6575fd-286f-4544-adae-02d95e9a1470 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:02.057558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6575fd-286f-4544-adae-02d95e9a1470 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:02.057829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6575fd-286f-4544-adae-02d95e9a1470 None admin] PATH_INFO: `/v3/services/image` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:02.058408 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6575fd-286f-4544-adae-02d95e9a1470 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:02.059800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6575fd-286f-4544-adae-02d95e9a1470 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-4d6575fd-286f-4544-adae-02d95e9a1470 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:02.069212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:02.070255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:02.071191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:02.071191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:02.071191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:02.071191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:02.071191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:02.071191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:02.071191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:02.071191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:02.071191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:02.071191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:02.071191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:07:02.071191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:07:02.071191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 01:07:02.071191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:07:02.071191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 531/1053] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Sep 13 01:07:01 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:07:02.076300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6575fd-286f-4544-adae-02d95e9a1470 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:02.096869 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 523/1054] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:07:01 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 01:07:02.102571 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36954d3f-b261-49f7-94e9-a46299f3a520 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:02.134562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:02.190268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6575fd-286f-4544-adae-02d95e9a1470 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:02.210348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36954d3f-b261-49f7-94e9-a46299f3a520 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:02.225232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14550ccf-7b72-40b0-b0e7-f583d99469e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:02.225843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14550ccf-7b72-40b0-b0e7-f583d99469e6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:02.226128 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14550ccf-7b72-40b0-b0e7-f583d99469e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:02.226408 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14550ccf-7b72-40b0-b0e7-f583d99469e6 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:02.227039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14550ccf-7b72-40b0-b0e7-f583d99469e6 None admin] RBAC: Adding query filter params (name=image) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:02.227374 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14550ccf-7b72-40b0-b0e7-f583d99469e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:02.228752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14550ccf-7b72-40b0-b0e7-f583d99469e6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:02.238814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 532/1055] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:07:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:07:02.239784 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14550ccf-7b72-40b0-b0e7-f583d99469e6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:02.247383 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00237ffa-90dc-44e0-8a0c-5ba97988687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:02.248014 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00237ffa-90dc-44e0-8a0c-5ba97988687d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:02.248292 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00237ffa-90dc-44e0-8a0c-5ba97988687d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:02.248563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00237ffa-90dc-44e0-8a0c-5ba97988687d None admin] PATH_INFO: `/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:02.249667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00237ffa-90dc-44e0-8a0c-5ba97988687d None admin] RBAC: Authorizing `identity:get_project(project_id=e1c0ccd8f95d4c55a7d3d6610aa19e81)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:02.251187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00237ffa-90dc-44e0-8a0c-5ba97988687d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:02.257664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 524/1056] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:07:02 2022] GET /identity/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:02.258676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00237ffa-90dc-44e0-8a0c-5ba97988687d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:02.276373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:02.348226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14550ccf-7b72-40b0-b0e7-f583d99469e6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:02.365568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:02.370228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00237ffa-90dc-44e0-8a0c-5ba97988687d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:02.383935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e8f7d-2e55-4a81-adf8-55d262ed8123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:02.384548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e8f7d-2e55-4a81-adf8-55d262ed8123 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:02.384827 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e8f7d-2e55-4a81-adf8-55d262ed8123 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:02.385106 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e8f7d-2e55-4a81-adf8-55d262ed8123 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:02.385721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e8f7d-2e55-4a81-adf8-55d262ed8123 None admin] RBAC: Adding query filter params (type=image) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:02.386216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e8f7d-2e55-4a81-adf8-55d262ed8123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:02.387434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e8f7d-2e55-4a81-adf8-55d262ed8123 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:02.397529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 533/1057] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:07:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:02.398466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e8f7d-2e55-4a81-adf8-55d262ed8123 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:02.417401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a112be7-8ac4-4d34-a62e-1ce07733071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:02.417401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a112be7-8ac4-4d34-a62e-1ce07733071a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:02.417401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a112be7-8ac4-4d34-a62e-1ce07733071a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:02.417401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a112be7-8ac4-4d34-a62e-1ce07733071a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:02.417854 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a112be7-8ac4-4d34-a62e-1ce07733071a None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=e1c0ccd8f95d4c55a7d3d6610aa19e81, user.id=d7f03f36562a4add9e7203f9961cb45d) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:02.417854 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a112be7-8ac4-4d34-a62e-1ce07733071a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:02.419352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a112be7-8ac4-4d34-a62e-1ce07733071a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:02.428554 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 525/1058] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:07:02 2022] GET /identity/v3/role_assignments?user.id=d7f03f36562a4add9e7203f9961cb45d&scope.project.id=e1c0ccd8f95d4c55a7d3d6610aa19e81&role.id=3799feb4caa64e568971222375957f54 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:07:02.522331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:02.530811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e8f7d-2e55-4a81-adf8-55d262ed8123 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:02.568918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df920a-d095-4e54-8b5d-dec64becc7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:02.569550 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df920a-d095-4e54-8b5d-dec64becc7c5 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:02.569831 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df920a-d095-4e54-8b5d-dec64becc7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:02.570105 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df920a-d095-4e54-8b5d-dec64becc7c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:02.570795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df920a-d095-4e54-8b5d-dec64becc7c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:02.572249 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df920a-d095-4e54-8b5d-dec64becc7c5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:02.603093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 534/1059] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:07:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:07:03.384188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f85e4b-309c-4bd7-bd47-cb40be8c48d9 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:03.384822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f85e4b-309c-4bd7-bd47-cb40be8c48d9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:03.384822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f85e4b-309c-4bd7-bd47-cb40be8c48d9 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:03.386233 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 526/1060] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:03.391177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f62ba-b0ec-4fc9-bbe3-9b9060d61096 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:03.391582 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f62ba-b0ec-4fc9-bbe3-9b9060d61096 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:03.391787 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f62ba-b0ec-4fc9-bbe3-9b9060d61096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:03.410005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8f0f62ba-b0ec-4fc9-bbe3-9b9060d61096 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:03.411226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8f0f62ba-b0ec-4fc9-bbe3-9b9060d61096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:03.488059 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 535/1061] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:03.756210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f85e4b-309c-4bd7-bd47-cb40be8c48d9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:03.859521 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f85e4b-309c-4bd7-bd47-cb40be8c48d9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:03.894197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1966e0-689f-4053-9b4d-8c6326f8972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:03.894839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1966e0-689f-4053-9b4d-8c6326f8972e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:03.895130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1966e0-689f-4053-9b4d-8c6326f8972e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:03.895407 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1966e0-689f-4053-9b4d-8c6326f8972e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:03.905493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1966e0-689f-4053-9b4d-8c6326f8972e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-3e1966e0-689f-4053-9b4d-8c6326f8972e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:07:03.910348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:03.911619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:03.912588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:03.912588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:03.912588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:03.912588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:03.912588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:07:03.912588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:07:03.912588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:07:03.912588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:07:03.912588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:07:03.912588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:07:03.912588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 01:07:03.912588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:03.915402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 527/1062] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Sep 13 01:07:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:07:03.917471 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f62ba-b0ec-4fc9-bbe3-9b9060d61096 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:03.994150 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:04.019882 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f62ba-b0ec-4fc9-bbe3-9b9060d61096 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:04.054268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d966e45-ac82-420f-bcf5-ee5830618b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:04.054878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d966e45-ac82-420f-bcf5-ee5830618b9d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:04.055188 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d966e45-ac82-420f-bcf5-ee5830618b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:04.055464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d966e45-ac82-420f-bcf5-ee5830618b9d None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:04.056132 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d966e45-ac82-420f-bcf5-ee5830618b9d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:04.056433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d966e45-ac82-420f-bcf5-ee5830618b9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:04.057803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d966e45-ac82-420f-bcf5-ee5830618b9d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:04.066534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 536/1063] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 13 01:07:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:04.072059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1966e0-689f-4053-9b4d-8c6326f8972e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:04.098230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:04.177003 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1966e0-689f-4053-9b4d-8c6326f8972e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:04.211408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbeaf6-447e-4f3d-a6e4-b8b00252035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:04.212042 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbeaf6-447e-4f3d-a6e4-b8b00252035a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:04.212321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbeaf6-447e-4f3d-a6e4-b8b00252035a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:04.212595 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbeaf6-447e-4f3d-a6e4-b8b00252035a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:04.223437 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbeaf6-447e-4f3d-a6e4-b8b00252035a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:04.224884 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbeaf6-447e-4f3d-a6e4-b8b00252035a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f6fbeaf6-447e-4f3d-a6e4-b8b00252035a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:07:04.239474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:04.240482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:07:04.246263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:07:04.246263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:07:04.246263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:04.246263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 528/1064] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:07:04.248076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d966e45-ac82-420f-bcf5-ee5830618b9d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:04.351892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d966e45-ac82-420f-bcf5-ee5830618b9d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:04.385472 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95e5b0-905d-49ee-87f9-63337a42d278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:04.386085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95e5b0-905d-49ee-87f9-63337a42d278 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:04.386365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95e5b0-905d-49ee-87f9-63337a42d278 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:04.386639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95e5b0-905d-49ee-87f9-63337a42d278 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:04.387305 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95e5b0-905d-49ee-87f9-63337a42d278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:04.387611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95e5b0-905d-49ee-87f9-63337a42d278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:04.388975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95e5b0-905d-49ee-87f9-63337a42d278 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:04.396743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:04.407809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 537/1065] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:04.409147 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbeaf6-447e-4f3d-a6e4-b8b00252035a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:04.491816 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:04.521830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbeaf6-447e-4f3d-a6e4-b8b00252035a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:04.557001 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee37a8-e978-4fb8-b944-00a1a7f0a30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:04.557667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee37a8-e978-4fb8-b944-00a1a7f0a30c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:04.557944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee37a8-e978-4fb8-b944-00a1a7f0a30c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:04.558216 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee37a8-e978-4fb8-b944-00a1a7f0a30c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:04.567141 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee37a8-e978-4fb8-b944-00a1a7f0a30c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:04.568572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee37a8-e978-4fb8-b944-00a1a7f0a30c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-b5ee37a8-e978-4fb8-b944-00a1a7f0a30c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:07:04.580206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:04.581197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:04.582215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:04.582215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:04.582215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:07:04.582215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:07:04.582215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:07:04.582215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:07:04.582215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:07:04.582215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:07:04.582215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:07:04.582215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:04.586093 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 529/1066] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 13 01:07:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:07:04.587389 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95e5b0-905d-49ee-87f9-63337a42d278 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:04.631192 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356bc2a-a945-4014-94f3-36a71fa8d600 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:04.631377 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356bc2a-a945-4014-94f3-36a71fa8d600 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:04.631631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356bc2a-a945-4014-94f3-36a71fa8d600 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:04.633086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 530/1067] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:07:04.637666 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1135e30-d2f0-4ad4-8f83-ca1e1b637505 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:04.637939 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1135e30-d2f0-4ad4-8f83-ca1e1b637505 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:04.638218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1135e30-d2f0-4ad4-8f83-ca1e1b637505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:04.656211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c1135e30-d2f0-4ad4-8f83-ca1e1b637505 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:04.657541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c1135e30-d2f0-4ad4-8f83-ca1e1b637505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:04.696071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95e5b0-905d-49ee-87f9-63337a42d278 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:04.732929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde07deb-39fa-4e89-b01c-d44f631bfc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:04.733642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde07deb-39fa-4e89-b01c-d44f631bfc97 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:04.733991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde07deb-39fa-4e89-b01c-d44f631bfc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:04.734336 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde07deb-39fa-4e89-b01c-d44f631bfc97 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:04.735222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde07deb-39fa-4e89-b01c-d44f631bfc97 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:04.736259 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde07deb-39fa-4e89-b01c-d44f631bfc97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:04.737751 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde07deb-39fa-4e89-b01c-d44f631bfc97 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:04.743422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 531/1068] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:07:04.759116 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 538/1069] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 13 01:07:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:04.762387 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1135e30-d2f0-4ad4-8f83-ca1e1b637505 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:04.792019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c57598-a2f8-47cc-930c-19af2543bffb None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:04.792421 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c57598-a2f8-47cc-930c-19af2543bffb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:04.792710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c57598-a2f8-47cc-930c-19af2543bffb None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:04.794084 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 539/1070] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:07:04.801217 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06848-ea09-45ff-a0b6-36508bcc5e2c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:04.801499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06848-ea09-45ff-a0b6-36508bcc5e2c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:04.801773 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06848-ea09-45ff-a0b6-36508bcc5e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:04.820262 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-cab06848-ea09-45ff-a0b6-36508bcc5e2c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:04.821457 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-cab06848-ea09-45ff-a0b6-36508bcc5e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:04.828865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:04.873762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:04.879538 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1135e30-d2f0-4ad4-8f83-ca1e1b637505 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:04.895184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 540/1071] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:07:04.918973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca6c5f-e65a-4f82-ac4d-4a9fbfa3df24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:04.919724 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca6c5f-e65a-4f82-ac4d-4a9fbfa3df24 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:04.920072 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca6c5f-e65a-4f82-ac4d-4a9fbfa3df24 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:04.920438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca6c5f-e65a-4f82-ac4d-4a9fbfa3df24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:04.931682 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca6c5f-e65a-4f82-ac4d-4a9fbfa3df24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:04.933130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca6c5f-e65a-4f82-ac4d-4a9fbfa3df24 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-91ca6c5f-e65a-4f82-ac4d-4a9fbfa3df24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:07:04.948329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:04.949276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:07:04.955613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:07:04.955613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:07:04.955613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:04.955613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 532/1072] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:07:04.957136 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab06848-ea09-45ff-a0b6-36508bcc5e2c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:05.007973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca6c5f-e65a-4f82-ac4d-4a9fbfa3df24 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:05.066149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab06848-ea09-45ff-a0b6-36508bcc5e2c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:05.113559 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5d7e-ce27-4159-987c-f3e62b33c189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:05.114160 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5d7e-ce27-4159-987c-f3e62b33c189 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:05.114596 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5d7e-ce27-4159-987c-f3e62b33c189 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:05.114707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5d7e-ce27-4159-987c-f3e62b33c189 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:05.115368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5d7e-ce27-4159-987c-f3e62b33c189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:05.115683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5d7e-ce27-4159-987c-f3e62b33c189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:05.117042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5d7e-ce27-4159-987c-f3e62b33c189 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:05.117441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca6c5f-e65a-4f82-ac4d-4a9fbfa3df24 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:05.128902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 541/1073] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:05.134433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5d7e-ce27-4159-987c-f3e62b33c189 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:05.136405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:05.155805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5514a-bd47-47f7-a610-a8dfec98e672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:05.156350 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5514a-bd47-47f7-a610-a8dfec98e672 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:05.156626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5514a-bd47-47f7-a610-a8dfec98e672 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:05.156893 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5514a-bd47-47f7-a610-a8dfec98e672 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:05.167774 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5514a-bd47-47f7-a610-a8dfec98e672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-9ed5514a-bd47-47f7-a610-a8dfec98e672 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:07:05.172506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:05.173702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:05.174657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:05.174657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:05.174657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:05.174657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:05.174657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:07:05.174657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:07:05.174657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:07:05.174657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:07:05.174657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:07:05.174657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:07:05.174657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:05.174657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:05.174657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 533/1074] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:07:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:07:05.175454 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5514a-bd47-47f7-a610-a8dfec98e672 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:05.183879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:05.238604 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5d7e-ce27-4159-987c-f3e62b33c189 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:05.272911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929343d-6e8d-4445-9212-1504a7c4863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:05.273537 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929343d-6e8d-4445-9212-1504a7c4863c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:05.273638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5514a-bd47-47f7-a610-a8dfec98e672 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:05.273817 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929343d-6e8d-4445-9212-1504a7c4863c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:05.274088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929343d-6e8d-4445-9212-1504a7c4863c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:05.280745 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929343d-6e8d-4445-9212-1504a7c4863c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:05.282254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929343d-6e8d-4445-9212-1504a7c4863c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:05.293400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-d929343d-6e8d-4445-9212-1504a7c4863c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:07:05.293400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:05.293400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:05.293400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:05.293400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:05.293400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:05.293400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:05.293400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:05.293400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:05.293400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:05.293400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:05.293400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:05.293400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:07:05.293400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:07:05.293400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:05.294496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:05.295574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:07:05.295574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:07:05.295574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:07:05.295574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:07:05.295574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:07:05.295574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:07:05.295574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:07:05.295574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:07:05.295574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 542/1075] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:07:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:07:05.295574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929343d-6e8d-4445-9212-1504a7c4863c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:05.308549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24521491-2dc1-439b-8c1d-ea2ddfc2a90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:05.309150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24521491-2dc1-439b-8c1d-ea2ddfc2a90c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:05.309426 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24521491-2dc1-439b-8c1d-ea2ddfc2a90c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:05.309694 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24521491-2dc1-439b-8c1d-ea2ddfc2a90c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:05.352574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:05.375485 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24521491-2dc1-439b-8c1d-ea2ddfc2a90c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:05.377495 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24521491-2dc1-439b-8c1d-ea2ddfc2a90c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:05.394500 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929343d-6e8d-4445-9212-1504a7c4863c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:05.401641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:05.430023 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56147a36-3662-44f5-835a-ff87073d8f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:05.430628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56147a36-3662-44f5-835a-ff87073d8f5e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:05.430907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56147a36-3662-44f5-835a-ff87073d8f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:05.431273 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56147a36-3662-44f5-835a-ff87073d8f5e None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:05.431918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56147a36-3662-44f5-835a-ff87073d8f5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:05.432223 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56147a36-3662-44f5-835a-ff87073d8f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:05.433594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56147a36-3662-44f5-835a-ff87073d8f5e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:05.442918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 543/1076] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:07:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:05.443734 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56147a36-3662-44f5-835a-ff87073d8f5e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:05.477678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 534/1077] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:07:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 01:07:05.478525 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24521491-2dc1-439b-8c1d-ea2ddfc2a90c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:05.545258 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56147a36-3662-44f5-835a-ff87073d8f5e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:05.556956 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:05.580283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15140b-d38a-4246-8673-4c98b0ed87e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:05.580893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15140b-d38a-4246-8673-4c98b0ed87e4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:05.581171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15140b-d38a-4246-8673-4c98b0ed87e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:05.581445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15140b-d38a-4246-8673-4c98b0ed87e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:05.581715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24521491-2dc1-439b-8c1d-ea2ddfc2a90c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:05.582126 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15140b-d38a-4246-8673-4c98b0ed87e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:05.582429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15140b-d38a-4246-8673-4c98b0ed87e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:05.583900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15140b-d38a-4246-8673-4c98b0ed87e4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:05.595880 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 544/1078] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:07:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:05.596795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15140b-d38a-4246-8673-4c98b0ed87e4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:05.620422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f11f85-8b6d-4610-8359-b35c8d61c811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:05.621041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f11f85-8b6d-4610-8359-b35c8d61c811 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:05.621319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f11f85-8b6d-4610-8359-b35c8d61c811 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:05.621587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f11f85-8b6d-4610-8359-b35c8d61c811 None admin] PATH_INFO: `/v3/users/d7f03f36562a4add9e7203f9961cb45d` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:05.622699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f11f85-8b6d-4610-8359-b35c8d61c811 None admin] RBAC: Authorizing `identity:get_user(user_id=d7f03f36562a4add9e7203f9961cb45d)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:05.624158 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f11f85-8b6d-4610-8359-b35c8d61c811 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:05.625712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 535/1079] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:07:05 2022] GET /identity/v3/users/d7f03f36562a4add9e7203f9961cb45d => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:05.626488 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f11f85-8b6d-4610-8359-b35c8d61c811 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:05.626940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:05.699033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15140b-d38a-4246-8673-4c98b0ed87e4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:05.728805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f11f85-8b6d-4610-8359-b35c8d61c811 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:05.732256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031e07a-cc50-4c88-be23-d2f4bcaa1826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:05.732887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031e07a-cc50-4c88-be23-d2f4bcaa1826 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:05.733164 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031e07a-cc50-4c88-be23-d2f4bcaa1826 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:05.733436 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031e07a-cc50-4c88-be23-d2f4bcaa1826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:05.743913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031e07a-cc50-4c88-be23-d2f4bcaa1826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:05.745347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031e07a-cc50-4c88-be23-d2f4bcaa1826 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-4031e07a-cc50-4c88-be23-d2f4bcaa1826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:07:05.760034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:05.761071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:07:05.761997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:07:05.761997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:07:05.761997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:07:05.761997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 545/1080] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:07:05.761997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031e07a-cc50-4c88-be23-d2f4bcaa1826 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:05.768684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee5657-f59b-4af9-88b3-2119c9cce5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:05.769348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee5657-f59b-4af9-88b3-2119c9cce5fe None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:05.769629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee5657-f59b-4af9-88b3-2119c9cce5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:05.769905 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee5657-f59b-4af9-88b3-2119c9cce5fe None admin] PATH_INFO: `/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/fadc83bec6be41979e1aa4d71f8fc2bd/roles/063ead59de26487aade9d571bde678c5` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:05.772075 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee5657-f59b-4af9-88b3-2119c9cce5fe None admin] RBAC: Authorizing `identity:create_grant(project_id=fe73ceb0a582452b9b636a701adafb6f, user_id=fadc83bec6be41979e1aa4d71f8fc2bd, role_id=063ead59de26487aade9d571bde678c5)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:05.773501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee5657-f59b-4af9-88b3-2119c9cce5fe None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:05.787281 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 536/1081] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:07:05 2022] PUT /identity/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/fadc83bec6be41979e1aa4d71f8fc2bd/roles/063ead59de26487aade9d571bde678c5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:07:05.792025 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee5657-f59b-4af9-88b3-2119c9cce5fe None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:05.796568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:05.868632 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:05.892534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031e07a-cc50-4c88-be23-d2f4bcaa1826 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:05.920180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee5657-f59b-4af9-88b3-2119c9cce5fe None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:05.931614 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9106258-c372-4c6f-9715-d5ed919cdb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:05.932257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9106258-c372-4c6f-9715-d5ed919cdb6a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:05.932532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9106258-c372-4c6f-9715-d5ed919cdb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:05.932811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9106258-c372-4c6f-9715-d5ed919cdb6a None admin] PATH_INFO: `/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:05.933979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9106258-c372-4c6f-9715-d5ed919cdb6a None admin] RBAC: Authorizing `identity:get_project(project_id=e1c0ccd8f95d4c55a7d3d6610aa19e81)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:05.935493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9106258-c372-4c6f-9715-d5ed919cdb6a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:05.937329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 546/1082] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:07:05 2022] GET /identity/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:05.944172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9106258-c372-4c6f-9715-d5ed919cdb6a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:05.966256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfc430-9a8e-491d-989f-839563b6663e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:05.967217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfc430-9a8e-491d-989f-839563b6663e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:05.967751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfc430-9a8e-491d-989f-839563b6663e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:05.968322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfc430-9a8e-491d-989f-839563b6663e None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:05.968986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfc430-9a8e-491d-989f-839563b6663e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:05.969296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfc430-9a8e-491d-989f-839563b6663e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:05.971365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfc430-9a8e-491d-989f-839563b6663e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:05.987832 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 537/1083] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:06.060287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9106258-c372-4c6f-9715-d5ed919cdb6a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:06.098765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302a5f8-b40f-44f1-b788-e118c6bfc399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:06.099472 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302a5f8-b40f-44f1-b788-e118c6bfc399 None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:06.099751 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302a5f8-b40f-44f1-b788-e118c6bfc399 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:06.100025 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302a5f8-b40f-44f1-b788-e118c6bfc399 None admin] PATH_INFO: `/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81/users/d7f03f36562a4add9e7203f9961cb45d/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:06.101971 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302a5f8-b40f-44f1-b788-e118c6bfc399 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1c0ccd8f95d4c55a7d3d6610aa19e81, user_id=d7f03f36562a4add9e7203f9961cb45d, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:06.103452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302a5f8-b40f-44f1-b788-e118c6bfc399 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:06.120345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 547/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:07:05 2022] PUT /identity/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81/users/d7f03f36562a4add9e7203f9961cb45d/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:07:07.956024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf13e1-950f-450a-ba66-8efb532cdb13 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:07.956608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf13e1-950f-450a-ba66-8efb532cdb13 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:07.956608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf13e1-950f-450a-ba66-8efb532cdb13 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:07.958050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 538/1085] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:07.963096 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88b390-1a6a-4bda-b04c-112fcef34cbe None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:07.963545 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88b390-1a6a-4bda-b04c-112fcef34cbe None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:07.963646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88b390-1a6a-4bda-b04c-112fcef34cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:07.981979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7a88b390-1a6a-4bda-b04c-112fcef34cbe None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:07.983173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7a88b390-1a6a-4bda-b04c-112fcef34cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:07.985126 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:08.051314 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 548/1086] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:07:08.263370 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726924b-acd6-4507-a459-fd9bce6d758a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:08.263563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726924b-acd6-4507-a459-fd9bce6d758a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:08.263832 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726924b-acd6-4507-a459-fd9bce6d758a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:08.265211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 539/1087] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:08.271095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d706d0-4dce-42e3-95d1-43d4d0af7626 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:08.271406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d706d0-4dce-42e3-95d1-43d4d0af7626 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:08.271682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d706d0-4dce-42e3-95d1-43d4d0af7626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:08.289510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-49d706d0-4dce-42e3-95d1-43d4d0af7626 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:08.290688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-49d706d0-4dce-42e3-95d1-43d4d0af7626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:08.321423 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726924b-acd6-4507-a459-fd9bce6d758a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:08.371106 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 549/1088] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:08.394825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:08.436789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726924b-acd6-4507-a459-fd9bce6d758a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:08.472397 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc39362-d2e6-4c6d-b207-69d75818097a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:08.473035 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc39362-d2e6-4c6d-b207-69d75818097a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:08.473316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc39362-d2e6-4c6d-b207-69d75818097a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:08.473586 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc39362-d2e6-4c6d-b207-69d75818097a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:08.484128 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc39362-d2e6-4c6d-b207-69d75818097a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-6dc39362-d2e6-4c6d-b207-69d75818097a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:07:08.489448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:08.490551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:08.491981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:08.491981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:08.491981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:08.491981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:08.491981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:07:08.491981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:07:08.491981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:07:08.491981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:07:08.491981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:07:08.491981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:07:08.491981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 01:07:08.491981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:08.491981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 540/1089] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Sep 13 01:07:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:07:08.496581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d706d0-4dce-42e3-95d1-43d4d0af7626 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:08.565067 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:08.599995 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d706d0-4dce-42e3-95d1-43d4d0af7626 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:08.635483 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42197b-ee41-4189-b55e-e84cc492cfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:08.636097 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42197b-ee41-4189-b55e-e84cc492cfc8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:08.636375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42197b-ee41-4189-b55e-e84cc492cfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:08.636645 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42197b-ee41-4189-b55e-e84cc492cfc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:08.637316 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42197b-ee41-4189-b55e-e84cc492cfc8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:08.638455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc39362-d2e6-4c6d-b207-69d75818097a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:08.638986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42197b-ee41-4189-b55e-e84cc492cfc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:08.640371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42197b-ee41-4189-b55e-e84cc492cfc8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:08.649596 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 550/1090] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 13 01:07:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:08.655158 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42197b-ee41-4189-b55e-e84cc492cfc8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:08.738895 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc39362-d2e6-4c6d-b207-69d75818097a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:08.753842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42197b-ee41-4189-b55e-e84cc492cfc8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:08.762846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:08.773959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f2772-a97b-46e6-939d-4e9bf9aa3258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:08.774585 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f2772-a97b-46e6-939d-4e9bf9aa3258 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:08.774864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f2772-a97b-46e6-939d-4e9bf9aa3258 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:08.775166 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f2772-a97b-46e6-939d-4e9bf9aa3258 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:08.781648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:08.786372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f2772-a97b-46e6-939d-4e9bf9aa3258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:07:08.788262 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c54b84-7e2e-4a0b-b72e-98b3b278c99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:08.788892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c54b84-7e2e-4a0b-b72e-98b3b278c99c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:08.789174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c54b84-7e2e-4a0b-b72e-98b3b278c99c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:08.789448 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c54b84-7e2e-4a0b-b72e-98b3b278c99c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-d52f2772-a97b-46e6-939d-4e9bf9aa3258 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:07:08.791218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:08.792218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:08.793058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:08.793058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:08.793058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:08.793058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:08.793058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:07:08.793058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:07:08.793058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:07:08.793058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:07:08.793058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:07:08.793058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:07:08.793058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:08.793058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:08.793058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 541/1091] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:07:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:07:08.798915 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f2772-a97b-46e6-939d-4e9bf9aa3258 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:08.801777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c54b84-7e2e-4a0b-b72e-98b3b278c99c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:08.803265 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c54b84-7e2e-4a0b-b72e-98b3b278c99c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-34c54b84-7e2e-4a0b-b72e-98b3b278c99c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:07:08.817702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:08.818673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:07:08.819654 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:07:08.819654 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:07:08.819654 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:07:08.819654 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 551/1092] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:07:08.824275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c54b84-7e2e-4a0b-b72e-98b3b278c99c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:08.900017 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f2772-a97b-46e6-939d-4e9bf9aa3258 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:08.922153 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c54b84-7e2e-4a0b-b72e-98b3b278c99c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:08.933676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4a83c-5773-4d4b-a62d-f47d00ba2f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:08.934279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4a83c-5773-4d4b-a62d-f47d00ba2f23 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:08.934558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4a83c-5773-4d4b-a62d-f47d00ba2f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:08.934832 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4a83c-5773-4d4b-a62d-f47d00ba2f23 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:08.935528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4a83c-5773-4d4b-a62d-f47d00ba2f23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:08.935834 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4a83c-5773-4d4b-a62d-f47d00ba2f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:08.937196 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4a83c-5773-4d4b-a62d-f47d00ba2f23 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:08.945247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 542/1093] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:07:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:07:08.951375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4a83c-5773-4d4b-a62d-f47d00ba2f23 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:08.961128 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4a6d6-a70b-4a2a-aef9-83ed831e92d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:08.961737 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4a6d6-a70b-4a2a-aef9-83ed831e92d9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:08.962017 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4a6d6-a70b-4a2a-aef9-83ed831e92d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:08.962295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4a6d6-a70b-4a2a-aef9-83ed831e92d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:08.962941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4a6d6-a70b-4a2a-aef9-83ed831e92d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:08.963329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4a6d6-a70b-4a2a-aef9-83ed831e92d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:08.964703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4a6d6-a70b-4a2a-aef9-83ed831e92d9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:08.976798 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 552/1094] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:07:08.982321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4a6d6-a70b-4a2a-aef9-83ed831e92d9 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:08.998022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:09.024940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:09.052725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4a83c-5773-4d4b-a62d-f47d00ba2f23 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:09.083441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4a6d6-a70b-4a2a-aef9-83ed831e92d9 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:09.086401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798bb20-f452-49a6-bf20-c5f47daa9424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:09.087029 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798bb20-f452-49a6-bf20-c5f47daa9424 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:09.087332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798bb20-f452-49a6-bf20-c5f47daa9424 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:09.087606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798bb20-f452-49a6-bf20-c5f47daa9424 None admin] PATH_INFO: `/v3/users/d7f03f36562a4add9e7203f9961cb45d` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:09.088729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798bb20-f452-49a6-bf20-c5f47daa9424 None admin] RBAC: Authorizing `identity:get_user(user_id=d7f03f36562a4add9e7203f9961cb45d)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:09.090159 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798bb20-f452-49a6-bf20-c5f47daa9424 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:09.091768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 543/1095] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:07:08 2022] GET /identity/v3/users/d7f03f36562a4add9e7203f9961cb45d => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:07:09.098224 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798bb20-f452-49a6-bf20-c5f47daa9424 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:09.118075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162dee4-1f84-4665-8056-ab10c2dc195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:09.118702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162dee4-1f84-4665-8056-ab10c2dc195c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:09.118983 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162dee4-1f84-4665-8056-ab10c2dc195c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:09.119288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162dee4-1f84-4665-8056-ab10c2dc195c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:09.126348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162dee4-1f84-4665-8056-ab10c2dc195c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:09.127855 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162dee4-1f84-4665-8056-ab10c2dc195c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-4162dee4-1f84-4665-8056-ab10c2dc195c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:07:09.139292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:09.140626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:09.142542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:09.142542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:09.142542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:07:09.142542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:07:09.142542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:07:09.142542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:07:09.142542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:07:09.142542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:07:09.142542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 01:07:09.142542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:07:09.142542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 553/1096] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 13 01:07:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:07:09.146679 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162dee4-1f84-4665-8056-ab10c2dc195c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:09.201743 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798bb20-f452-49a6-bf20-c5f47daa9424 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:09.215890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:09.238248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b4c7a-cbcd-46a8-9269-5ec3748a38a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:09.238855 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b4c7a-cbcd-46a8-9269-5ec3748a38a8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:09.239168 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b4c7a-cbcd-46a8-9269-5ec3748a38a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:09.239442 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b4c7a-cbcd-46a8-9269-5ec3748a38a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:09.247873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162dee4-1f84-4665-8056-ab10c2dc195c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:09.249391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:09.282596 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1b4a5-83bc-4e4a-b70e-412635f03e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:09.283308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1b4a5-83bc-4e4a-b70e-412635f03e36 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:09.283587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1b4a5-83bc-4e4a-b70e-412635f03e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:09.283861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1b4a5-83bc-4e4a-b70e-412635f03e36 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:09.284583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1b4a5-83bc-4e4a-b70e-412635f03e36 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:09.284888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1b4a5-83bc-4e4a-b70e-412635f03e36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:09.286318 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1b4a5-83bc-4e4a-b70e-412635f03e36 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:09.303824 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 554/1097] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 13 01:07:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:07:09.305553 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b4c7a-cbcd-46a8-9269-5ec3748a38a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:09.307117 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b4c7a-cbcd-46a8-9269-5ec3748a38a8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:09.309395 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1b4a5-83bc-4e4a-b70e-412635f03e36 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:09.406380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 544/1098] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:07:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 01:07:09.406729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1b4a5-83bc-4e4a-b70e-412635f03e36 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:09.412731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b4c7a-cbcd-46a8-9269-5ec3748a38a8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:09.430483 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:09.444066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a379b-2502-438f-a338-78ecbf5b29c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:09.444681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a379b-2502-438f-a338-78ecbf5b29c8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:09.444961 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a379b-2502-438f-a338-78ecbf5b29c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:09.445238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a379b-2502-438f-a338-78ecbf5b29c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:09.473882 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:09.513243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a379b-2502-438f-a338-78ecbf5b29c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:09.514699 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a379b-2502-438f-a338-78ecbf5b29c8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:09.514959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b4c7a-cbcd-46a8-9269-5ec3748a38a8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:09.553749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d19e04-c798-4b1f-9186-5369b4572383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:09.554372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d19e04-c798-4b1f-9186-5369b4572383 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:09.554645 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d19e04-c798-4b1f-9186-5369b4572383 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:09.554915 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d19e04-c798-4b1f-9186-5369b4572383 None admin] PATH_INFO: `/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:09.556238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d19e04-c798-4b1f-9186-5369b4572383 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c0ccd8f95d4c55a7d3d6610aa19e81)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:09.557646 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d19e04-c798-4b1f-9186-5369b4572383 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:09.559297 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 545/1099] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:07:09 2022] GET /identity/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:07:09.565865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d19e04-c798-4b1f-9186-5369b4572383 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:09.617543 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 555/1100] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:07:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 01:07:09.623216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a379b-2502-438f-a338-78ecbf5b29c8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:09.646940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:09.666783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d19e04-c798-4b1f-9186-5369b4572383 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:09.685838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:09.701553 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd77cfb-eb97-4a73-9c9c-da20ae5046a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:09.702154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd77cfb-eb97-4a73-9c9c-da20ae5046a2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:09.702425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd77cfb-eb97-4a73-9c9c-da20ae5046a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:09.702695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd77cfb-eb97-4a73-9c9c-da20ae5046a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:09.703438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd77cfb-eb97-4a73-9c9c-da20ae5046a2 None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=e1c0ccd8f95d4c55a7d3d6610aa19e81, user.id=d7f03f36562a4add9e7203f9961cb45d) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:09.703758 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd77cfb-eb97-4a73-9c9c-da20ae5046a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:09.705167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd77cfb-eb97-4a73-9c9c-da20ae5046a2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:09.710735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 546/1101] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:07:09 2022] GET /identity/v3/role_assignments?user.id=d7f03f36562a4add9e7203f9961cb45d&scope.project.id=e1c0ccd8f95d4c55a7d3d6610aa19e81&role.id=3799feb4caa64e568971222375957f54 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:09.727590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a379b-2502-438f-a338-78ecbf5b29c8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:09.773062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14e545-afc8-4cbe-9eeb-f5d94921052e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:09.773729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14e545-afc8-4cbe-9eeb-f5d94921052e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:09.774014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14e545-afc8-4cbe-9eeb-f5d94921052e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:09.774286 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14e545-afc8-4cbe-9eeb-f5d94921052e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:09.790679 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14e545-afc8-4cbe-9eeb-f5d94921052e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:09.792229 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14e545-afc8-4cbe-9eeb-f5d94921052e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-1f14e545-afc8-4cbe-9eeb-f5d94921052e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:07:09.814210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:09.815358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:07:09.816258 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:07:09.816258 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:07:09.816258 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:07:09.816706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 556/1102] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:07:09.827906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd77cfb-eb97-4a73-9c9c-da20ae5046a2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:09.947749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd77cfb-eb97-4a73-9c9c-da20ae5046a2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:09.990249 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830d094-641e-4113-a66f-997d89f92ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:09.991275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830d094-641e-4113-a66f-997d89f92ffd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:09.991728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830d094-641e-4113-a66f-997d89f92ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:09.992160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830d094-641e-4113-a66f-997d89f92ffd None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:09.993252 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830d094-641e-4113-a66f-997d89f92ffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:09.993699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830d094-641e-4113-a66f-997d89f92ffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:09.995181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830d094-641e-4113-a66f-997d89f92ffd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:10.012221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 547/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:10.017922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14e545-afc8-4cbe-9eeb-f5d94921052e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:10.140817 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14e545-afc8-4cbe-9eeb-f5d94921052e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:10.154649 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:10.177111 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0799902-3d0c-4318-8061-3502fa019af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:10.177733 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0799902-3d0c-4318-8061-3502fa019af7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:10.178010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0799902-3d0c-4318-8061-3502fa019af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:10.178280 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0799902-3d0c-4318-8061-3502fa019af7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:10.185055 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0799902-3d0c-4318-8061-3502fa019af7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:10.186510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0799902-3d0c-4318-8061-3502fa019af7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:10.198587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-f0799902-3d0c-4318-8061-3502fa019af7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:07:10.198587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:10.198587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:10.198587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:10.198587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:10.198587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:10.198587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:10.198587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:10.198587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:10.198587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:10.198587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:10.198587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:10.198587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:07:10.198587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:07:10.198587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:10.199625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:10.200789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:07:10.200789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:07:10.200789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:07:10.200789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:07:10.200789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:07:10.200789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:07:10.200789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:07:10.200789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:07:10.200789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 557/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:07:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:07:10.209676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830d094-641e-4113-a66f-997d89f92ffd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:10.218551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:10.321046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830d094-641e-4113-a66f-997d89f92ffd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:10.358035 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b46df7-0d11-4948-aeab-c436c72f8b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:10.358651 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b46df7-0d11-4948-aeab-c436c72f8b21 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:10.358925 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b46df7-0d11-4948-aeab-c436c72f8b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:10.359226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b46df7-0d11-4948-aeab-c436c72f8b21 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:10.359919 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b46df7-0d11-4948-aeab-c436c72f8b21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:10.360943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b46df7-0d11-4948-aeab-c436c72f8b21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:10.362656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b46df7-0d11-4948-aeab-c436c72f8b21 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:10.382714 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 548/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:07:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:10.384018 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0799902-3d0c-4318-8061-3502fa019af7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:10.497869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0799902-3d0c-4318-8061-3502fa019af7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:10.533505 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a28edb-588e-437d-9327-31c1b6ba6b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:10.534114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a28edb-588e-437d-9327-31c1b6ba6b92 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:10.534419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a28edb-588e-437d-9327-31c1b6ba6b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:10.534688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a28edb-588e-437d-9327-31c1b6ba6b92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:10.535511 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a28edb-588e-437d-9327-31c1b6ba6b92 None admin] RBAC: Adding query filter params (role.id=063ead59de26487aade9d571bde678c5, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=fadc83bec6be41979e1aa4d71f8fc2bd) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:10.535813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a28edb-588e-437d-9327-31c1b6ba6b92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:10.537261 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a28edb-588e-437d-9327-31c1b6ba6b92 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:10.543334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 558/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:07:10 2022] GET /identity/v3/role_assignments?user.id=fadc83bec6be41979e1aa4d71f8fc2bd&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=063ead59de26487aade9d571bde678c5 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:11.992961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fb168-ca8f-45ea-8136-7a546d30b5f4 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:11.993530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fb168-ca8f-45ea-8136-7a546d30b5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:11.993530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fb168-ca8f-45ea-8136-7a546d30b5f4 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:11.994845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 549/1107] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:12.000026 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851de7-849d-458b-824b-e52d918b7654 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:12.000416 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851de7-849d-458b-824b-e52d918b7654 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:12.001099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851de7-849d-458b-824b-e52d918b7654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:12.019662 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-14851de7-849d-458b-824b-e52d918b7654 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:12.020857 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-14851de7-849d-458b-824b-e52d918b7654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:12.050321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:12.088877 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 559/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:12.358174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fb168-ca8f-45ea-8136-7a546d30b5f4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:12.425312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:12.462144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fb168-ca8f-45ea-8136-7a546d30b5f4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:12.494273 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a804e3-da2f-40d8-aace-ae24a3a6dc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:12.494922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a804e3-da2f-40d8-aace-ae24a3a6dc2a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:12.495233 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a804e3-da2f-40d8-aace-ae24a3a6dc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:12.495508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a804e3-da2f-40d8-aace-ae24a3a6dc2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:12.496612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a804e3-da2f-40d8-aace-ae24a3a6dc2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:12.498035 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a804e3-da2f-40d8-aace-ae24a3a6dc2a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:12.499626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 550/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:07:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:12.506022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14851de7-849d-458b-824b-e52d918b7654 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:12.601925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14851de7-849d-458b-824b-e52d918b7654 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:12.634619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a98d3-b928-4f6c-bf27-dd2e7bfde1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:12.635180 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a98d3-b928-4f6c-bf27-dd2e7bfde1fd None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:12.635457 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a98d3-b928-4f6c-bf27-dd2e7bfde1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:12.635725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a98d3-b928-4f6c-bf27-dd2e7bfde1fd None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:12.636371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a98d3-b928-4f6c-bf27-dd2e7bfde1fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:12.637782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a98d3-b928-4f6c-bf27-dd2e7bfde1fd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:12.657588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 560/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:07:12 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:07:14.837533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ae820-1dc5-4923-8f12-52ba8bff04c0 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:14.838080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ae820-1dc5-4923-8f12-52ba8bff04c0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:14.838080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ae820-1dc5-4923-8f12-52ba8bff04c0 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:14.839452 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 551/1111] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:14.844840 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4dea5-b5a5-4ba4-b052-7dac21376f80 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:14.845258 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4dea5-b5a5-4ba4-b052-7dac21376f80 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:14.845372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4dea5-b5a5-4ba4-b052-7dac21376f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:14.863180 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f0b4dea5-b5a5-4ba4-b052-7dac21376f80 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:14.864368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f0b4dea5-b5a5-4ba4-b052-7dac21376f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:14.880833 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:14.930168 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 561/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:15.210933 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ae820-1dc5-4923-8f12-52ba8bff04c0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:15.308525 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ae820-1dc5-4923-8f12-52ba8bff04c0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:15.340751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cdc61-16d5-4ce0-8153-73818d1990fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:15.341356 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cdc61-16d5-4ce0-8153-73818d1990fd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:15.341630 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cdc61-16d5-4ce0-8153-73818d1990fd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:15.341896 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cdc61-16d5-4ce0-8153-73818d1990fd None admin] PATH_INFO: `/v3/roles/6f1196f44c2040ee86de4a614692041d` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:15.343279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cdc61-16d5-4ce0-8153-73818d1990fd None admin] RBAC: Authorizing `identity:get_role(role_id=6f1196f44c2040ee86de4a614692041d)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:15.344653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cdc61-16d5-4ce0-8153-73818d1990fd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:15.345941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 552/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:07:15 2022] GET /identity/v3/roles/6f1196f44c2040ee86de4a614692041d => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:15.351775 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4dea5-b5a5-4ba4-b052-7dac21376f80 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:15.449785 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4dea5-b5a5-4ba4-b052-7dac21376f80 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:15.483306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640866df-7bce-4596-a12d-cdaca0514988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:15.483878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640866df-7bce-4596-a12d-cdaca0514988 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:15.484162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640866df-7bce-4596-a12d-cdaca0514988 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:15.484439 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640866df-7bce-4596-a12d-cdaca0514988 None admin] PATH_INFO: `/v3/users/5c76713fa8cb4a7f9dcd0ab752d7b08a` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:15.497700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640866df-7bce-4596-a12d-cdaca0514988 None admin] RBAC: Authorizing `identity:get_user(user_id=5c76713fa8cb4a7f9dcd0ab752d7b08a)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:15.499212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640866df-7bce-4596-a12d-cdaca0514988 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:15.501095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 562/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:07:15 2022] GET /identity/v3/users/5c76713fa8cb4a7f9dcd0ab752d7b08a => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:07:15.506865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cdc61-16d5-4ce0-8153-73818d1990fd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:15.509767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:15.604051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cdc61-16d5-4ce0-8153-73818d1990fd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:15.636550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0160912-995d-48aa-b2f9-d6e3428aee08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:15.637145 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0160912-995d-48aa-b2f9-d6e3428aee08 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:15.637426 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0160912-995d-48aa-b2f9-d6e3428aee08 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:15.637701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0160912-995d-48aa-b2f9-d6e3428aee08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:15.701936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0160912-995d-48aa-b2f9-d6e3428aee08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:15.703410 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0160912-995d-48aa-b2f9-d6e3428aee08 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:15.705360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:15.798008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 553/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:07:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 01:07:15.803892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640866df-7bce-4596-a12d-cdaca0514988 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:15.816623 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:15.902419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640866df-7bce-4596-a12d-cdaca0514988 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:15.935236 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6507b5-7936-49cc-b6cf-e609ddf298cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:15.935850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6507b5-7936-49cc-b6cf-e609ddf298cb None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:15.936126 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6507b5-7936-49cc-b6cf-e609ddf298cb None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:15.936397 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6507b5-7936-49cc-b6cf-e609ddf298cb None admin] PATH_INFO: `/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:15.937480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6507b5-7936-49cc-b6cf-e609ddf298cb None admin] RBAC: Authorizing `identity:get_project(project_id=e1c0ccd8f95d4c55a7d3d6610aa19e81)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:15.939723 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6507b5-7936-49cc-b6cf-e609ddf298cb None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:15.941311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 563/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:07:15 2022] GET /identity/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:15.947385 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0160912-995d-48aa-b2f9-d6e3428aee08 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:16.043224 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0160912-995d-48aa-b2f9-d6e3428aee08 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:16.044714 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:16.078337 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a5cf8-eb1a-4615-936c-aa605f59f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:16.079129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a5cf8-eb1a-4615-936c-aa605f59f010 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:16.079435 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a5cf8-eb1a-4615-936c-aa605f59f010 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:16.079703 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a5cf8-eb1a-4615-936c-aa605f59f010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:16.080408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a5cf8-eb1a-4615-936c-aa605f59f010 None admin] RBAC: Adding query filter params (role.id=6f1196f44c2040ee86de4a614692041d, scope.project.id=e1c0ccd8f95d4c55a7d3d6610aa19e81, user.id=5c76713fa8cb4a7f9dcd0ab752d7b08a) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:16.080713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a5cf8-eb1a-4615-936c-aa605f59f010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:16.082103 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a5cf8-eb1a-4615-936c-aa605f59f010 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:16.087259 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 554/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:07:15 2022] GET /identity/v3/role_assignments?user.id=5c76713fa8cb4a7f9dcd0ab752d7b08a&scope.project.id=e1c0ccd8f95d4c55a7d3d6610aa19e81&role.id=6f1196f44c2040ee86de4a614692041d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:18.239640 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83909019-5d8a-4a52-b3d0-7de8de80025a None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:18.240194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83909019-5d8a-4a52-b3d0-7de8de80025a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:18.240194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83909019-5d8a-4a52-b3d0-7de8de80025a None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:18.241575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 564/1118] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:18.246670 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c9a26-6fb5-4ca8-a155-e64c908590e9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:18.247098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c9a26-6fb5-4ca8-a155-e64c908590e9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:18.247253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c9a26-6fb5-4ca8-a155-e64c908590e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:18.265762 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a21c9a26-6fb5-4ca8-a155-e64c908590e9 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:18.267203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a21c9a26-6fb5-4ca8-a155-e64c908590e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:18.330524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 555/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:18.605069 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83909019-5d8a-4a52-b3d0-7de8de80025a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:18.682244 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:18.704552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83909019-5d8a-4a52-b3d0-7de8de80025a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:18.737975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c858ec-9ec7-4f3d-896d-570a3d77d893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:18.738591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c858ec-9ec7-4f3d-896d-570a3d77d893 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:18.738873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c858ec-9ec7-4f3d-896d-570a3d77d893 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:18.739177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c858ec-9ec7-4f3d-896d-570a3d77d893 None admin] PATH_INFO: `/v3/roles/6f1196f44c2040ee86de4a614692041d` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:18.740554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c858ec-9ec7-4f3d-896d-570a3d77d893 None admin] RBAC: Authorizing `identity:get_role(role_id=6f1196f44c2040ee86de4a614692041d)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:18.741930 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c858ec-9ec7-4f3d-896d-570a3d77d893 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:18.743257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 565/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:07:18 2022] GET /identity/v3/roles/6f1196f44c2040ee86de4a614692041d => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:18.748972 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c9a26-6fb5-4ca8-a155-e64c908590e9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:18.839185 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:18.845928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c9a26-6fb5-4ca8-a155-e64c908590e9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:18.878794 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b61ae-229c-4c4f-9f36-2750580f0329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:18.879373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b61ae-229c-4c4f-9f36-2750580f0329 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:18.879650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b61ae-229c-4c4f-9f36-2750580f0329 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:18.879916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b61ae-229c-4c4f-9f36-2750580f0329 None admin] PATH_INFO: `/v3/users/5c76713fa8cb4a7f9dcd0ab752d7b08a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:18.881002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b61ae-229c-4c4f-9f36-2750580f0329 None admin] RBAC: Authorizing `identity:get_user(user_id=5c76713fa8cb4a7f9dcd0ab752d7b08a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:18.882418 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b61ae-229c-4c4f-9f36-2750580f0329 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:18.884020 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 556/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:07:18 2022] GET /identity/v3/users/5c76713fa8cb4a7f9dcd0ab752d7b08a => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:18.889682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c858ec-9ec7-4f3d-896d-570a3d77d893 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:18.986556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c858ec-9ec7-4f3d-896d-570a3d77d893 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:19.018719 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f5db9-0984-4ddb-bdf7-5101aa01d31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:19.019350 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f5db9-0984-4ddb-bdf7-5101aa01d31e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:19.019626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f5db9-0984-4ddb-bdf7-5101aa01d31e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:19.019900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f5db9-0984-4ddb-bdf7-5101aa01d31e None admin] PATH_INFO: `/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:19.020985 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f5db9-0984-4ddb-bdf7-5101aa01d31e None admin] RBAC: Authorizing `identity:get_project(project_id=e1c0ccd8f95d4c55a7d3d6610aa19e81)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:19.022392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f5db9-0984-4ddb-bdf7-5101aa01d31e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:19.023989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 566/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:07:18 2022] GET /identity/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:19.029733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b61ae-229c-4c4f-9f36-2750580f0329 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:19.125073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b61ae-229c-4c4f-9f36-2750580f0329 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:19.158297 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c148326-7535-4041-b4c6-69fcf38656a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:19.158881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c148326-7535-4041-b4c6-69fcf38656a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:19.159186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c148326-7535-4041-b4c6-69fcf38656a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:19.159459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c148326-7535-4041-b4c6-69fcf38656a5 None admin] PATH_INFO: `/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81/users/5c76713fa8cb4a7f9dcd0ab752d7b08a/roles/6f1196f44c2040ee86de4a614692041d` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:19.161544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c148326-7535-4041-b4c6-69fcf38656a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1c0ccd8f95d4c55a7d3d6610aa19e81, user_id=5c76713fa8cb4a7f9dcd0ab752d7b08a, role_id=6f1196f44c2040ee86de4a614692041d)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:19.162946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c148326-7535-4041-b4c6-69fcf38656a5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:19.174994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 557/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:07:19 2022] PUT /identity/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81/users/5c76713fa8cb4a7f9dcd0ab752d7b08a/roles/6f1196f44c2040ee86de4a614692041d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:07:21.294073 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072ff14-7ce9-463d-8f7b-c14c355457b3 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:21.294603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072ff14-7ce9-463d-8f7b-c14c355457b3 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:21.294696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072ff14-7ce9-463d-8f7b-c14c355457b3 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:21.296005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 567/1124] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:21.301432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31846c08-fed8-4e57-8264-b26e1a8f6e1a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:21.301836 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31846c08-fed8-4e57-8264-b26e1a8f6e1a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:21.302010 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31846c08-fed8-4e57-8264-b26e1a8f6e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:21.319745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-31846c08-fed8-4e57-8264-b26e1a8f6e1a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:21.320930 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-31846c08-fed8-4e57-8264-b26e1a8f6e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:21.338298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:21.386114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 558/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:21.667212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072ff14-7ce9-463d-8f7b-c14c355457b3 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:21.682948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:21.768076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072ff14-7ce9-463d-8f7b-c14c355457b3 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:21.800440 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130e629-46dc-4db3-b44b-a3fb792fd936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:21.801048 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130e629-46dc-4db3-b44b-a3fb792fd936 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:21.801321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130e629-46dc-4db3-b44b-a3fb792fd936 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:21.801595 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130e629-46dc-4db3-b44b-a3fb792fd936 None admin] PATH_INFO: `/v3/roles/6f1196f44c2040ee86de4a614692041d` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:21.802952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130e629-46dc-4db3-b44b-a3fb792fd936 None admin] RBAC: Authorizing `identity:get_role(role_id=6f1196f44c2040ee86de4a614692041d)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:21.804345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130e629-46dc-4db3-b44b-a3fb792fd936 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:21.805636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 568/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:07:21 2022] GET /identity/v3/roles/6f1196f44c2040ee86de4a614692041d => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:21.811371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31846c08-fed8-4e57-8264-b26e1a8f6e1a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:21.907128 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31846c08-fed8-4e57-8264-b26e1a8f6e1a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:21.940191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa004a-58d2-450c-bab5-070dac40d31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:21.940737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa004a-58d2-450c-bab5-070dac40d31c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:21.941012 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa004a-58d2-450c-bab5-070dac40d31c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:21.941281 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa004a-58d2-450c-bab5-070dac40d31c None admin] PATH_INFO: `/v3/users/5c76713fa8cb4a7f9dcd0ab752d7b08a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:21.942375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa004a-58d2-450c-bab5-070dac40d31c None admin] RBAC: Authorizing `identity:get_user(user_id=5c76713fa8cb4a7f9dcd0ab752d7b08a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:21.943803 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa004a-58d2-450c-bab5-070dac40d31c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:21.945335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 559/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:07:21 2022] GET /identity/v3/users/5c76713fa8cb4a7f9dcd0ab752d7b08a => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:21.951193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130e629-46dc-4db3-b44b-a3fb792fd936 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:22.030024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:22.049137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130e629-46dc-4db3-b44b-a3fb792fd936 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:22.082527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007a63c-b841-4dfd-8a4b-d12ba3086ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:22.083147 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007a63c-b841-4dfd-8a4b-d12ba3086ddd None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:22.083427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007a63c-b841-4dfd-8a4b-d12ba3086ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:22.083699 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007a63c-b841-4dfd-8a4b-d12ba3086ddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:22.147755 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007a63c-b841-4dfd-8a4b-d12ba3086ddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:22.149193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007a63c-b841-4dfd-8a4b-d12ba3086ddd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:22.225780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:22.243903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 569/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:07:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 01:07:22.249812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa004a-58d2-450c-bab5-070dac40d31c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:22.274002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:22.346493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa004a-58d2-450c-bab5-070dac40d31c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:22.378922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230acd9c-980a-41ad-a133-c0601f97cac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:22.379562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230acd9c-980a-41ad-a133-c0601f97cac9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:22.379839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230acd9c-980a-41ad-a133-c0601f97cac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:22.380107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230acd9c-980a-41ad-a133-c0601f97cac9 None admin] PATH_INFO: `/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:22.381189 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230acd9c-980a-41ad-a133-c0601f97cac9 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c0ccd8f95d4c55a7d3d6610aa19e81)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:22.382596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230acd9c-980a-41ad-a133-c0601f97cac9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:22.384307 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 560/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:07:22 2022] GET /identity/v3/projects/e1c0ccd8f95d4c55a7d3d6610aa19e81 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:22.390353 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007a63c-b841-4dfd-8a4b-d12ba3086ddd None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:22.489760 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007a63c-b841-4dfd-8a4b-d12ba3086ddd None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:22.521908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1c433-6546-4fb0-a92f-d72992fa8dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:22.522504 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1c433-6546-4fb0-a92f-d72992fa8dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:22.522781 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1c433-6546-4fb0-a92f-d72992fa8dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:22.523054 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1c433-6546-4fb0-a92f-d72992fa8dd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:22.523800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1c433-6546-4fb0-a92f-d72992fa8dd8 None admin] RBAC: Adding query filter params (role.id=6f1196f44c2040ee86de4a614692041d, scope.project.id=e1c0ccd8f95d4c55a7d3d6610aa19e81, user.id=5c76713fa8cb4a7f9dcd0ab752d7b08a) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:22.524106 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1c433-6546-4fb0-a92f-d72992fa8dd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:22.525534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1c433-6546-4fb0-a92f-d72992fa8dd8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:22.531045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 570/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:07:22 2022] GET /identity/v3/role_assignments?user.id=5c76713fa8cb4a7f9dcd0ab752d7b08a&scope.project.id=e1c0ccd8f95d4c55a7d3d6610aa19e81&role.id=6f1196f44c2040ee86de4a614692041d => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:24.688611 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a352f-1472-4d07-aa69-eb9de4616ec8 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:24.689134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a352f-1472-4d07-aa69-eb9de4616ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:24.689134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a352f-1472-4d07-aa69-eb9de4616ec8 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:24.690411 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 561/1131] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:24.696028 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14636a5-d5a9-443b-90d7-45b6a5c17c92 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:24.696425 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14636a5-d5a9-443b-90d7-45b6a5c17c92 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:24.696576 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14636a5-d5a9-443b-90d7-45b6a5c17c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:24.715037 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f14636a5-d5a9-443b-90d7-45b6a5c17c92 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:24.716240 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f14636a5-d5a9-443b-90d7-45b6a5c17c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:24.757406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:24.783409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 571/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:25.057948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a352f-1472-4d07-aa69-eb9de4616ec8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:25.146837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:25.157379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a352f-1472-4d07-aa69-eb9de4616ec8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:25.190667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23ec48-3533-4186-98d2-610072a305ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:25.191300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23ec48-3533-4186-98d2-610072a305ec None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:25.191578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23ec48-3533-4186-98d2-610072a305ec None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:25.191848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23ec48-3533-4186-98d2-610072a305ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:25.192940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23ec48-3533-4186-98d2-610072a305ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:25.194369 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23ec48-3533-4186-98d2-610072a305ec None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:25.195932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 562/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:07:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:25.202090 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14636a5-d5a9-443b-90d7-45b6a5c17c92 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:25.310035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14636a5-d5a9-443b-90d7-45b6a5c17c92 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:25.342672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9fd33-9d0c-49da-84de-0971ddc2fb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:25.343285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9fd33-9d0c-49da-84de-0971ddc2fb7f None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:25.343560 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9fd33-9d0c-49da-84de-0971ddc2fb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:25.344442 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9fd33-9d0c-49da-84de-0971ddc2fb7f None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:25.345295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9fd33-9d0c-49da-84de-0971ddc2fb7f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:25.346708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9fd33-9d0c-49da-84de-0971ddc2fb7f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:25.373895 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 572/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 13 01:07:25 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:07:27.542682 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c40092-0b18-4710-9864-537fe11a84a9 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:27.543235 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c40092-0b18-4710-9864-537fe11a84a9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:27.543235 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c40092-0b18-4710-9864-537fe11a84a9 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:27.544594 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 563/1135] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:27.550036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858010d0-6802-475f-9771-98e7f199fe1d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:27.550458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858010d0-6802-475f-9771-98e7f199fe1d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:27.550593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858010d0-6802-475f-9771-98e7f199fe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:27.569041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-858010d0-6802-475f-9771-98e7f199fe1d None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:27.570219 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-858010d0-6802-475f-9771-98e7f199fe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:27.592917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:27.638414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 573/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:27.913555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c40092-0b18-4710-9864-537fe11a84a9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:28.011029 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c40092-0b18-4710-9864-537fe11a84a9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:28.044757 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a1445-b680-4276-b2f1-7113534441c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:28.045371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a1445-b680-4276-b2f1-7113534441c6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:28.045650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a1445-b680-4276-b2f1-7113534441c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:28.045921 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a1445-b680-4276-b2f1-7113534441c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:28.047560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a1445-b680-4276-b2f1-7113534441c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:28.048977 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a1445-b680-4276-b2f1-7113534441c6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:28.050515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 564/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:07:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:28.056353 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858010d0-6802-475f-9771-98e7f199fe1d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:28.157415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858010d0-6802-475f-9771-98e7f199fe1d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:28.191141 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21afeb8-790d-49d1-b18c-5a650c43d5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:28.191688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21afeb8-790d-49d1-b18c-5a650c43d5f9 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:28.191967 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21afeb8-790d-49d1-b18c-5a650c43d5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:28.192238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21afeb8-790d-49d1-b18c-5a650c43d5f9 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:28.192887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21afeb8-790d-49d1-b18c-5a650c43d5f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:28.194325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21afeb8-790d-49d1-b18c-5a650c43d5f9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:28.214954 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 574/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:07:28 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:07:30.388797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8271c19-9e3e-49a8-9e96-d55e80e6166e None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:30.389327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8271c19-9e3e-49a8-9e96-d55e80e6166e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:30.389327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8271c19-9e3e-49a8-9e96-d55e80e6166e None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:30.390705 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 565/1139] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:30.395945 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f048027-9963-4732-82cd-bc17db4a438b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:30.396389 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f048027-9963-4732-82cd-bc17db4a438b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:30.396527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f048027-9963-4732-82cd-bc17db4a438b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:30.414269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1f048027-9963-4732-82cd-bc17db4a438b None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:30.415913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1f048027-9963-4732-82cd-bc17db4a438b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:30.426130 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:30.483694 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 575/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:30.749620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8271c19-9e3e-49a8-9e96-d55e80e6166e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:30.777045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:30.848659 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8271c19-9e3e-49a8-9e96-d55e80e6166e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:30.881671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70e9e2-c745-45e9-86f6-af8d1f91bec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:30.882283 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70e9e2-c745-45e9-86f6-af8d1f91bec9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:30.882562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70e9e2-c745-45e9-86f6-af8d1f91bec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:30.882835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70e9e2-c745-45e9-86f6-af8d1f91bec9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:30.892586 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70e9e2-c745-45e9-86f6-af8d1f91bec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-2d70e9e2-c745-45e9-86f6-af8d1f91bec9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:07:30.897330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:30.898459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:30.899725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:30.899725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:30.899725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:30.899725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:30.899725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:07:30.899725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:07:30.899725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:07:30.899725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:07:30.899725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:07:30.899725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:07:30.899725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:30.899725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:30.899725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 566/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:07:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:07:30.904430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f048027-9963-4732-82cd-bc17db4a438b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:31.000885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f048027-9963-4732-82cd-bc17db4a438b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:31.032926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d47a4-011c-4bfa-9a5d-a3fcb5ed4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:31.033519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d47a4-011c-4bfa-9a5d-a3fcb5ed4fac None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:31.033793 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d47a4-011c-4bfa-9a5d-a3fcb5ed4fac None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:31.034060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d47a4-011c-4bfa-9a5d-a3fcb5ed4fac None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:31.034711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d47a4-011c-4bfa-9a5d-a3fcb5ed4fac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:31.035010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d47a4-011c-4bfa-9a5d-a3fcb5ed4fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:31.036595 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d47a4-011c-4bfa-9a5d-a3fcb5ed4fac None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:31.045605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 576/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:07:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:31.052318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70e9e2-c745-45e9-86f6-af8d1f91bec9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:31.133696 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:31.148610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70e9e2-c745-45e9-86f6-af8d1f91bec9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:31.181141 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071a36c-bce5-4dc2-b517-8f6a4cc15062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:31.181752 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071a36c-bce5-4dc2-b517-8f6a4cc15062 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:31.182030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071a36c-bce5-4dc2-b517-8f6a4cc15062 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:31.182302 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071a36c-bce5-4dc2-b517-8f6a4cc15062 None admin] PATH_INFO: `/v3/users/69ccd08b9759436981d08e5f2698be9b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:31.195381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071a36c-bce5-4dc2-b517-8f6a4cc15062 None admin] RBAC: Authorizing `identity:get_user(user_id=69ccd08b9759436981d08e5f2698be9b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:31.196801 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071a36c-bce5-4dc2-b517-8f6a4cc15062 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:31.198373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 567/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:07:31 2022] GET /identity/v3/users/69ccd08b9759436981d08e5f2698be9b => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:31.204559 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d47a4-011c-4bfa-9a5d-a3fcb5ed4fac None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:31.213539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:31.309198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d47a4-011c-4bfa-9a5d-a3fcb5ed4fac None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:31.342245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f6a42-11ad-4914-9808-e86228ab5f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:31.342838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f6a42-11ad-4914-9808-e86228ab5f75 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:31.343146 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f6a42-11ad-4914-9808-e86228ab5f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:31.343418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f6a42-11ad-4914-9808-e86228ab5f75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:31.407302 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f6a42-11ad-4914-9808-e86228ab5f75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:31.408739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f6a42-11ad-4914-9808-e86228ab5f75 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:31.416158 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:31.504785 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 577/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:07:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 01:07:31.510737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071a36c-bce5-4dc2-b517-8f6a4cc15062 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:31.607725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071a36c-bce5-4dc2-b517-8f6a4cc15062 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:31.645073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ac208-ead3-4ef5-9b9a-b527d2cb2e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:31.645690 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ac208-ead3-4ef5-9b9a-b527d2cb2e52 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:31.645969 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ac208-ead3-4ef5-9b9a-b527d2cb2e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:31.646322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ac208-ead3-4ef5-9b9a-b527d2cb2e52 None admin] PATH_INFO: `/v3/projects/825c0a32cec14362832790f3c8342cab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:31.647981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ac208-ead3-4ef5-9b9a-b527d2cb2e52 None admin] RBAC: Authorizing `identity:get_project(project_id=825c0a32cec14362832790f3c8342cab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:31.650651 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ac208-ead3-4ef5-9b9a-b527d2cb2e52 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:31.653718 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 568/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:07:31 2022] GET /identity/v3/projects/825c0a32cec14362832790f3c8342cab => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:31.660639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f6a42-11ad-4914-9808-e86228ab5f75 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:31.756330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f6a42-11ad-4914-9808-e86228ab5f75 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:31.763294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:31.790567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bbf9b-10ea-4e6d-9f22-694ef397fa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:31.791183 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bbf9b-10ea-4e6d-9f22-694ef397fa6a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:31.791458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bbf9b-10ea-4e6d-9f22-694ef397fa6a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:31.791724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bbf9b-10ea-4e6d-9f22-694ef397fa6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:31.792426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bbf9b-10ea-4e6d-9f22-694ef397fa6a None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=825c0a32cec14362832790f3c8342cab, user.id=69ccd08b9759436981d08e5f2698be9b) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:31.792725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bbf9b-10ea-4e6d-9f22-694ef397fa6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:31.794134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bbf9b-10ea-4e6d-9f22-694ef397fa6a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:31.800193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 578/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:07:31 2022] GET /identity/v3/role_assignments?user.id=69ccd08b9759436981d08e5f2698be9b&scope.project.id=825c0a32cec14362832790f3c8342cab&role.id=3799feb4caa64e568971222375957f54 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:33.921422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c7e02-aca3-43b8-b123-d8e0f4ee665b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:33.922767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c7e02-aca3-43b8-b123-d8e0f4ee665b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:33.922767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c7e02-aca3-43b8-b123-d8e0f4ee665b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:33.924182 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 569/1147] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:33.929362 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7133b-2dfa-4e54-b081-e00c8fc65803 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:33.929786 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7133b-2dfa-4e54-b081-e00c8fc65803 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:33.929885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7133b-2dfa-4e54-b081-e00c8fc65803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:33.948042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b8a7133b-2dfa-4e54-b081-e00c8fc65803 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:33.949208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b8a7133b-2dfa-4e54-b081-e00c8fc65803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:34.012828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 579/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:34.276257 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c7e02-aca3-43b8-b123-d8e0f4ee665b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:34.290716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:34.375358 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c7e02-aca3-43b8-b123-d8e0f4ee665b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:34.408191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55deeae-0d76-4a70-91bc-d80abb4261a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:34.408806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55deeae-0d76-4a70-91bc-d80abb4261a0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:34.409083 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55deeae-0d76-4a70-91bc-d80abb4261a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:34.409354 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55deeae-0d76-4a70-91bc-d80abb4261a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:34.419306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55deeae-0d76-4a70-91bc-d80abb4261a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-b55deeae-0d76-4a70-91bc-d80abb4261a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:07:34.424130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:34.425310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:34.426380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:34.426380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:34.426380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:34.426380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:34.426380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:07:34.426380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:07:34.426380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:07:34.426380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:07:34.426380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:07:34.426380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:07:34.426380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:34.426380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:34.426380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 570/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:07:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:07:34.431213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7133b-2dfa-4e54-b081-e00c8fc65803 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:34.524347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:34.527398 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7133b-2dfa-4e54-b081-e00c8fc65803 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:34.560646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533a958-4153-4a4e-aac0-d7c4285442dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:34.561243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533a958-4153-4a4e-aac0-d7c4285442dc None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:34.561525 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533a958-4153-4a4e-aac0-d7c4285442dc None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:34.561800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533a958-4153-4a4e-aac0-d7c4285442dc None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:34.563268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533a958-4153-4a4e-aac0-d7c4285442dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:34.563574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533a958-4153-4a4e-aac0-d7c4285442dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:34.564951 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533a958-4153-4a4e-aac0-d7c4285442dc None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:34.572743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 580/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:07:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:34.579517 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55deeae-0d76-4a70-91bc-d80abb4261a0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:34.647862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:34.676150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55deeae-0d76-4a70-91bc-d80abb4261a0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:34.708839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df526dea-a89e-49b7-8294-ccc95b5a2f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:34.709448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df526dea-a89e-49b7-8294-ccc95b5a2f77 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:34.709727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df526dea-a89e-49b7-8294-ccc95b5a2f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:34.709997 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df526dea-a89e-49b7-8294-ccc95b5a2f77 None admin] PATH_INFO: `/v3/users/69ccd08b9759436981d08e5f2698be9b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:34.711112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df526dea-a89e-49b7-8294-ccc95b5a2f77 None admin] RBAC: Authorizing `identity:get_user(user_id=69ccd08b9759436981d08e5f2698be9b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:34.712532 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df526dea-a89e-49b7-8294-ccc95b5a2f77 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:34.714083 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 571/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:07:34 2022] GET /identity/v3/users/69ccd08b9759436981d08e5f2698be9b => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:07:34.719987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533a958-4153-4a4e-aac0-d7c4285442dc None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:34.817040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533a958-4153-4a4e-aac0-d7c4285442dc None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:34.849050 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c1fbe-93f2-4aa0-aa14-3a23dbdb0335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:34.849663 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c1fbe-93f2-4aa0-aa14-3a23dbdb0335 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:34.849944 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c1fbe-93f2-4aa0-aa14-3a23dbdb0335 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:34.850222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c1fbe-93f2-4aa0-aa14-3a23dbdb0335 None admin] PATH_INFO: `/v3/projects/825c0a32cec14362832790f3c8342cab` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:34.851388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c1fbe-93f2-4aa0-aa14-3a23dbdb0335 None admin] RBAC: Authorizing `identity:get_project(project_id=825c0a32cec14362832790f3c8342cab)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:34.852811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c1fbe-93f2-4aa0-aa14-3a23dbdb0335 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:34.854399 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 581/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:07:34 2022] GET /identity/v3/projects/825c0a32cec14362832790f3c8342cab => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:34.860925 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df526dea-a89e-49b7-8294-ccc95b5a2f77 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:34.956870 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df526dea-a89e-49b7-8294-ccc95b5a2f77 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:34.989483 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29971c39-dc6f-43d6-be29-e5ebd2f1fb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:34.990128 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29971c39-dc6f-43d6-be29-e5ebd2f1fb3a None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:34.990408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29971c39-dc6f-43d6-be29-e5ebd2f1fb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:34.990682 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29971c39-dc6f-43d6-be29-e5ebd2f1fb3a None admin] PATH_INFO: `/v3/projects/825c0a32cec14362832790f3c8342cab/users/69ccd08b9759436981d08e5f2698be9b/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:34.992574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29971c39-dc6f-43d6-be29-e5ebd2f1fb3a None admin] RBAC: Authorizing `identity:create_grant(project_id=825c0a32cec14362832790f3c8342cab, user_id=69ccd08b9759436981d08e5f2698be9b, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:34.993993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29971c39-dc6f-43d6-be29-e5ebd2f1fb3a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:35.002802 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:35.007845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 572/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:07:34 2022] PUT /identity/v3/projects/825c0a32cec14362832790f3c8342cab/users/69ccd08b9759436981d08e5f2698be9b/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:07:37.129957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937e9f4-aaab-4057-830b-05ea69fa9c95 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:37.130527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937e9f4-aaab-4057-830b-05ea69fa9c95 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:37.130527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937e9f4-aaab-4057-830b-05ea69fa9c95 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:37.131888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 582/1154] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:37.137157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9cc4-6280-4c90-aa8a-8087e0e18b20 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:37.137558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9cc4-6280-4c90-aa8a-8087e0e18b20 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:37.137706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9cc4-6280-4c90-aa8a-8087e0e18b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:37.155654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1edf9cc4-6280-4c90-aa8a-8087e0e18b20 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:37.157103 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1edf9cc4-6280-4c90-aa8a-8087e0e18b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:37.222879 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 573/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:37.493462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937e9f4-aaab-4057-830b-05ea69fa9c95 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:37.524323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:37.595297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937e9f4-aaab-4057-830b-05ea69fa9c95 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:37.627315 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fd3d8-fcb7-4994-9690-d8b27396c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:37.627924 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fd3d8-fcb7-4994-9690-d8b27396c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:37.628200 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fd3d8-fcb7-4994-9690-d8b27396c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:37.628471 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fd3d8-fcb7-4994-9690-d8b27396c6a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:37.638627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fd3d8-fcb7-4994-9690-d8b27396c6a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-466fd3d8-fcb7-4994-9690-d8b27396c6a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:07:37.643929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:37.645047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:37.645920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:37.645920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:37.645920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:37.645920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:37.645920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:07:37.645920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:07:37.645920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:07:37.645920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:07:37.645920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:07:37.645920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:07:37.645920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:37.645920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:07:37.645920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 583/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:07:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:07:37.651165 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf9cc4-6280-4c90-aa8a-8087e0e18b20 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:37.746637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf9cc4-6280-4c90-aa8a-8087e0e18b20 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:37.773577 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:37.779367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ce383-16c1-4894-be9c-267adb5d8fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:37.779961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ce383-16c1-4894-be9c-267adb5d8fbd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:37.780240 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ce383-16c1-4894-be9c-267adb5d8fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:37.780510 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ce383-16c1-4894-be9c-267adb5d8fbd None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:37.781729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ce383-16c1-4894-be9c-267adb5d8fbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:37.782118 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ce383-16c1-4894-be9c-267adb5d8fbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:37.783502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ce383-16c1-4894-be9c-267adb5d8fbd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:37.791212 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 574/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:07:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:37.797511 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fd3d8-fcb7-4994-9690-d8b27396c6a3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:37.885003 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:37.895263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fd3d8-fcb7-4994-9690-d8b27396c6a3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:37.927591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2deabc1-c38e-48fa-bd01-2e5982aa9e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:37.928199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2deabc1-c38e-48fa-bd01-2e5982aa9e40 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:37.928474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2deabc1-c38e-48fa-bd01-2e5982aa9e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:37.928744 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2deabc1-c38e-48fa-bd01-2e5982aa9e40 None admin] PATH_INFO: `/v3/users/69ccd08b9759436981d08e5f2698be9b` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:37.929832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2deabc1-c38e-48fa-bd01-2e5982aa9e40 None admin] RBAC: Authorizing `identity:get_user(user_id=69ccd08b9759436981d08e5f2698be9b)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:37.931272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2deabc1-c38e-48fa-bd01-2e5982aa9e40 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:37.932811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 584/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:07:37 2022] GET /identity/v3/users/69ccd08b9759436981d08e5f2698be9b => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:37.938966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ce383-16c1-4894-be9c-267adb5d8fbd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:38.035139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ce383-16c1-4894-be9c-267adb5d8fbd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:38.066963 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819ca4e-e744-4015-b816-f1e9d5b8b266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:38.067578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819ca4e-e744-4015-b816-f1e9d5b8b266 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:38.067852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819ca4e-e744-4015-b816-f1e9d5b8b266 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:38.068122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819ca4e-e744-4015-b816-f1e9d5b8b266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:38.122585 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:38.132970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819ca4e-e744-4015-b816-f1e9d5b8b266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:38.134390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819ca4e-e744-4015-b816-f1e9d5b8b266 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:38.227985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 575/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:07:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 01:07:38.234730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2deabc1-c38e-48fa-bd01-2e5982aa9e40 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:38.333161 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2deabc1-c38e-48fa-bd01-2e5982aa9e40 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:38.365410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068967d-e659-415f-ac0f-177b5e06b506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:38.366022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068967d-e659-415f-ac0f-177b5e06b506 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:38.366297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068967d-e659-415f-ac0f-177b5e06b506 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:38.366575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068967d-e659-415f-ac0f-177b5e06b506 None admin] PATH_INFO: `/v3/projects/825c0a32cec14362832790f3c8342cab` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:38.367660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068967d-e659-415f-ac0f-177b5e06b506 None admin] RBAC: Authorizing `identity:get_project(project_id=825c0a32cec14362832790f3c8342cab)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:38.369071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068967d-e659-415f-ac0f-177b5e06b506 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:38.370650 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 585/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:07:38 2022] GET /identity/v3/projects/825c0a32cec14362832790f3c8342cab => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:38.377482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819ca4e-e744-4015-b816-f1e9d5b8b266 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:38.463705 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:38.473171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819ca4e-e744-4015-b816-f1e9d5b8b266 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:38.507220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fbbee-6cb1-443f-931a-949f1af83e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:38.507806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fbbee-6cb1-443f-931a-949f1af83e5c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:38.508080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fbbee-6cb1-443f-931a-949f1af83e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:38.508348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fbbee-6cb1-443f-931a-949f1af83e5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:38.509055 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fbbee-6cb1-443f-931a-949f1af83e5c None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=825c0a32cec14362832790f3c8342cab, user.id=69ccd08b9759436981d08e5f2698be9b) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:38.509358 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fbbee-6cb1-443f-931a-949f1af83e5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:38.510759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fbbee-6cb1-443f-931a-949f1af83e5c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:38.517238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 576/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:07:38 2022] GET /identity/v3/role_assignments?user.id=69ccd08b9759436981d08e5f2698be9b&scope.project.id=825c0a32cec14362832790f3c8342cab&role.id=3799feb4caa64e568971222375957f54 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:40.673063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de4157-bc80-48e1-b30f-ec31fdc9814c None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:40.673601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de4157-bc80-48e1-b30f-ec31fdc9814c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:40.673601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de4157-bc80-48e1-b30f-ec31fdc9814c None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:40.674857 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 586/1162] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:40.680016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cde7e5-7399-42cd-bf92-92debda8b3e4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:40.680451 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cde7e5-7399-42cd-bf92-92debda8b3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:40.680570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cde7e5-7399-42cd-bf92-92debda8b3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:40.698753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f5cde7e5-7399-42cd-bf92-92debda8b3e4 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:40.700209 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f5cde7e5-7399-42cd-bf92-92debda8b3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:40.763381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 577/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:41.033165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de4157-bc80-48e1-b30f-ec31fdc9814c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:41.060701 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:41.134747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de4157-bc80-48e1-b30f-ec31fdc9814c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:41.167443 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c7557-a9b7-499f-9c46-a09be988f3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:41.168036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c7557-a9b7-499f-9c46-a09be988f3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:41.168314 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c7557-a9b7-499f-9c46-a09be988f3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:41.168584 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c7557-a9b7-499f-9c46-a09be988f3d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:41.233831 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c7557-a9b7-499f-9c46-a09be988f3d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:41.235819 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c7557-a9b7-499f-9c46-a09be988f3d8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:41.260264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:41.332368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 587/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:07:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 01:07:41.338253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cde7e5-7399-42cd-bf92-92debda8b3e4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:41.419820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:41.435104 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cde7e5-7399-42cd-bf92-92debda8b3e4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:41.468044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3651-1157-4142-93a5-9cfe5b94fc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:41.469031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3651-1157-4142-93a5-9cfe5b94fc83 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:41.469309 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3651-1157-4142-93a5-9cfe5b94fc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:41.469579 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3651-1157-4142-93a5-9cfe5b94fc83 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:41.475950 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd3651-1157-4142-93a5-9cfe5b94fc83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:41.477367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd3651-1157-4142-93a5-9cfe5b94fc83 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-adcd3651-1157-4142-93a5-9cfe5b94fc83 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:41.489160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:41.490364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:41.491474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:41.491474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:41.491474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:41.491474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:41.491474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:41.491474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:41.491474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:41.491474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:41.491474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:41.491474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:41.491474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 13 01:07:41.491474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:07:41.491474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 01:07:41.491474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:41.491474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 578/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 13 01:07:41 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:07:41.496409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c7557-a9b7-499f-9c46-a09be988f3d8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:41.593687 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c7557-a9b7-499f-9c46-a09be988f3d8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:41.618437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:41.627834 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49515ea-a63f-4211-bc63-e17607c67d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:41.628420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49515ea-a63f-4211-bc63-e17607c67d33 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:41.628699 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49515ea-a63f-4211-bc63-e17607c67d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:41.628973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49515ea-a63f-4211-bc63-e17607c67d33 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:41.629606 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49515ea-a63f-4211-bc63-e17607c67d33 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:41.629907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49515ea-a63f-4211-bc63-e17607c67d33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:41.631301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49515ea-a63f-4211-bc63-e17607c67d33 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:41.638213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 588/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 13 01:07:41 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:43.768861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cec444-99bc-475e-9bc7-852be662173d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:43.769371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cec444-99bc-475e-9bc7-852be662173d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:43.769465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cec444-99bc-475e-9bc7-852be662173d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:43.770729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 579/1167] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:43.775879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fc8ab-cc78-4cfa-bc94-6078902ff8d5 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:43.776314 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fc8ab-cc78-4cfa-bc94-6078902ff8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:43.776407 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fc8ab-cc78-4cfa-bc94-6078902ff8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:43.794070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-709fc8ab-cc78-4cfa-bc94-6078902ff8d5 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:43.795289 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-709fc8ab-cc78-4cfa-bc94-6078902ff8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:43.860260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 589/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:44.133953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cec444-99bc-475e-9bc7-852be662173d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:44.232776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cec444-99bc-475e-9bc7-852be662173d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:44.265766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e6223-83d1-4562-b3c3-e57a00b5243b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:44.266560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e6223-83d1-4562-b3c3-e57a00b5243b None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:44.266839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e6223-83d1-4562-b3c3-e57a00b5243b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:44.267135 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e6223-83d1-4562-b3c3-e57a00b5243b None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:44.267802 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e6223-83d1-4562-b3c3-e57a00b5243b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:44.269150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e6223-83d1-4562-b3c3-e57a00b5243b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:44.284325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 580/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Tue Sep 13 01:07:44 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:07:46.440255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cd42e-04d9-454d-a999-c2c0f77affb5 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:46.440666 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cd42e-04d9-454d-a999-c2c0f77affb5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:46.440813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cd42e-04d9-454d-a999-c2c0f77affb5 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:46.442175 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 590/1170] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:46.447454 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b3c52-fa2a-4f71-b864-8b6eb0174dbb None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:46.447859 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b3c52-fa2a-4f71-b864-8b6eb0174dbb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:46.448009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b3c52-fa2a-4f71-b864-8b6eb0174dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:46.461161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:46.466959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-073b3c52-fa2a-4f71-b864-8b6eb0174dbb None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:46.468861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-073b3c52-fa2a-4f71-b864-8b6eb0174dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:46.533686 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 581/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:46.808031 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cd42e-04d9-454d-a999-c2c0f77affb5 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:46.906567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cd42e-04d9-454d-a999-c2c0f77affb5 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:46.926156 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:46.940608 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6f563-e311-40fe-a1c9-b26d12d50828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:46.941229 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6f563-e311-40fe-a1c9-b26d12d50828 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:46.941508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6f563-e311-40fe-a1c9-b26d12d50828 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:46.941781 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6f563-e311-40fe-a1c9-b26d12d50828 None admin] PATH_INFO: `/v3/domains/ea10d38dade74fc89282a6ce01a572dd` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:46.952245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6f563-e311-40fe-a1c9-b26d12d50828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ea10d38dade74fc89282a6ce01a572dd)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:46.953668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6f563-e311-40fe-a1c9-b26d12d50828 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:46.955264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 591/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Tue Sep 13 01:07:46 2022] GET /identity/v3/domains/ea10d38dade74fc89282a6ce01a572dd => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:46.961022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b3c52-fa2a-4f71-b864-8b6eb0174dbb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:47.055304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b3c52-fa2a-4f71-b864-8b6eb0174dbb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:47.087219 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe593d7f-5e94-4995-9b9d-14a09d485972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:47.087751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe593d7f-5e94-4995-9b9d-14a09d485972 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:47.088027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe593d7f-5e94-4995-9b9d-14a09d485972 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:47.088296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe593d7f-5e94-4995-9b9d-14a09d485972 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:47.088930 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe593d7f-5e94-4995-9b9d-14a09d485972 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:47.090340 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe593d7f-5e94-4995-9b9d-14a09d485972 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:47.096288 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:47.117118 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 582/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 13 01:07:46 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:07:49.288114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957790a9-eec0-4e7b-a645-720d8e7fc94e None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:49.288646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957790a9-eec0-4e7b-a645-720d8e7fc94e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:49.288646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957790a9-eec0-4e7b-a645-720d8e7fc94e None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:49.289996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 592/1174] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:49.295265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94e9ca-f0e7-421b-8732-cd9faa163666 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:49.295645 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94e9ca-f0e7-421b-8732-cd9faa163666 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:49.295817 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94e9ca-f0e7-421b-8732-cd9faa163666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:49.314297 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1e94e9ca-f0e7-421b-8732-cd9faa163666 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:49.315555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1e94e9ca-f0e7-421b-8732-cd9faa163666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:49.380537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 583/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:49.657622 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957790a9-eec0-4e7b-a645-720d8e7fc94e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:49.760973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957790a9-eec0-4e7b-a645-720d8e7fc94e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:49.793188 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3502f-6c52-4da3-b792-606b2eee59fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:49.793812 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3502f-6c52-4da3-b792-606b2eee59fd None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:49.794093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3502f-6c52-4da3-b792-606b2eee59fd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:49.794371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3502f-6c52-4da3-b792-606b2eee59fd None admin] PATH_INFO: `/v3/domains/ea10d38dade74fc89282a6ce01a572dd` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:49.795506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3502f-6c52-4da3-b792-606b2eee59fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=ea10d38dade74fc89282a6ce01a572dd)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:49.797615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3502f-6c52-4da3-b792-606b2eee59fd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:49.799193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 593/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Tue Sep 13 01:07:49 2022] GET /identity/v3/domains/ea10d38dade74fc89282a6ce01a572dd => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:49.805083 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94e9ca-f0e7-421b-8732-cd9faa163666 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:49.899111 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94e9ca-f0e7-421b-8732-cd9faa163666 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:49.915436 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:49.933097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fda96-1f2d-43d1-b672-73ca229d63c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:49.933692 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fda96-1f2d-43d1-b672-73ca229d63c3 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:49.933970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fda96-1f2d-43d1-b672-73ca229d63c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:49.934242 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fda96-1f2d-43d1-b672-73ca229d63c3 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:49.934886 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fda96-1f2d-43d1-b672-73ca229d63c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:49.936340 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fda96-1f2d-43d1-b672-73ca229d63c3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:49.957773 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 584/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:07:49 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:07:52.133918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07d5e1-7a93-4635-9f7b-2777ccc5fdc8 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:52.134480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07d5e1-7a93-4635-9f7b-2777ccc5fdc8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:52.134480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07d5e1-7a93-4635-9f7b-2777ccc5fdc8 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:52.135845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 594/1178] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:52.141918 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b83d6-b350-423c-a856-d0ecaf603f7a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:52.142316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b83d6-b350-423c-a856-d0ecaf603f7a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:52.142460 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b83d6-b350-423c-a856-d0ecaf603f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:52.161069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-145b83d6-b350-423c-a856-d0ecaf603f7a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:52.162238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-145b83d6-b350-423c-a856-d0ecaf603f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:52.226491 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 585/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:52.498106 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07d5e1-7a93-4635-9f7b-2777ccc5fdc8 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:52.547967 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:52.599553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07d5e1-7a93-4635-9f7b-2777ccc5fdc8 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:52.632415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039bcfc-5eaf-4eef-a93d-24bf8496de13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:52.633026 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039bcfc-5eaf-4eef-a93d-24bf8496de13 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:52.633304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039bcfc-5eaf-4eef-a93d-24bf8496de13 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:52.633575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039bcfc-5eaf-4eef-a93d-24bf8496de13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:52.644008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039bcfc-5eaf-4eef-a93d-24bf8496de13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-d039bcfc-5eaf-4eef-a93d-24bf8496de13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:07:52.648706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:52.649795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:52.650813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:52.650813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:52.650813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:52.650813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:52.650813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:07:52.650813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:07:52.650813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:07:52.650813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:07:52.650813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:07:52.650813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:07:52.650813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:52.650813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:07:52.650813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 595/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:07:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:07:52.656072 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b83d6-b350-423c-a856-d0ecaf603f7a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:52.751836 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b83d6-b350-423c-a856-d0ecaf603f7a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:52.753941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:52.784714 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755fe1c-97ce-46a2-92a6-204bac10433b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:52.785304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755fe1c-97ce-46a2-92a6-204bac10433b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:52.785579 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755fe1c-97ce-46a2-92a6-204bac10433b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:52.785845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755fe1c-97ce-46a2-92a6-204bac10433b None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:52.786497 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755fe1c-97ce-46a2-92a6-204bac10433b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:52.786791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755fe1c-97ce-46a2-92a6-204bac10433b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:52.788172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755fe1c-97ce-46a2-92a6-204bac10433b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:52.796310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 586/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:07:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:52.802181 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039bcfc-5eaf-4eef-a93d-24bf8496de13 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:52.899564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039bcfc-5eaf-4eef-a93d-24bf8496de13 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:52.908049 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:52.933035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92110c-0cc0-40ec-8b9d-028fcc55dc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:52.933648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92110c-0cc0-40ec-8b9d-028fcc55dc8c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:52.933925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92110c-0cc0-40ec-8b9d-028fcc55dc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:52.934197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92110c-0cc0-40ec-8b9d-028fcc55dc8c None admin] PATH_INFO: `/v3/users/db009822f7a342b7a83b9395a245bc55` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:52.947527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92110c-0cc0-40ec-8b9d-028fcc55dc8c None admin] RBAC: Authorizing `identity:get_user(user_id=db009822f7a342b7a83b9395a245bc55)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:52.948959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92110c-0cc0-40ec-8b9d-028fcc55dc8c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:52.950939 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 596/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:07:52 2022] GET /identity/v3/users/db009822f7a342b7a83b9395a245bc55 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:52.956554 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755fe1c-97ce-46a2-92a6-204bac10433b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:53.054348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755fe1c-97ce-46a2-92a6-204bac10433b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:53.086749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642ef8d-5a2f-4391-9a0b-a6e8e4a12490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:53.087363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642ef8d-5a2f-4391-9a0b-a6e8e4a12490 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:53.087637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642ef8d-5a2f-4391-9a0b-a6e8e4a12490 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:53.087903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642ef8d-5a2f-4391-9a0b-a6e8e4a12490 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:53.120470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:53.153357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642ef8d-5a2f-4391-9a0b-a6e8e4a12490 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:53.154783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642ef8d-5a2f-4391-9a0b-a6e8e4a12490 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:53.249473 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 587/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:07:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 01:07:53.255368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92110c-0cc0-40ec-8b9d-028fcc55dc8c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:53.352970 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92110c-0cc0-40ec-8b9d-028fcc55dc8c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:53.384833 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8304ba-1053-41c9-a557-324c01dd2c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:53.385445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8304ba-1053-41c9-a557-324c01dd2c2a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:53.385722 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8304ba-1053-41c9-a557-324c01dd2c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:53.385992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8304ba-1053-41c9-a557-324c01dd2c2a None admin] PATH_INFO: `/v3/projects/6fb8b5e0060f45368789a763faeb06ac` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:53.387098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8304ba-1053-41c9-a557-324c01dd2c2a None admin] RBAC: Authorizing `identity:get_project(project_id=6fb8b5e0060f45368789a763faeb06ac)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:53.388518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8304ba-1053-41c9-a557-324c01dd2c2a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:53.390711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 597/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:07:53 2022] GET /identity/v3/projects/6fb8b5e0060f45368789a763faeb06ac => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:53.396759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642ef8d-5a2f-4391-9a0b-a6e8e4a12490 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:53.459889 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:53.493547 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642ef8d-5a2f-4391-9a0b-a6e8e4a12490 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:53.526143 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89057165-339a-422a-9bac-cd7915da1a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:53.526740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89057165-339a-422a-9bac-cd7915da1a00 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:53.527018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89057165-339a-422a-9bac-cd7915da1a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:53.527319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89057165-339a-422a-9bac-cd7915da1a00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:53.528039 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89057165-339a-422a-9bac-cd7915da1a00 None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=6fb8b5e0060f45368789a763faeb06ac, user.id=db009822f7a342b7a83b9395a245bc55) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:53.528347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89057165-339a-422a-9bac-cd7915da1a00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:53.529764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89057165-339a-422a-9bac-cd7915da1a00 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:53.535664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 588/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:07:53 2022] GET /identity/v3/role_assignments?user.id=db009822f7a342b7a83b9395a245bc55&scope.project.id=6fb8b5e0060f45368789a763faeb06ac&role.id=3799feb4caa64e568971222375957f54 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:55.654343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2982aa-b756-4970-b48e-c2b59dc9a0eb None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:55.654865 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2982aa-b756-4970-b48e-c2b59dc9a0eb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:55.654865 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2982aa-b756-4970-b48e-c2b59dc9a0eb None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:55.657134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 598/1186] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:55.662293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daea91-e3aa-489b-9ff3-b2016eac8910 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:55.662699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daea91-e3aa-489b-9ff3-b2016eac8910 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:55.662848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daea91-e3aa-489b-9ff3-b2016eac8910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:55.680765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-99daea91-e3aa-489b-9ff3-b2016eac8910 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:55.681897 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-99daea91-e3aa-489b-9ff3-b2016eac8910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:55.747882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 589/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:07:56.018331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2982aa-b756-4970-b48e-c2b59dc9a0eb None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:56.052974 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:56.117362 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2982aa-b756-4970-b48e-c2b59dc9a0eb None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:56.149161 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae31ff0-2389-48a9-ac95-eb28a119d36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:56.149805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae31ff0-2389-48a9-ac95-eb28a119d36e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:56.150078 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae31ff0-2389-48a9-ac95-eb28a119d36e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:56.150347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae31ff0-2389-48a9-ac95-eb28a119d36e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:56.160774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae31ff0-2389-48a9-ac95-eb28a119d36e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-cae31ff0-2389-48a9-ac95-eb28a119d36e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:07:56.165487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:56.166558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:56.167803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:56.167803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:56.167803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:56.167803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:56.167803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:07:56.167803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:07:56.167803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:07:56.167803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:07:56.167803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:07:56.167803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:07:56.167803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:56.167803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:07:56.167803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 599/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:07:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:07:56.173306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99daea91-e3aa-489b-9ff3-b2016eac8910 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:56.229937 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:56.269281 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99daea91-e3aa-489b-9ff3-b2016eac8910 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:56.302197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f05988-90cd-4017-94c9-e1baae4beb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:56.302794 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f05988-90cd-4017-94c9-e1baae4beb93 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:56.303096 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f05988-90cd-4017-94c9-e1baae4beb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:56.303377 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f05988-90cd-4017-94c9-e1baae4beb93 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:56.304036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f05988-90cd-4017-94c9-e1baae4beb93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:56.304342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f05988-90cd-4017-94c9-e1baae4beb93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:56.305694 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f05988-90cd-4017-94c9-e1baae4beb93 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:56.313491 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 590/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:07:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:07:56.319226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae31ff0-2389-48a9-ac95-eb28a119d36e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:56.410928 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:56.418326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae31ff0-2389-48a9-ac95-eb28a119d36e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:56.451785 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e453b-869a-40b0-b3eb-eb5c5355f7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:56.453264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e453b-869a-40b0-b3eb-eb5c5355f7bf None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:56.453558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e453b-869a-40b0-b3eb-eb5c5355f7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:56.453815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e453b-869a-40b0-b3eb-eb5c5355f7bf None admin] PATH_INFO: `/v3/users/db009822f7a342b7a83b9395a245bc55` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:56.454918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e453b-869a-40b0-b3eb-eb5c5355f7bf None admin] RBAC: Authorizing `identity:get_user(user_id=db009822f7a342b7a83b9395a245bc55)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:56.456374 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e453b-869a-40b0-b3eb-eb5c5355f7bf None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:56.457943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 600/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:07:56 2022] GET /identity/v3/users/db009822f7a342b7a83b9395a245bc55 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:56.463709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f05988-90cd-4017-94c9-e1baae4beb93 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:56.560211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f05988-90cd-4017-94c9-e1baae4beb93 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:56.582001 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:56.594356 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19037c-36fe-4e98-a1c3-98474717ce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:56.594978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19037c-36fe-4e98-a1c3-98474717ce16 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:56.595284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19037c-36fe-4e98-a1c3-98474717ce16 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:56.595559 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19037c-36fe-4e98-a1c3-98474717ce16 None admin] PATH_INFO: `/v3/projects/6fb8b5e0060f45368789a763faeb06ac` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:56.596663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19037c-36fe-4e98-a1c3-98474717ce16 None admin] RBAC: Authorizing `identity:get_project(project_id=6fb8b5e0060f45368789a763faeb06ac)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:56.598095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19037c-36fe-4e98-a1c3-98474717ce16 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:56.599740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 591/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:07:56 2022] GET /identity/v3/projects/6fb8b5e0060f45368789a763faeb06ac => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:56.605611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e453b-869a-40b0-b3eb-eb5c5355f7bf None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:56.701137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e453b-869a-40b0-b3eb-eb5c5355f7bf None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:56.733941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce92243-950f-47af-91d3-0ea89d43a0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:56.734581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce92243-950f-47af-91d3-0ea89d43a0aa None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:56.734858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce92243-950f-47af-91d3-0ea89d43a0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:56.735159 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce92243-950f-47af-91d3-0ea89d43a0aa None admin] PATH_INFO: `/v3/projects/6fb8b5e0060f45368789a763faeb06ac/users/db009822f7a342b7a83b9395a245bc55/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:56.737011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce92243-950f-47af-91d3-0ea89d43a0aa None admin] RBAC: Authorizing `identity:create_grant(project_id=6fb8b5e0060f45368789a763faeb06ac, user_id=db009822f7a342b7a83b9395a245bc55, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:56.738423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce92243-950f-47af-91d3-0ea89d43a0aa None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:56.752707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 601/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:07:56 2022] PUT /identity/v3/projects/6fb8b5e0060f45368789a763faeb06ac/users/db009822f7a342b7a83b9395a245bc55/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:07:58.877348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c2682-09b3-40b4-a733-b3e88a21072d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:58.877902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c2682-09b3-40b4-a733-b3e88a21072d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:58.877902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c2682-09b3-40b4-a733-b3e88a21072d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:58.879263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 592/1193] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:07:58.884576 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de6dbe-056f-4266-a1d7-71703a45567c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:58.884995 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de6dbe-056f-4266-a1d7-71703a45567c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:58.885110 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de6dbe-056f-4266-a1d7-71703a45567c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:58.905090 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a0de6dbe-056f-4266-a1d7-71703a45567c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:07:58.906260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a0de6dbe-056f-4266-a1d7-71703a45567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:07:58.922708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:58.972992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 602/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:07:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:07:59.243640 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c2682-09b3-40b4-a733-b3e88a21072d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:59.343078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c2682-09b3-40b4-a733-b3e88a21072d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:59.375756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530bb77-022b-4208-a215-0bc4204988c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:59.376364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530bb77-022b-4208-a215-0bc4204988c0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:59.376641 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530bb77-022b-4208-a215-0bc4204988c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:59.376912 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530bb77-022b-4208-a215-0bc4204988c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:59.386601 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530bb77-022b-4208-a215-0bc4204988c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-5530bb77-022b-4208-a215-0bc4204988c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:07:59.391890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:07:59.392986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:07:59.393867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:07:59.393867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:07:59.393867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:07:59.393867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:07:59.393867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:07:59.393867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:07:59.393867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:07:59.393867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:07:59.393867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:07:59.393867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:07:59.393867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:07:59.393867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:07:59.393867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 593/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:07:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:07:59.398894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de6dbe-056f-4266-a1d7-71703a45567c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:59.496505 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de6dbe-056f-4266-a1d7-71703a45567c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:59.528659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53498453-f5b0-4c8c-bd9d-107b268e8236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:59.529254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53498453-f5b0-4c8c-bd9d-107b268e8236 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:59.529528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53498453-f5b0-4c8c-bd9d-107b268e8236 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:59.529793 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53498453-f5b0-4c8c-bd9d-107b268e8236 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:59.530512 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53498453-f5b0-4c8c-bd9d-107b268e8236 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:07:59.530811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53498453-f5b0-4c8c-bd9d-107b268e8236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:59.532192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53498453-f5b0-4c8c-bd9d-107b268e8236 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:59.539873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 603/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:07:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:59.547446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530bb77-022b-4208-a215-0bc4204988c0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:59.596739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:59.644778 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530bb77-022b-4208-a215-0bc4204988c0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:59.676858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31887d4b-fecd-4307-b568-1bfa18073fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:59.677465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887d4b-fecd-4307-b568-1bfa18073fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:59.677742 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887d4b-fecd-4307-b568-1bfa18073fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:59.678019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887d4b-fecd-4307-b568-1bfa18073fa9 None admin] PATH_INFO: `/v3/users/db009822f7a342b7a83b9395a245bc55` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:59.679144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31887d4b-fecd-4307-b568-1bfa18073fa9 None admin] RBAC: Authorizing `identity:get_user(user_id=db009822f7a342b7a83b9395a245bc55)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:59.680570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31887d4b-fecd-4307-b568-1bfa18073fa9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:59.682115 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 594/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 13 01:07:59 2022] GET /identity/v3/users/db009822f7a342b7a83b9395a245bc55 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:07:59.688515 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53498453-f5b0-4c8c-bd9d-107b268e8236 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:07:59.704907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:59.792208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53498453-f5b0-4c8c-bd9d-107b268e8236 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:07:59.824541 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a7d1f-2a06-462e-b836-beb1ea7ab0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:07:59.825395 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a7d1f-2a06-462e-b836-beb1ea7ab0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:07:59.825673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a7d1f-2a06-462e-b836-beb1ea7ab0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:07:59.825947 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a7d1f-2a06-462e-b836-beb1ea7ab0d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:07:59.890554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a7d1f-2a06-462e-b836-beb1ea7ab0d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:07:59.892009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a7d1f-2a06-462e-b836-beb1ea7ab0d7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:07:59.905687 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:07:59.987169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 604/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:07:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 01:07:59.993224 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31887d4b-fecd-4307-b568-1bfa18073fa9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:08:00.089422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31887d4b-fecd-4307-b568-1bfa18073fa9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:08:00.105576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:08:00.122488 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093bd72-6321-4ecc-8192-ab367e0db853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:08:00.123136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093bd72-6321-4ecc-8192-ab367e0db853 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:08:00.123417 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093bd72-6321-4ecc-8192-ab367e0db853 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:08:00.124215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093bd72-6321-4ecc-8192-ab367e0db853 None admin] PATH_INFO: `/v3/projects/6fb8b5e0060f45368789a763faeb06ac` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:08:00.125328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093bd72-6321-4ecc-8192-ab367e0db853 None admin] RBAC: Authorizing `identity:get_project(project_id=6fb8b5e0060f45368789a763faeb06ac)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:08:00.126744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093bd72-6321-4ecc-8192-ab367e0db853 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:08:00.128375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 595/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 13 01:07:59 2022] GET /identity/v3/projects/6fb8b5e0060f45368789a763faeb06ac => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:08:00.134519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a7d1f-2a06-462e-b836-beb1ea7ab0d7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:08:00.230114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a7d1f-2a06-462e-b836-beb1ea7ab0d7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:08:00.243931 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:08:00.264228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdeb08-1050-4f6f-8482-d42f89eb96a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:08:00.264944 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdeb08-1050-4f6f-8482-d42f89eb96a0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:08:00.265220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdeb08-1050-4f6f-8482-d42f89eb96a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:08:00.265490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdeb08-1050-4f6f-8482-d42f89eb96a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:08:00.266199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdeb08-1050-4f6f-8482-d42f89eb96a0 None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=6fb8b5e0060f45368789a763faeb06ac, user.id=db009822f7a342b7a83b9395a245bc55) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:08:00.266501 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdeb08-1050-4f6f-8482-d42f89eb96a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:08:00.267945 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdeb08-1050-4f6f-8482-d42f89eb96a0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:08:00.273577 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 605/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:08:00 2022] GET /identity/v3/role_assignments?user.id=db009822f7a342b7a83b9395a245bc55&scope.project.id=6fb8b5e0060f45368789a763faeb06ac&role.id=3799feb4caa64e568971222375957f54 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:08:10.118426 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:08:10.271361 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=11 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:08:56.083466 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd89f1-8829-4520-857d-57475409cd23 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:08:56.084311 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd89f1-8829-4520-857d-57475409cd23 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:08:56.084311 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd89f1-8829-4520-857d-57475409cd23 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:08:56.085526 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 596/1201] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:08:56.091892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a55833-1c3a-4309-b8b1-41e4a4b16b75 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:08:56.092452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a55833-1c3a-4309-b8b1-41e4a4b16b75 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:08:56.092671 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a55833-1c3a-4309-b8b1-41e4a4b16b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:08:56.123232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-78a55833-1c3a-4309-b8b1-41e4a4b16b75 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:08:56.124717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-78a55833-1c3a-4309-b8b1-41e4a4b16b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:08:56.229394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 606/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:08:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:08:56.534815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd89f1-8829-4520-857d-57475409cd23 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:08:56.667224 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd89f1-8829-4520-857d-57475409cd23 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:08:56.709676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba1901-4ee3-49af-8a00-d6aa28947b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:08:56.710689 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba1901-4ee3-49af-8a00-d6aa28947b24 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:08:56.710938 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba1901-4ee3-49af-8a00-d6aa28947b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:08:56.711363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba1901-4ee3-49af-8a00-d6aa28947b24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:08:56.725652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba1901-4ee3-49af-8a00-d6aa28947b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:08:56.727767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba1901-4ee3-49af-8a00-d6aa28947b24 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-4dba1901-4ee3-49af-8a00-d6aa28947b24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:08:56.747332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:08:56.748470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:08:56.749475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:08:56.749475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:08:56.749475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:08:56.749475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 597/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:08:56.756685 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a55833-1c3a-4309-b8b1-41e4a4b16b75 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:08:56.898007 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a55833-1c3a-4309-b8b1-41e4a4b16b75 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:08:56.932620 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:08:56.941245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbf546-37c2-4317-bae2-6fdd3f66633c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:08:56.941892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbf546-37c2-4317-bae2-6fdd3f66633c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:08:56.942183 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbf546-37c2-4317-bae2-6fdd3f66633c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:08:56.942452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbf546-37c2-4317-bae2-6fdd3f66633c None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:08:56.943144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbf546-37c2-4317-bae2-6fdd3f66633c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:08:56.943453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbf546-37c2-4317-bae2-6fdd3f66633c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:08:56.944817 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbf546-37c2-4317-bae2-6fdd3f66633c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:08:56.963892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 607/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:08:56.966565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba1901-4ee3-49af-8a00-d6aa28947b24 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:08:57.040812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:08:57.103976 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba1901-4ee3-49af-8a00-d6aa28947b24 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:08:57.142726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6aac9-f9d3-4c51-9158-4c2d461da237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:08:57.144883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6aac9-f9d3-4c51-9158-4c2d461da237 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:08:57.144883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6aac9-f9d3-4c51-9158-4c2d461da237 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:08:57.144883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6aac9-f9d3-4c51-9158-4c2d461da237 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:08:57.144883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6aac9-f9d3-4c51-9158-4c2d461da237 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:08:57.148079 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6aac9-f9d3-4c51-9158-4c2d461da237 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:08:57.170544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 598/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 13 01:08:56 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:08:59.509264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e96ef4-01b1-4631-a51e-c7b5fef3db65 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:08:59.509810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e96ef4-01b1-4631-a51e-c7b5fef3db65 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:08:59.509810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e96ef4-01b1-4631-a51e-c7b5fef3db65 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:08:59.511187 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 608/1206] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:08:59.517711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980cf03-6a01-4a93-b5c0-f7a7d6ff3076 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:08:59.518281 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980cf03-6a01-4a93-b5c0-f7a7d6ff3076 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:08:59.518281 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980cf03-6a01-4a93-b5c0-f7a7d6ff3076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:08:59.538689 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f980cf03-6a01-4a93-b5c0-f7a7d6ff3076 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:08:59.539950 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f980cf03-6a01-4a93-b5c0-f7a7d6ff3076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:08:59.621013 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 599/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:08:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:08:59.891375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e96ef4-01b1-4631-a51e-c7b5fef3db65 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:00.011618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e96ef4-01b1-4631-a51e-c7b5fef3db65 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:00.057728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5fce7-2367-4fbf-be50-fdd0ae12247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:00.058462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5fce7-2367-4fbf-be50-fdd0ae12247c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:00.058770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5fce7-2367-4fbf-be50-fdd0ae12247c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:00.059383 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5fce7-2367-4fbf-be50-fdd0ae12247c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:00.077879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5fce7-2367-4fbf-be50-fdd0ae12247c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a3e5fce7-2367-4fbf-be50-fdd0ae12247c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:09:00.091875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:00.096627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:00.097513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:00.097513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:00.097513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:00.097513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:00.097513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:09:00.097513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:09:00.097513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:09:00.097513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:09:00.097513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:09:00.097513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:09:00.097513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:09:00.097513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:00.097513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 609/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:08:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:00.098248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980cf03-6a01-4a93-b5c0-f7a7d6ff3076 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:00.143230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:00.220220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980cf03-6a01-4a93-b5c0-f7a7d6ff3076 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:00.260340 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99f8f-9002-469d-a5e0-2a5f69e79333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:00.261821 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99f8f-9002-469d-a5e0-2a5f69e79333 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:00.261821 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99f8f-9002-469d-a5e0-2a5f69e79333 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:00.261821 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99f8f-9002-469d-a5e0-2a5f69e79333 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:00.262417 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99f8f-9002-469d-a5e0-2a5f69e79333 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:00.262699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99f8f-9002-469d-a5e0-2a5f69e79333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:00.264730 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99f8f-9002-469d-a5e0-2a5f69e79333 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:00.280709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 600/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:09:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:00.283281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5fce7-2367-4fbf-be50-fdd0ae12247c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:00.350521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:00.413582 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5fce7-2367-4fbf-be50-fdd0ae12247c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:00.469272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e969ca-c062-4311-8ae2-c188464dd7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:00.469923 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e969ca-c062-4311-8ae2-c188464dd7ce None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:00.470238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e969ca-c062-4311-8ae2-c188464dd7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:00.470493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e969ca-c062-4311-8ae2-c188464dd7ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:00.482904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e969ca-c062-4311-8ae2-c188464dd7ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:00.484395 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e969ca-c062-4311-8ae2-c188464dd7ce None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-62e969ca-c062-4311-8ae2-c188464dd7ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:09:00.500518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:00.501768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:09:00.503124 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:09:00.503124 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:00.503124 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:00.506483 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 610/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:09:00.507670 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99f8f-9002-469d-a5e0-2a5f69e79333 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:00.630753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:00.634768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99f8f-9002-469d-a5e0-2a5f69e79333 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:00.676390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406002f-8ea9-499e-9cbe-7408cc522d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:00.677164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406002f-8ea9-499e-9cbe-7408cc522d37 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:00.677561 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406002f-8ea9-499e-9cbe-7408cc522d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:00.677922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406002f-8ea9-499e-9cbe-7408cc522d37 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:00.679667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406002f-8ea9-499e-9cbe-7408cc522d37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:00.679667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406002f-8ea9-499e-9cbe-7408cc522d37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:00.680941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406002f-8ea9-499e-9cbe-7408cc522d37 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:00.694559 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 601/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:00.700876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e969ca-c062-4311-8ae2-c188464dd7ce None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:00.830150 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e969ca-c062-4311-8ae2-c188464dd7ce None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:00.832134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:00.874325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0250b-b319-4332-b4fc-60e2e518d06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:00.875054 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0250b-b319-4332-b4fc-60e2e518d06b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:00.875397 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0250b-b319-4332-b4fc-60e2e518d06b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:00.875740 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0250b-b319-4332-b4fc-60e2e518d06b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:00.884716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0250b-b319-4332-b4fc-60e2e518d06b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:00.886166 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0250b-b319-4332-b4fc-60e2e518d06b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-56a0250b-b319-4332-b4fc-60e2e518d06b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:09:00.899544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:00.901246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:00.902233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:00.902233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:00.902233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:09:00.902233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:09:00.902233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:09:00.902233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:09:00.902233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:09:00.902233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:09:00.902233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 01:09:00.902233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:00.902233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 611/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:00.907248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406002f-8ea9-499e-9cbe-7408cc522d37 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:01.019250 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406002f-8ea9-499e-9cbe-7408cc522d37 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:01.057147 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bd8fe-9f6a-4f8c-8b32-d7acbd13460c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:01.057778 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bd8fe-9f6a-4f8c-8b32-d7acbd13460c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:01.058057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bd8fe-9f6a-4f8c-8b32-d7acbd13460c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:01.058328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bd8fe-9f6a-4f8c-8b32-d7acbd13460c None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:01.059122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bd8fe-9f6a-4f8c-8b32-d7acbd13460c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:01.059600 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bd8fe-9f6a-4f8c-8b32-d7acbd13460c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:01.061180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bd8fe-9f6a-4f8c-8b32-d7acbd13460c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:01.087105 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 602/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Sep 13 01:09:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:09:01.092263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0250b-b319-4332-b4fc-60e2e518d06b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:01.212024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0250b-b319-4332-b4fc-60e2e518d06b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:01.249930 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d418f68-f261-486e-8dc3-3d794e0f5277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:01.251033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d418f68-f261-486e-8dc3-3d794e0f5277 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:01.251555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d418f68-f261-486e-8dc3-3d794e0f5277 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:01.252104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d418f68-f261-486e-8dc3-3d794e0f5277 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:01.292154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:01.347563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d418f68-f261-486e-8dc3-3d794e0f5277 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:01.349733 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d418f68-f261-486e-8dc3-3d794e0f5277 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:01.476485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 612/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:09:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 01:09:01.483136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bd8fe-9f6a-4f8c-8b32-d7acbd13460c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:01.505746 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:01.603397 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bd8fe-9f6a-4f8c-8b32-d7acbd13460c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:01.653578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2b526-4ecd-48fc-a041-64a3adced316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:01.654623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2b526-4ecd-48fc-a041-64a3adced316 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:01.654623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2b526-4ecd-48fc-a041-64a3adced316 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:01.654849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2b526-4ecd-48fc-a041-64a3adced316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:01.667666 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2b526-4ecd-48fc-a041-64a3adced316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:01.669412 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2b526-4ecd-48fc-a041-64a3adced316 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-a0e2b526-4ecd-48fc-a041-64a3adced316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:09:01.686241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:01.687944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:09:01.689327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:09:01.689327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:01.689327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:09:01.689327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 603/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:09:01.693926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d418f68-f261-486e-8dc3-3d794e0f5277 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:01.773901 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:01.821914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d418f68-f261-486e-8dc3-3d794e0f5277 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:01.862291 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e16d3-4223-4ce6-a790-998f0028e8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:01.862861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e16d3-4223-4ce6-a790-998f0028e8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:01.863169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e16d3-4223-4ce6-a790-998f0028e8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:01.863445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e16d3-4223-4ce6-a790-998f0028e8c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:01.864124 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e16d3-4223-4ce6-a790-998f0028e8c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:01.864430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e16d3-4223-4ce6-a790-998f0028e8c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:01.865832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e16d3-4223-4ce6-a790-998f0028e8c5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:01.880353 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 613/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:09:01.886966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2b526-4ecd-48fc-a041-64a3adced316 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:01.970509 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:02.004022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2b526-4ecd-48fc-a041-64a3adced316 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:02.040578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e3ccb-a3ef-4ddd-ac52-caaccc140f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:02.041171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e3ccb-a3ef-4ddd-ac52-caaccc140f50 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:02.041448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e3ccb-a3ef-4ddd-ac52-caaccc140f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:02.041725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e3ccb-a3ef-4ddd-ac52-caaccc140f50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:02.049444 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e3ccb-a3ef-4ddd-ac52-caaccc140f50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:02.050922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e3ccb-a3ef-4ddd-ac52-caaccc140f50 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:02.063637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0d8e3ccb-a3ef-4ddd-ac52-caaccc140f50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:09:02.063637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:02.063637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:02.063637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:02.063637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:02.063637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:02.063637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:02.063637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:02.063637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:02.063637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:02.063637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:02.063637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:02.063637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:09:02.063637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:09:02.063637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:02.065095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:02.066009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:09:02.066009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:09:02.066009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:09:02.066009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:09:02.066009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:09:02.066009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:09:02.066009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:09:02.066009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:09:02.066009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 604/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:09:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:02.070985 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e16d3-4223-4ce6-a790-998f0028e8c5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:02.187352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e16d3-4223-4ce6-a790-998f0028e8c5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:02.210195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:02.224254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b9e7c-29b1-4a2f-b4f0-f253972612b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:02.225065 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b9e7c-29b1-4a2f-b4f0-f253972612b8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:02.225375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b9e7c-29b1-4a2f-b4f0-f253972612b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:02.225707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b9e7c-29b1-4a2f-b4f0-f253972612b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:02.226523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b9e7c-29b1-4a2f-b4f0-f253972612b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:02.226954 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b9e7c-29b1-4a2f-b4f0-f253972612b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:02.229062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b9e7c-29b1-4a2f-b4f0-f253972612b8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:02.244025 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 614/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:09:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:09:02.250598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e3ccb-a3ef-4ddd-ac52-caaccc140f50 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:02.358918 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e3ccb-a3ef-4ddd-ac52-caaccc140f50 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:02.388782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:02.395190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac13ad6-f978-4a02-b955-5892bb900a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:02.396422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac13ad6-f978-4a02-b955-5892bb900a73 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:02.396756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac13ad6-f978-4a02-b955-5892bb900a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:02.397059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac13ad6-f978-4a02-b955-5892bb900a73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:02.397823 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac13ad6-f978-4a02-b955-5892bb900a73 None admin] RBAC: Adding query filter params (role.id=e55e17c894314bc6a5772b2de35b4874, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=0c5e6dae854a44a0ad6628e7dd69dfc5) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:02.399184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac13ad6-f978-4a02-b955-5892bb900a73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:02.399731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac13ad6-f978-4a02-b955-5892bb900a73 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:02.406229 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 605/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:09:02 2022] GET /identity/v3/role_assignments?user.id=0c5e6dae854a44a0ad6628e7dd69dfc5&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=e55e17c894314bc6a5772b2de35b4874 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:04.660046 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606657dd-debb-4c4f-85c9-e6e2b6037586 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:04.660627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606657dd-debb-4c4f-85c9-e6e2b6037586 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:04.660627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606657dd-debb-4c4f-85c9-e6e2b6037586 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:04.662156 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 615/1220] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:09:04.667542 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c4718-4844-46dc-8191-47fbec315d89 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:04.667992 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c4718-4844-46dc-8191-47fbec315d89 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:04.668085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c4718-4844-46dc-8191-47fbec315d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:04.688912 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9d1c4718-4844-46dc-8191-47fbec315d89 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:09:04.690291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9d1c4718-4844-46dc-8191-47fbec315d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:09:04.761555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 606/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:09:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 01:09:05.063846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606657dd-debb-4c4f-85c9-e6e2b6037586 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:05.174863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606657dd-debb-4c4f-85c9-e6e2b6037586 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:05.215295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3870e95-60da-44ba-9aea-105f00f80cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:05.216238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3870e95-60da-44ba-9aea-105f00f80cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:05.216522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3870e95-60da-44ba-9aea-105f00f80cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:05.216793 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3870e95-60da-44ba-9aea-105f00f80cd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:05.227958 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3870e95-60da-44ba-9aea-105f00f80cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-f3870e95-60da-44ba-9aea-105f00f80cd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:09:05.233532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:05.234603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:05.235502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:05.235502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:05.235502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:05.235502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:05.235502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:09:05.235502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:09:05.235502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:09:05.235502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:09:05.235502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:09:05.235502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:09:05.235502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:09:05.235502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:05.235502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 616/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:09:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:09:05.241128 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c4718-4844-46dc-8191-47fbec315d89 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:05.347642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c4718-4844-46dc-8191-47fbec315d89 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:05.373190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:05.386155 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ae19a-f911-4537-b71b-abda9a8d710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:05.386798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ae19a-f911-4537-b71b-abda9a8d710f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:05.387620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ae19a-f911-4537-b71b-abda9a8d710f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:05.387881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ae19a-f911-4537-b71b-abda9a8d710f None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:05.388597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ae19a-f911-4537-b71b-abda9a8d710f None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:05.388862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ae19a-f911-4537-b71b-abda9a8d710f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:05.390230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ae19a-f911-4537-b71b-abda9a8d710f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:05.398246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 607/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:09:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:05.405396 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3870e95-60da-44ba-9aea-105f00f80cd2 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:05.458612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:05.520528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3870e95-60da-44ba-9aea-105f00f80cd2 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:05.557886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba6ef0-7644-446f-9763-ff172904df6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:05.558525 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba6ef0-7644-446f-9763-ff172904df6b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:05.558846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba6ef0-7644-446f-9763-ff172904df6b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:05.559093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba6ef0-7644-446f-9763-ff172904df6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:05.569838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba6ef0-7644-446f-9763-ff172904df6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:05.571311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba6ef0-7644-446f-9763-ff172904df6b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a0ba6ef0-7644-446f-9763-ff172904df6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:09:05.587739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:05.589001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:09:05.589938 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:09:05.589938 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:05.589938 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:05.589938 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 617/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:05.595685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ae19a-f911-4537-b71b-abda9a8d710f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:05.701181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ae19a-f911-4537-b71b-abda9a8d710f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:05.743903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707236b-0615-4803-b76c-b7773a301f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:05.744518 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707236b-0615-4803-b76c-b7773a301f70 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:05.744879 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707236b-0615-4803-b76c-b7773a301f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:05.745065 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707236b-0615-4803-b76c-b7773a301f70 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:05.745718 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707236b-0615-4803-b76c-b7773a301f70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:05.746082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707236b-0615-4803-b76c-b7773a301f70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:05.748037 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707236b-0615-4803-b76c-b7773a301f70 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:05.759979 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 608/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:05.766438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba6ef0-7644-446f-9763-ff172904df6b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:05.877152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:05.885812 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba6ef0-7644-446f-9763-ff172904df6b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:05.923985 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ba0b4-91e0-43dc-bccb-a62a9acc961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:05.924614 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ba0b4-91e0-43dc-bccb-a62a9acc961e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:05.924894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ba0b4-91e0-43dc-bccb-a62a9acc961e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:05.925169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ba0b4-91e0-43dc-bccb-a62a9acc961e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:05.934798 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ba0b4-91e0-43dc-bccb-a62a9acc961e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:05.936369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ba0b4-91e0-43dc-bccb-a62a9acc961e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-701ba0b4-91e0-43dc-bccb-a62a9acc961e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:09:05.948020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:05.949088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:05.951400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:05.951400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:05.951400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:09:05.951400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:09:05.951400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:09:05.951400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:09:05.951400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:09:05.951400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:09:05.951400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 01:09:05.951400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:05.951400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 618/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:05.957233 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707236b-0615-4803-b76c-b7773a301f70 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:06.012748 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:06.068819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707236b-0615-4803-b76c-b7773a301f70 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:06.116929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b6bdb-8b58-42ed-9ce1-ffa0e157cb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:06.117613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b6bdb-8b58-42ed-9ce1-ffa0e157cb82 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:06.117907 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b6bdb-8b58-42ed-9ce1-ffa0e157cb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:06.118286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b6bdb-8b58-42ed-9ce1-ffa0e157cb82 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:06.119016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b6bdb-8b58-42ed-9ce1-ffa0e157cb82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:06.119346 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b6bdb-8b58-42ed-9ce1-ffa0e157cb82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:06.120899 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b6bdb-8b58-42ed-9ce1-ffa0e157cb82 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:06.140989 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 609/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Sep 13 01:09:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:06.147359 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ba0b4-91e0-43dc-bccb-a62a9acc961e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:06.283728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ba0b4-91e0-43dc-bccb-a62a9acc961e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:06.323891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0663f-3ad5-4d35-8162-7472f18f276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:06.324681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0663f-3ad5-4d35-8162-7472f18f276e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:06.325424 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0663f-3ad5-4d35-8162-7472f18f276e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:06.325761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0663f-3ad5-4d35-8162-7472f18f276e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:06.337419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0663f-3ad5-4d35-8162-7472f18f276e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:06.338960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0663f-3ad5-4d35-8162-7472f18f276e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-74b0663f-3ad5-4d35-8162-7472f18f276e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:09:06.354750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:06.357020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:09:06.358212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:09:06.358212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:06.358212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:06.358212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 619/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:06.362414 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b6bdb-8b58-42ed-9ce1-ffa0e157cb82 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:06.470267 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b6bdb-8b58-42ed-9ce1-ffa0e157cb82 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:06.472736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:06.507247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c4194-a5e5-49da-9fd6-672ca602fb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:06.507853 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c4194-a5e5-49da-9fd6-672ca602fb95 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:06.508129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c4194-a5e5-49da-9fd6-672ca602fb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:06.508397 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c4194-a5e5-49da-9fd6-672ca602fb95 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:06.509032 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c4194-a5e5-49da-9fd6-672ca602fb95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:06.509331 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c4194-a5e5-49da-9fd6-672ca602fb95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:06.510676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c4194-a5e5-49da-9fd6-672ca602fb95 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:06.522824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 610/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:09:06.529373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0663f-3ad5-4d35-8162-7472f18f276e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:06.539141 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:06.639172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0663f-3ad5-4d35-8162-7472f18f276e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:06.677822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd7ad1-be33-4b57-be2d-ab6d2a5a134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:06.678451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd7ad1-be33-4b57-be2d-ab6d2a5a134c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:06.678733 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd7ad1-be33-4b57-be2d-ab6d2a5a134c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:06.679011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd7ad1-be33-4b57-be2d-ab6d2a5a134c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:06.686126 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd7ad1-be33-4b57-be2d-ab6d2a5a134c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:06.687638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd7ad1-be33-4b57-be2d-ab6d2a5a134c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:06.699469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-becd7ad1-be33-4b57-be2d-ab6d2a5a134c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:09:06.699469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:06.699469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:06.699469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:06.699469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:06.699469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:06.699469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:06.699469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:06.699469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:06.699469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:06.699469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:06.699469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:06.699469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:09:06.699469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:09:06.699469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:06.701212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:06.702198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:09:06.702198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:09:06.702198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:09:06.702198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:09:06.702198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:09:06.702198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:09:06.702198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:09:06.702198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:06.702198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 620/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:09:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:09:06.707281 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c4194-a5e5-49da-9fd6-672ca602fb95 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:06.817975 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c4194-a5e5-49da-9fd6-672ca602fb95 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:06.854627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a6164-d5ac-4cd7-a2b4-7db0a2840ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:06.855233 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a6164-d5ac-4cd7-a2b4-7db0a2840ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:06.855512 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a6164-d5ac-4cd7-a2b4-7db0a2840ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:06.855904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a6164-d5ac-4cd7-a2b4-7db0a2840ab5 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:06.856740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a6164-d5ac-4cd7-a2b4-7db0a2840ab5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:06.857064 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a6164-d5ac-4cd7-a2b4-7db0a2840ab5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:06.858477 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a6164-d5ac-4cd7-a2b4-7db0a2840ab5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:06.871638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 611/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:09:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:06.877503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd7ad1-be33-4b57-be2d-ab6d2a5a134c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:06.944851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:06.981508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd7ad1-be33-4b57-be2d-ab6d2a5a134c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:07.016994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8b522-eb16-47a4-95ee-2dca12651dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:07.017649 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8b522-eb16-47a4-95ee-2dca12651dd7 None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:07.017931 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8b522-eb16-47a4-95ee-2dca12651dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:07.018207 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8b522-eb16-47a4-95ee-2dca12651dd7 None admin] PATH_INFO: `/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/0c5e6dae854a44a0ad6628e7dd69dfc5/roles/e55e17c894314bc6a5772b2de35b4874` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:07.033297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8b522-eb16-47a4-95ee-2dca12651dd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe73ceb0a582452b9b636a701adafb6f, user_id=0c5e6dae854a44a0ad6628e7dd69dfc5, role_id=e55e17c894314bc6a5772b2de35b4874)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:07.034758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8b522-eb16-47a4-95ee-2dca12651dd7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:07.047940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 621/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:09:06 2022] PUT /identity/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/0c5e6dae854a44a0ad6628e7dd69dfc5/roles/e55e17c894314bc6a5772b2de35b4874 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:09:09.330129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbea5f-92d6-4db8-be3b-17a7144f51b4 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:09.331615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbea5f-92d6-4db8-be3b-17a7144f51b4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:09.331615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbea5f-92d6-4db8-be3b-17a7144f51b4 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:09.332065 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 612/1233] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:09:09.337412 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec274ab2-e87a-459e-8328-ded0b93a73d7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:09.337861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec274ab2-e87a-459e-8328-ded0b93a73d7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:09.338011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec274ab2-e87a-459e-8328-ded0b93a73d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:09.358522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ec274ab2-e87a-459e-8328-ded0b93a73d7 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:09:09.359852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ec274ab2-e87a-459e-8328-ded0b93a73d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:09:09.433010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 622/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:09:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:09:09.703618 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbea5f-92d6-4db8-be3b-17a7144f51b4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:09.732772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:09.826674 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbea5f-92d6-4db8-be3b-17a7144f51b4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:09.866891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ddfe5-c59f-49e1-bdb0-e09829f632c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:09.867551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ddfe5-c59f-49e1-bdb0-e09829f632c6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:09.867829 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ddfe5-c59f-49e1-bdb0-e09829f632c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:09.868098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ddfe5-c59f-49e1-bdb0-e09829f632c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:09.880378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ddfe5-c59f-49e1-bdb0-e09829f632c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-3e7ddfe5-c59f-49e1-bdb0-e09829f632c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:09:09.885086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:09.886190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:09.888205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:09.888205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:09.888205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:09.888205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:09.888205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:09:09.888205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:09:09.888205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:09:09.888205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:09:09.888205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:09:09.888205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:09:09.888205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 01:09:09.888205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:09:09.888205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 613/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 13 01:09:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:09.893061 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec274ab2-e87a-459e-8328-ded0b93a73d7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:09.946726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:10.004995 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec274ab2-e87a-459e-8328-ded0b93a73d7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:10.040349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd6c00-bd3a-4449-a55a-307d026eedb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:10.041011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd6c00-bd3a-4449-a55a-307d026eedb6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:10.041291 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd6c00-bd3a-4449-a55a-307d026eedb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:10.041611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd6c00-bd3a-4449-a55a-307d026eedb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:10.042247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd6c00-bd3a-4449-a55a-307d026eedb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:10.042553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd6c00-bd3a-4449-a55a-307d026eedb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:10.044281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd6c00-bd3a-4449-a55a-307d026eedb6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:10.053010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 623/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 13 01:09:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:10.059982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ddfe5-c59f-49e1-bdb0-e09829f632c6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:10.161289 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:10.178180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ddfe5-c59f-49e1-bdb0-e09829f632c6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:10.224203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb2854-d3f4-4760-95ba-494f9dcf0484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:10.224937 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb2854-d3f4-4760-95ba-494f9dcf0484 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:10.225214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb2854-d3f4-4760-95ba-494f9dcf0484 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:10.225482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb2854-d3f4-4760-95ba-494f9dcf0484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:10.239299 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb2854-d3f4-4760-95ba-494f9dcf0484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:10.241298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb2854-d3f4-4760-95ba-494f9dcf0484 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-39bb2854-d3f4-4760-95ba-494f9dcf0484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:09:10.261019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:10.262715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:09:10.263680 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:09:10.263680 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:10.263680 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:09:10.263680 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 614/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:10.269552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd6c00-bd3a-4449-a55a-307d026eedb6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:10.380362 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd6c00-bd3a-4449-a55a-307d026eedb6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:10.393889 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:10.422252 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c10d22-06c3-461e-83e6-a72a0daae213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:10.422642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c10d22-06c3-461e-83e6-a72a0daae213 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:10.422955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c10d22-06c3-461e-83e6-a72a0daae213 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:10.423245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c10d22-06c3-461e-83e6-a72a0daae213 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:10.424009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c10d22-06c3-461e-83e6-a72a0daae213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:10.424381 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c10d22-06c3-461e-83e6-a72a0daae213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:10.425849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c10d22-06c3-461e-83e6-a72a0daae213 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:10.438935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 624/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:10.445017 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb2854-d3f4-4760-95ba-494f9dcf0484 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:10.560010 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb2854-d3f4-4760-95ba-494f9dcf0484 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:10.599139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bc67f-8856-482c-8cc0-d83d7814e095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:10.599920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bc67f-8856-482c-8cc0-d83d7814e095 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:10.600316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bc67f-8856-482c-8cc0-d83d7814e095 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:10.600708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bc67f-8856-482c-8cc0-d83d7814e095 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:10.603878 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:10.611099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bc67f-8856-482c-8cc0-d83d7814e095 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:10.612979 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bc67f-8856-482c-8cc0-d83d7814e095 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-572bc67f-8856-482c-8cc0-d83d7814e095 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:09:10.626440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:10.627599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:10.628636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:10.628636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:10.628636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:09:10.628636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:09:10.628636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:09:10.628636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:09:10.628636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:09:10.628636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:09:10.628636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 01:09:10.628636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:09:10.628636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 615/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:10.634631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c10d22-06c3-461e-83e6-a72a0daae213 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:10.745154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c10d22-06c3-461e-83e6-a72a0daae213 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:10.783542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c017198-4b28-4db3-b714-14910ae67228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:10.784222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c017198-4b28-4db3-b714-14910ae67228 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:10.784541 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c017198-4b28-4db3-b714-14910ae67228 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:10.784809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c017198-4b28-4db3-b714-14910ae67228 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:10.785615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c017198-4b28-4db3-b714-14910ae67228 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:10.785914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c017198-4b28-4db3-b714-14910ae67228 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:10.787524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c017198-4b28-4db3-b714-14910ae67228 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:10.809999 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 625/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Sep 13 01:09:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:10.816177 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bc67f-8856-482c-8cc0-d83d7814e095 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:10.927290 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bc67f-8856-482c-8cc0-d83d7814e095 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:10.964417 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fe4ea-60f2-4ea5-aa6e-7061749e27d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:10.965634 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fe4ea-60f2-4ea5-aa6e-7061749e27d8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:10.965843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fe4ea-60f2-4ea5-aa6e-7061749e27d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:10.966261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fe4ea-60f2-4ea5-aa6e-7061749e27d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:11.037637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:11.044977 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fe4ea-60f2-4ea5-aa6e-7061749e27d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:11.046444 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fe4ea-60f2-4ea5-aa6e-7061749e27d8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:11.166472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 616/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:09:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 01:09:11.173438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c017198-4b28-4db3-b714-14910ae67228 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:11.205448 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:11.292509 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c017198-4b28-4db3-b714-14910ae67228 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:11.336009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428b775-1726-42ca-9ba0-35c4adb96362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:11.336730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428b775-1726-42ca-9ba0-35c4adb96362 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:11.337021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428b775-1726-42ca-9ba0-35c4adb96362 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:11.337323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428b775-1726-42ca-9ba0-35c4adb96362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:11.348787 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428b775-1726-42ca-9ba0-35c4adb96362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:11.350320 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428b775-1726-42ca-9ba0-35c4adb96362 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-b428b775-1726-42ca-9ba0-35c4adb96362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:09:11.366220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:11.367270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:09:11.368185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:09:11.368185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:11.368185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:11.368185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 626/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:11.374147 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fe4ea-60f2-4ea5-aa6e-7061749e27d8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:11.489319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:11.499764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fe4ea-60f2-4ea5-aa6e-7061749e27d8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:11.542431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4c2f9-3002-4f37-8364-9fe2b1ab20cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:11.544030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4c2f9-3002-4f37-8364-9fe2b1ab20cc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:11.544419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4c2f9-3002-4f37-8364-9fe2b1ab20cc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:11.544819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4c2f9-3002-4f37-8364-9fe2b1ab20cc None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:11.545718 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4c2f9-3002-4f37-8364-9fe2b1ab20cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:11.546106 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4c2f9-3002-4f37-8364-9fe2b1ab20cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:11.547629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4c2f9-3002-4f37-8364-9fe2b1ab20cc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:11.562990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 617/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:11.570112 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428b775-1726-42ca-9ba0-35c4adb96362 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:11.661314 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:11.687890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428b775-1726-42ca-9ba0-35c4adb96362 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:11.729976 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940043c0-7049-407c-b7b7-2ff56bbc0131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:11.731266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940043c0-7049-407c-b7b7-2ff56bbc0131 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:11.731548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940043c0-7049-407c-b7b7-2ff56bbc0131 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:11.731823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940043c0-7049-407c-b7b7-2ff56bbc0131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:11.740470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940043c0-7049-407c-b7b7-2ff56bbc0131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:11.742086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940043c0-7049-407c-b7b7-2ff56bbc0131 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:11.757655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-940043c0-7049-407c-b7b7-2ff56bbc0131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:09:11.757655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:11.757655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:11.757655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:11.757655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:11.757655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:11.757655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:11.757655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:11.757655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:11.757655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:11.757655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:11.757655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:11.757655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:09:11.757655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:09:11.757655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:11.759690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:11.761135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:09:11.761135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:09:11.761135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:09:11.761135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:09:11.761135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:09:11.761135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:09:11.761135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:09:11.761135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:11.761135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 627/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:09:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:11.765986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4c2f9-3002-4f37-8364-9fe2b1ab20cc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:11.888520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4c2f9-3002-4f37-8364-9fe2b1ab20cc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:11.926755 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858afb8-1ddb-4ab4-a9df-50fcfd639af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:11.927403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858afb8-1ddb-4ab4-a9df-50fcfd639af5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:11.927684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858afb8-1ddb-4ab4-a9df-50fcfd639af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:11.927956 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858afb8-1ddb-4ab4-a9df-50fcfd639af5 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:11.928686 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858afb8-1ddb-4ab4-a9df-50fcfd639af5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:11.928953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858afb8-1ddb-4ab4-a9df-50fcfd639af5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:11.930371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858afb8-1ddb-4ab4-a9df-50fcfd639af5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:11.943168 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 618/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:09:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:11.949427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940043c0-7049-407c-b7b7-2ff56bbc0131 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:12.063312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940043c0-7049-407c-b7b7-2ff56bbc0131 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:12.105646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ba3de-9627-4b6c-8ee7-20c201f5a280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:12.106457 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ba3de-9627-4b6c-8ee7-20c201f5a280 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:12.106812 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ba3de-9627-4b6c-8ee7-20c201f5a280 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:12.107147 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ba3de-9627-4b6c-8ee7-20c201f5a280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:12.107936 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ba3de-9627-4b6c-8ee7-20c201f5a280 None admin] RBAC: Adding query filter params (role.id=e55e17c894314bc6a5772b2de35b4874, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=0c5e6dae854a44a0ad6628e7dd69dfc5) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:12.108319 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ba3de-9627-4b6c-8ee7-20c201f5a280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:12.109850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ba3de-9627-4b6c-8ee7-20c201f5a280 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:12.116808 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 628/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:09:11 2022] GET /identity/v3/role_assignments?user.id=0c5e6dae854a44a0ad6628e7dd69dfc5&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=e55e17c894314bc6a5772b2de35b4874 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:14.581289 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a28c97-963d-4754-b159-34e512d6d4a9 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:14.581850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a28c97-963d-4754-b159-34e512d6d4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:14.581850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a28c97-963d-4754-b159-34e512d6d4a9 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:14.583237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 619/1247] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:09:14.588893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63daef4-7f53-40d9-a5a5-aedfa46bd5b2 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:14.589420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63daef4-7f53-40d9-a5a5-aedfa46bd5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:14.589533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63daef4-7f53-40d9-a5a5-aedfa46bd5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:14.596883 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:14.609918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a63daef4-7f53-40d9-a5a5-aedfa46bd5b2 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:09:14.611164 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a63daef4-7f53-40d9-a5a5-aedfa46bd5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:09:14.681125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 629/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:09:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:09:14.950829 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a28c97-963d-4754-b159-34e512d6d4a9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:14.969694 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:15.065199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a28c97-963d-4754-b159-34e512d6d4a9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:15.114819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517500a-712e-4b9c-b9ba-6cd1f6424807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:15.115612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517500a-712e-4b9c-b9ba-6cd1f6424807 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:15.116055 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517500a-712e-4b9c-b9ba-6cd1f6424807 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:15.116388 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517500a-712e-4b9c-b9ba-6cd1f6424807 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:15.128132 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517500a-712e-4b9c-b9ba-6cd1f6424807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f517500a-712e-4b9c-b9ba-6cd1f6424807 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:09:15.132998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:15.135184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:15.136220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:15.136220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:15.136220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:15.136220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:15.136220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:09:15.136220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:09:15.136220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:09:15.136220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:09:15.136220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:09:15.136220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:09:15.136220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:09:15.136220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:09:15.136220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 620/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:09:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:15.140410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63daef4-7f53-40d9-a5a5-aedfa46bd5b2 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:15.252496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63daef4-7f53-40d9-a5a5-aedfa46bd5b2 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:15.286175 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:15.291573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c97cbc-8dbc-445b-91f8-aca1438ddaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:15.292179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c97cbc-8dbc-445b-91f8-aca1438ddaf9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:15.292455 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c97cbc-8dbc-445b-91f8-aca1438ddaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:15.292724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c97cbc-8dbc-445b-91f8-aca1438ddaf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:15.293509 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c97cbc-8dbc-445b-91f8-aca1438ddaf9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:15.293808 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c97cbc-8dbc-445b-91f8-aca1438ddaf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:15.295242 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c97cbc-8dbc-445b-91f8-aca1438ddaf9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:15.304962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 630/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:09:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:15.311919 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517500a-712e-4b9c-b9ba-6cd1f6424807 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:15.394156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:15.418645 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517500a-712e-4b9c-b9ba-6cd1f6424807 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:15.457708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02abd65-53cc-455b-808a-061cbbbf7cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:15.458352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02abd65-53cc-455b-808a-061cbbbf7cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:15.458626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02abd65-53cc-455b-808a-061cbbbf7cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:15.458895 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02abd65-53cc-455b-808a-061cbbbf7cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:15.470646 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02abd65-53cc-455b-808a-061cbbbf7cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:15.472157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02abd65-53cc-455b-808a-061cbbbf7cc7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e02abd65-53cc-455b-808a-061cbbbf7cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:09:15.488604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:15.489808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:09:15.491048 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:09:15.491048 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:15.491048 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:09:15.491048 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 621/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:15.495867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c97cbc-8dbc-445b-91f8-aca1438ddaf9 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:15.601805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c97cbc-8dbc-445b-91f8-aca1438ddaf9 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:15.637866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da9720-2d89-4a04-9e9e-14587f40fc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:15.638572 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da9720-2d89-4a04-9e9e-14587f40fc50 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:15.638848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da9720-2d89-4a04-9e9e-14587f40fc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:15.639147 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da9720-2d89-4a04-9e9e-14587f40fc50 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:15.639797 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da9720-2d89-4a04-9e9e-14587f40fc50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:15.640096 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da9720-2d89-4a04-9e9e-14587f40fc50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:15.641467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da9720-2d89-4a04-9e9e-14587f40fc50 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:15.654386 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 631/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:15.660183 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02abd65-53cc-455b-808a-061cbbbf7cc7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:15.765134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02abd65-53cc-455b-808a-061cbbbf7cc7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:15.791789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:15.800287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d7445-6a1a-4e38-9f8a-28aa7b696333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:15.800927 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d7445-6a1a-4e38-9f8a-28aa7b696333 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:15.801202 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d7445-6a1a-4e38-9f8a-28aa7b696333 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:15.801469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d7445-6a1a-4e38-9f8a-28aa7b696333 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:15.811008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d7445-6a1a-4e38-9f8a-28aa7b696333 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:15.812501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d7445-6a1a-4e38-9f8a-28aa7b696333 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-159d7445-6a1a-4e38-9f8a-28aa7b696333 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:09:15.827929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:15.829061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:15.830016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:15.830016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:15.830016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:09:15.830016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:09:15.830016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:09:15.830016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:09:15.830016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:09:15.830016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:09:15.830016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 01:09:15.830016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:09:15.830016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 622/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:09:15.834927 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da9720-2d89-4a04-9e9e-14587f40fc50 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:15.892664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:15.939534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da9720-2d89-4a04-9e9e-14587f40fc50 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:15.975292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4cb29-1359-4789-b683-3953056ff59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:15.975899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4cb29-1359-4789-b683-3953056ff59e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:15.976172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4cb29-1359-4789-b683-3953056ff59e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:15.976438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4cb29-1359-4789-b683-3953056ff59e None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:15.977160 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4cb29-1359-4789-b683-3953056ff59e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:15.977459 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4cb29-1359-4789-b683-3953056ff59e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:15.978885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4cb29-1359-4789-b683-3953056ff59e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:15.996996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 632/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Sep 13 01:09:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:16.002800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d7445-6a1a-4e38-9f8a-28aa7b696333 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:16.114173 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d7445-6a1a-4e38-9f8a-28aa7b696333 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:16.146482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d8cd9-744d-4530-8f1d-5242ad1d4618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:16.147020 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d8cd9-744d-4530-8f1d-5242ad1d4618 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:16.147330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d8cd9-744d-4530-8f1d-5242ad1d4618 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:16.147600 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d8cd9-744d-4530-8f1d-5242ad1d4618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:16.201520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:16.213623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d8cd9-744d-4530-8f1d-5242ad1d4618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:16.215125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d8cd9-744d-4530-8f1d-5242ad1d4618 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:16.313481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 623/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:09:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 01:09:16.319416 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4cb29-1359-4789-b683-3953056ff59e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:16.415539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4cb29-1359-4789-b683-3953056ff59e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:16.428591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:16.450712 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc911101-73c7-4f5c-84d2-6dbb4b82d855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:16.451368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc911101-73c7-4f5c-84d2-6dbb4b82d855 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:16.451645 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc911101-73c7-4f5c-84d2-6dbb4b82d855 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:16.451915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc911101-73c7-4f5c-84d2-6dbb4b82d855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:16.461487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc911101-73c7-4f5c-84d2-6dbb4b82d855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:16.462922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc911101-73c7-4f5c-84d2-6dbb4b82d855 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-dc911101-73c7-4f5c-84d2-6dbb4b82d855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:09:16.477030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:16.478115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:09:16.479447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:09:16.479447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:16.479447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:16.479447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 633/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:16.483862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d8cd9-744d-4530-8f1d-5242ad1d4618 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:16.568057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:16.580488 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d8cd9-744d-4530-8f1d-5242ad1d4618 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:16.613325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8252f-9165-414c-937a-be832e339a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:16.613920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8252f-9165-414c-937a-be832e339a03 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:16.614200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8252f-9165-414c-937a-be832e339a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:16.614473 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8252f-9165-414c-937a-be832e339a03 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:16.615131 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8252f-9165-414c-937a-be832e339a03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:16.615439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8252f-9165-414c-937a-be832e339a03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:16.616789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8252f-9165-414c-937a-be832e339a03 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:16.628336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 624/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:16.633823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc911101-73c7-4f5c-84d2-6dbb4b82d855 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:16.730176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc911101-73c7-4f5c-84d2-6dbb4b82d855 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:16.763579 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9a028-f2df-41a7-99c5-0236914d6b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:16.764182 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9a028-f2df-41a7-99c5-0236914d6b11 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:16.764459 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9a028-f2df-41a7-99c5-0236914d6b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:16.764728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9a028-f2df-41a7-99c5-0236914d6b11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:16.771171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9a028-f2df-41a7-99c5-0236914d6b11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:16.772614 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9a028-f2df-41a7-99c5-0236914d6b11 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:16.784552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-7cf9a028-f2df-41a7-99c5-0236914d6b11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:09:16.784552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:16.784552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:16.784552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:16.784552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:16.784552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:16.784552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:16.784552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:16.784552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:16.784552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:16.784552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:16.784552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:16.784552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:09:16.784552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:09:16.784552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:16.785594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:16.786670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:09:16.786670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:09:16.786670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:09:16.786670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:09:16.786670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:09:16.786670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:09:16.786670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:09:16.786670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:16.786670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 634/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:09:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:16.791376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8252f-9165-414c-937a-be832e339a03 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:16.887884 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8252f-9165-414c-937a-be832e339a03 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:16.919685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa46f0-01ed-48c8-8916-b2fd1970e237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:16.920277 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa46f0-01ed-48c8-8916-b2fd1970e237 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:16.920555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa46f0-01ed-48c8-8916-b2fd1970e237 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:16.920825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa46f0-01ed-48c8-8916-b2fd1970e237 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:16.921504 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa46f0-01ed-48c8-8916-b2fd1970e237 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:16.921809 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa46f0-01ed-48c8-8916-b2fd1970e237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:16.923244 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa46f0-01ed-48c8-8916-b2fd1970e237 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:16.935413 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 625/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:09:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:16.941243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9a028-f2df-41a7-99c5-0236914d6b11 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:16.967223 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:17.039429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9a028-f2df-41a7-99c5-0236914d6b11 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:17.079177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d49c5-ded2-4814-bf53-d697a4209fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:17.079781 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d49c5-ded2-4814-bf53-d697a4209fad None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:17.080064 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d49c5-ded2-4814-bf53-d697a4209fad None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:17.080364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d49c5-ded2-4814-bf53-d697a4209fad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:17.081190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d49c5-ded2-4814-bf53-d697a4209fad None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=0c5e6dae854a44a0ad6628e7dd69dfc5) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:17.081574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d49c5-ded2-4814-bf53-d697a4209fad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:17.083108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d49c5-ded2-4814-bf53-d697a4209fad None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:17.088756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 635/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:09:16 2022] GET /identity/v3/role_assignments?user.id=0c5e6dae854a44a0ad6628e7dd69dfc5&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=3799feb4caa64e568971222375957f54 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:19.199710 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e616eaa-ff4b-4702-8f56-0ae0a625dbe1 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:19.200518 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e616eaa-ff4b-4702-8f56-0ae0a625dbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:19.200518 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e616eaa-ff4b-4702-8f56-0ae0a625dbe1 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:19.201862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 626/1261] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:09:19.206917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35611588-2af2-4aa9-abd0-aa46bb3cad69 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:19.207316 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35611588-2af2-4aa9-abd0-aa46bb3cad69 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:19.207493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35611588-2af2-4aa9-abd0-aa46bb3cad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:19.225682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-35611588-2af2-4aa9-abd0-aa46bb3cad69 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:09:19.226880 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-35611588-2af2-4aa9-abd0-aa46bb3cad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:09:19.291864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 636/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:09:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:09:19.558333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e616eaa-ff4b-4702-8f56-0ae0a625dbe1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:19.569672 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:19.658189 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e616eaa-ff4b-4702-8f56-0ae0a625dbe1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:19.691103 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd8fed-f3b5-41ef-b095-affa7557e3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:19.691733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd8fed-f3b5-41ef-b095-affa7557e3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:19.692013 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd8fed-f3b5-41ef-b095-affa7557e3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:19.692290 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd8fed-f3b5-41ef-b095-affa7557e3e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:19.702929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd8fed-f3b5-41ef-b095-affa7557e3e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c8bd8fed-f3b5-41ef-b095-affa7557e3e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:09:19.707683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:19.708693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:19.709546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:19.709546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:19.709546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:19.709546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:19.709546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:09:19.709546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:09:19.709546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:09:19.709546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:09:19.709546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:09:19.709546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:09:19.709546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:09:19.709546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:09:19.709546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 627/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:09:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:19.715322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35611588-2af2-4aa9-abd0-aa46bb3cad69 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:19.733148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:19.812348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35611588-2af2-4aa9-abd0-aa46bb3cad69 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:19.847161 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9581b-e265-4020-8567-11cfe70f6814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:19.847759 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9581b-e265-4020-8567-11cfe70f6814 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:19.848033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9581b-e265-4020-8567-11cfe70f6814 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:19.848300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9581b-e265-4020-8567-11cfe70f6814 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:19.848949 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9581b-e265-4020-8567-11cfe70f6814 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:19.849248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9581b-e265-4020-8567-11cfe70f6814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:19.850605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9581b-e265-4020-8567-11cfe70f6814 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:19.858410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 637/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:09:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:19.864126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd8fed-f3b5-41ef-b095-affa7557e3e2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:19.928446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:19.963557 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd8fed-f3b5-41ef-b095-affa7557e3e2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:19.996392 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7e049-cf00-45a3-8f01-c50c7c13701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:19.997006 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7e049-cf00-45a3-8f01-c50c7c13701e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:19.997285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7e049-cf00-45a3-8f01-c50c7c13701e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:19.997558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7e049-cf00-45a3-8f01-c50c7c13701e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:20.007705 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7e049-cf00-45a3-8f01-c50c7c13701e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:20.009137 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7e049-cf00-45a3-8f01-c50c7c13701e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-86e7e049-cf00-45a3-8f01-c50c7c13701e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:09:20.022783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:20.023945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:09:20.025235 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:09:20.025235 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:20.025235 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:09:20.025235 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 628/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:20.030107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9581b-e265-4020-8567-11cfe70f6814 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:20.123914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:20.145186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9581b-e265-4020-8567-11cfe70f6814 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:20.178272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad5b2f-4136-4008-8ece-7d33af7ab565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:20.178862 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad5b2f-4136-4008-8ece-7d33af7ab565 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:20.179168 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad5b2f-4136-4008-8ece-7d33af7ab565 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:20.179656 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad5b2f-4136-4008-8ece-7d33af7ab565 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:20.181257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad5b2f-4136-4008-8ece-7d33af7ab565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:20.181257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad5b2f-4136-4008-8ece-7d33af7ab565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:20.182378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad5b2f-4136-4008-8ece-7d33af7ab565 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:20.193816 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 638/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:20.199664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7e049-cf00-45a3-8f01-c50c7c13701e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:20.299456 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7e049-cf00-45a3-8f01-c50c7c13701e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:20.318264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:20.332945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09923659-5177-41fe-8538-4919d8742be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:20.333570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09923659-5177-41fe-8538-4919d8742be4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:20.333850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09923659-5177-41fe-8538-4919d8742be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:20.334124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09923659-5177-41fe-8538-4919d8742be4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:20.342125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09923659-5177-41fe-8538-4919d8742be4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:20.343602 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09923659-5177-41fe-8538-4919d8742be4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-09923659-5177-41fe-8538-4919d8742be4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:09:20.354441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:20.355667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:20.356704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:20.356704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:20.356704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:09:20.356704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:09:20.356704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:09:20.356704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:09:20.356704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:09:20.356704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:09:20.356704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 01:09:20.356704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:09:20.356704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 629/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:20.361645 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad5b2f-4136-4008-8ece-7d33af7ab565 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:20.462347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad5b2f-4136-4008-8ece-7d33af7ab565 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:20.495425 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f7e89-0911-40bf-adaf-46183724c410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:20.496193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f7e89-0911-40bf-adaf-46183724c410 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:20.496476 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f7e89-0911-40bf-adaf-46183724c410 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:20.496748 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f7e89-0911-40bf-adaf-46183724c410 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:20.497461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f7e89-0911-40bf-adaf-46183724c410 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:20.497766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f7e89-0911-40bf-adaf-46183724c410 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:20.499218 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f7e89-0911-40bf-adaf-46183724c410 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:20.507598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:20.517800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 639/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Sep 13 01:09:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:20.523585 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09923659-5177-41fe-8538-4919d8742be4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:20.619408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09923659-5177-41fe-8538-4919d8742be4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:20.651510 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201467c-fe3d-48f8-87d0-e2445eb53a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:20.652200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201467c-fe3d-48f8-87d0-e2445eb53a60 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:20.652976 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201467c-fe3d-48f8-87d0-e2445eb53a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:20.653396 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201467c-fe3d-48f8-87d0-e2445eb53a60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:20.663569 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201467c-fe3d-48f8-87d0-e2445eb53a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:20.665003 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201467c-fe3d-48f8-87d0-e2445eb53a60 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-6201467c-fe3d-48f8-87d0-e2445eb53a60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:09:20.678936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:20.680078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:09:20.681385 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:09:20.681385 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:20.681385 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:09:20.681385 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 630/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:20.686277 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f7e89-0911-40bf-adaf-46183724c410 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:20.782995 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f7e89-0911-40bf-adaf-46183724c410 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:20.815979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a97af-0ad1-409a-93f3-ff2d38e3fd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:20.816576 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a97af-0ad1-409a-93f3-ff2d38e3fd5f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:20.816857 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a97af-0ad1-409a-93f3-ff2d38e3fd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:20.817131 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a97af-0ad1-409a-93f3-ff2d38e3fd5f None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:20.817767 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a97af-0ad1-409a-93f3-ff2d38e3fd5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:20.818068 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a97af-0ad1-409a-93f3-ff2d38e3fd5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:20.819462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a97af-0ad1-409a-93f3-ff2d38e3fd5f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:20.831317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 640/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:20.836780 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201467c-fe3d-48f8-87d0-e2445eb53a60 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:20.867156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:20.934372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201467c-fe3d-48f8-87d0-e2445eb53a60 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:20.966952 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9f494-1d40-4679-a254-6e01c1ce1f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:20.967592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9f494-1d40-4679-a254-6e01c1ce1f10 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:20.967875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9f494-1d40-4679-a254-6e01c1ce1f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:20.968149 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9f494-1d40-4679-a254-6e01c1ce1f10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:20.974537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9f494-1d40-4679-a254-6e01c1ce1f10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:20.975993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9f494-1d40-4679-a254-6e01c1ce1f10 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:20.987729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-9aa9f494-1d40-4679-a254-6e01c1ce1f10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:09:20.987729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:20.987729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:20.987729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:20.987729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:20.987729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:20.987729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:20.987729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:20.987729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:20.987729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:20.987729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:20.987729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:20.987729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:09:20.987729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:09:20.987729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:20.988791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:20.989900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:09:20.989900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:09:20.989900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:09:20.989900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:09:20.989900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:09:20.989900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:09:20.989900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:09:20.989900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:09:20.989900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 631/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:09:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 01:09:20.994651 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a97af-0ad1-409a-93f3-ff2d38e3fd5f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:21.051741 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:21.102516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a97af-0ad1-409a-93f3-ff2d38e3fd5f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:21.135257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecaf4e7-d798-4f2d-8dea-71de006ba6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:21.135851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecaf4e7-d798-4f2d-8dea-71de006ba6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:21.136126 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecaf4e7-d798-4f2d-8dea-71de006ba6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:21.136395 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecaf4e7-d798-4f2d-8dea-71de006ba6d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:21.137315 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecaf4e7-d798-4f2d-8dea-71de006ba6d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:21.137616 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecaf4e7-d798-4f2d-8dea-71de006ba6d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:21.139039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecaf4e7-d798-4f2d-8dea-71de006ba6d0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:21.150440 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 641/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:09:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:21.156712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9f494-1d40-4679-a254-6e01c1ce1f10 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:21.245241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:21.255756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9f494-1d40-4679-a254-6e01c1ce1f10 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:21.288140 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec6eaa-820d-4681-ad69-ed13eb565db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:21.288783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec6eaa-820d-4681-ad69-ed13eb565db0 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:21.289064 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec6eaa-820d-4681-ad69-ed13eb565db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:21.289335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec6eaa-820d-4681-ad69-ed13eb565db0 None admin] PATH_INFO: `/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/0c5e6dae854a44a0ad6628e7dd69dfc5/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:21.291219 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec6eaa-820d-4681-ad69-ed13eb565db0 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe73ceb0a582452b9b636a701adafb6f, user_id=0c5e6dae854a44a0ad6628e7dd69dfc5, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:21.292645 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec6eaa-820d-4681-ad69-ed13eb565db0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:21.305142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 632/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 13 01:09:21 2022] PUT /identity/v3/projects/fe73ceb0a582452b9b636a701adafb6f/users/0c5e6dae854a44a0ad6628e7dd69dfc5/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:09:23.432589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf4756-3814-4ba9-a19b-64056f8caaa6 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:23.433022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf4756-3814-4ba9-a19b-64056f8caaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:23.433143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf4756-3814-4ba9-a19b-64056f8caaa6 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:23.435552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 642/1274] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:09:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:09:23.440754 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630324-e05a-4bb0-85f7-c6bd17a0f487 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:23.441150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630324-e05a-4bb0-85f7-c6bd17a0f487 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:23.441308 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630324-e05a-4bb0-85f7-c6bd17a0f487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:23.459615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7c630324-e05a-4bb0-85f7-c6bd17a0f487 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:09:23.460815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7c630324-e05a-4bb0-85f7-c6bd17a0f487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:09:23.525734 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 633/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:09:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:09:23.793940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf4756-3814-4ba9-a19b-64056f8caaa6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:23.892035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf4756-3814-4ba9-a19b-64056f8caaa6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:23.909041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:23.926810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac168c-4e37-414a-abf7-cfc6b8ec994d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:23.927463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac168c-4e37-414a-abf7-cfc6b8ec994d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:23.927744 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac168c-4e37-414a-abf7-cfc6b8ec994d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:23.928015 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac168c-4e37-414a-abf7-cfc6b8ec994d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:23.938135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac168c-4e37-414a-abf7-cfc6b8ec994d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-69ac168c-4e37-414a-abf7-cfc6b8ec994d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 01:09:23.942891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:23.944013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:23.945063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:23.945063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:23.945063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:23.945063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:23.945063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 01:09:23.945063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 01:09:23.945063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 01:09:23.945063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 01:09:23.945063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 01:09:23.945063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 01:09:23.945063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 01:09:23.945063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:23.945063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 643/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 13 01:09:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:23.949916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c630324-e05a-4bb0-85f7-c6bd17a0f487 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:24.027989 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:24.047574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c630324-e05a-4bb0-85f7-c6bd17a0f487 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:24.091463 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b479f8-ca3b-4baa-92e2-6a85511ac46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:24.092296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b479f8-ca3b-4baa-92e2-6a85511ac46c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:24.092717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b479f8-ca3b-4baa-92e2-6a85511ac46c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:24.093076 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b479f8-ca3b-4baa-92e2-6a85511ac46c None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:24.094001 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b479f8-ca3b-4baa-92e2-6a85511ac46c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:24.094553 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b479f8-ca3b-4baa-92e2-6a85511ac46c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:24.096444 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b479f8-ca3b-4baa-92e2-6a85511ac46c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:24.107824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 634/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 13 01:09:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:09:24.115443 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac168c-4e37-414a-abf7-cfc6b8ec994d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:24.219301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac168c-4e37-414a-abf7-cfc6b8ec994d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:24.251714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7ce5a-8d16-4a7f-9383-5c54a810c1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:24.252327 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7ce5a-8d16-4a7f-9383-5c54a810c1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:24.252604 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7ce5a-8d16-4a7f-9383-5c54a810c1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:24.252873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7ce5a-8d16-4a7f-9383-5c54a810c1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:24.263037 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7ce5a-8d16-4a7f-9383-5c54a810c1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:24.264510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7ce5a-8d16-4a7f-9383-5c54a810c1a8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-ffe7ce5a-8d16-4a7f-9383-5c54a810c1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:09:24.279434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:24.280573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:09:24.281570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:09:24.281570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:24.281570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:24.281570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 644/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:24.286353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b479f8-ca3b-4baa-92e2-6a85511ac46c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:24.382541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b479f8-ca3b-4baa-92e2-6a85511ac46c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:24.414940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b5edb-6c05-4695-99d2-643da15a8493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:24.415570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b5edb-6c05-4695-99d2-643da15a8493 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:24.415850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b5edb-6c05-4695-99d2-643da15a8493 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:24.416124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b5edb-6c05-4695-99d2-643da15a8493 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:24.416772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b5edb-6c05-4695-99d2-643da15a8493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:24.417078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b5edb-6c05-4695-99d2-643da15a8493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:24.418978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b5edb-6c05-4695-99d2-643da15a8493 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:24.432288 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 635/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:24.438586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7ce5a-8d16-4a7f-9383-5c54a810c1a8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:24.469858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:24.537751 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7ce5a-8d16-4a7f-9383-5c54a810c1a8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:24.570494 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806ab61-1d2e-4f9e-bf01-968cafcad290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:24.571125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806ab61-1d2e-4f9e-bf01-968cafcad290 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:24.571402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806ab61-1d2e-4f9e-bf01-968cafcad290 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:24.571677 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806ab61-1d2e-4f9e-bf01-968cafcad290 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:24.579002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806ab61-1d2e-4f9e-bf01-968cafcad290 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:24.580449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806ab61-1d2e-4f9e-bf01-968cafcad290 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a806ab61-1d2e-4f9e-bf01-968cafcad290 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 01:09:24.591842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:24.592950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:24.593989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:24.593989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:24.593989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 01:09:24.593989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 01:09:24.593989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 01:09:24.593989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 01:09:24.593989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 01:09:24.593989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 01:09:24.593989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 01:09:24.593989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:24.593989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 645/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:24.598796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b5edb-6c05-4695-99d2-643da15a8493 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:24.602561 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:24.694787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b5edb-6c05-4695-99d2-643da15a8493 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:24.727668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287e117-6203-4e48-b156-893bd0e2a68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:24.728256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287e117-6203-4e48-b156-893bd0e2a68f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:24.728531 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287e117-6203-4e48-b156-893bd0e2a68f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:24.728799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287e117-6203-4e48-b156-893bd0e2a68f None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:24.729508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287e117-6203-4e48-b156-893bd0e2a68f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:24.729805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287e117-6203-4e48-b156-893bd0e2a68f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:24.732079 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287e117-6203-4e48-b156-893bd0e2a68f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:24.749146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 636/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Sep 13 01:09:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:24.754925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806ab61-1d2e-4f9e-bf01-968cafcad290 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:24.843873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:24.853540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806ab61-1d2e-4f9e-bf01-968cafcad290 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:24.886951 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc32f66-add1-409b-ac22-edbec152d2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:24.887572 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32f66-add1-409b-ac22-edbec152d2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:24.887852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32f66-add1-409b-ac22-edbec152d2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:24.888125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32f66-add1-409b-ac22-edbec152d2f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:24.953665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc32f66-add1-409b-ac22-edbec152d2f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:24.955047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc32f66-add1-409b-ac22-edbec152d2f7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:25.042435 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:25.053538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 646/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 13 01:09:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 01:09:25.060125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287e117-6203-4e48-b156-893bd0e2a68f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:25.126076 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:25.162252 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287e117-6203-4e48-b156-893bd0e2a68f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:25.195140 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9a678-cd2a-49cb-9717-f7d45178f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:25.195757 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9a678-cd2a-49cb-9717-f7d45178f5ae None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:25.196032 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9a678-cd2a-49cb-9717-f7d45178f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:25.196300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9a678-cd2a-49cb-9717-f7d45178f5ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:25.206213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9a678-cd2a-49cb-9717-f7d45178f5ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:25.207631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9a678-cd2a-49cb-9717-f7d45178f5ae None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c6f9a678-cd2a-49cb-9717-f7d45178f5ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 01:09:25.222091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:25.223237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 01:09:25.224310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 01:09:25.224310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 01:09:25.224310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:09:25.224310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 637/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:25.228887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc32f66-add1-409b-ac22-edbec152d2f7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:25.325489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc32f66-add1-409b-ac22-edbec152d2f7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:25.360289 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d7c41-20c0-4ced-af0e-963539fa963b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:25.360891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d7c41-20c0-4ced-af0e-963539fa963b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:25.361169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d7c41-20c0-4ced-af0e-963539fa963b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:25.361444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d7c41-20c0-4ced-af0e-963539fa963b None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:25.362077 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d7c41-20c0-4ced-af0e-963539fa963b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:25.362379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d7c41-20c0-4ced-af0e-963539fa963b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:25.363928 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d7c41-20c0-4ced-af0e-963539fa963b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:25.375132 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 647/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 13 01:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:25.380766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9a678-cd2a-49cb-9717-f7d45178f5ae None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:25.480118 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9a678-cd2a-49cb-9717-f7d45178f5ae None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:25.493333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:25.513107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54095ad3-f92a-490d-81c1-4778bb6e2c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:25.513717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54095ad3-f92a-490d-81c1-4778bb6e2c6e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:25.513992 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54095ad3-f92a-490d-81c1-4778bb6e2c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:25.514258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54095ad3-f92a-490d-81c1-4778bb6e2c6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:25.520563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54095ad3-f92a-490d-81c1-4778bb6e2c6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:25.521990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54095ad3-f92a-490d-81c1-4778bb6e2c6e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:25.533612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-54095ad3-f92a-490d-81c1-4778bb6e2c6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:09:25.533612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:25.533612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:25.533612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:25.533612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:25.533612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:25.533612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:25.533612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:25.533612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:25.533612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:25.533612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:25.533612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:25.533612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 01:09:25.533612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 01:09:25.533612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:25.534688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:25.535871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 01:09:25.535871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 01:09:25.535871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 01:09:25.535871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 01:09:25.535871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 01:09:25.535871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 01:09:25.535871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 01:09:25.535871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Sep 13 01:09:25.535871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 638/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 13 01:09:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:25.540630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d7c41-20c0-4ced-af0e-963539fa963b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:25.590156 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:25.639010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d7c41-20c0-4ced-af0e-963539fa963b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:25.673521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47fce9-5b0b-4303-9fbb-b73d70a170db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:25.674115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47fce9-5b0b-4303-9fbb-b73d70a170db None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:25.674393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47fce9-5b0b-4303-9fbb-b73d70a170db None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:25.674664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47fce9-5b0b-4303-9fbb-b73d70a170db None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:25.675366 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47fce9-5b0b-4303-9fbb-b73d70a170db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:25.675669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47fce9-5b0b-4303-9fbb-b73d70a170db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:25.677085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47fce9-5b0b-4303-9fbb-b73d70a170db None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:25.689767 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 648/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 13 01:09:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:25.695862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54095ad3-f92a-490d-81c1-4778bb6e2c6e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:25.792150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54095ad3-f92a-490d-81c1-4778bb6e2c6e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:25.825335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191d454-730c-473f-9413-9359641f8741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:25.825927 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191d454-730c-473f-9413-9359641f8741 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:25.826215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191d454-730c-473f-9413-9359641f8741 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:25.826488 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191d454-730c-473f-9413-9359641f8741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:25.827232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191d454-730c-473f-9413-9359641f8741 None admin] RBAC: Adding query filter params (role.id=3799feb4caa64e568971222375957f54, scope.project.id=fe73ceb0a582452b9b636a701adafb6f, user.id=0c5e6dae854a44a0ad6628e7dd69dfc5) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:25.827544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191d454-730c-473f-9413-9359641f8741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:25.828955 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191d454-730c-473f-9413-9359641f8741 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:25.834479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 639/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 13 01:09:25 2022] GET /identity/v3/role_assignments?user.id=0c5e6dae854a44a0ad6628e7dd69dfc5&scope.project.id=fe73ceb0a582452b9b636a701adafb6f&role.id=3799feb4caa64e568971222375957f54 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:27.984283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9127d-4327-4c5a-b4b6-5516208f804a None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:27.984809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9127d-4327-4c5a-b4b6-5516208f804a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:27.984809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9127d-4327-4c5a-b4b6-5516208f804a None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:27.986169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 649/1288] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:09:27.991310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fee845-0f98-474b-9c9d-d777a20021fa None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:27.991728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fee845-0f98-474b-9c9d-d777a20021fa None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:27.991861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fee845-0f98-474b-9c9d-d777a20021fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:28.010257 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e1fee845-0f98-474b-9c9d-d777a20021fa None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:09:28.011527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e1fee845-0f98-474b-9c9d-d777a20021fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:09:28.039690 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:28.087257 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 640/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:09:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:09:28.366154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9127d-4327-4c5a-b4b6-5516208f804a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:28.466160 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9127d-4327-4c5a-b4b6-5516208f804a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:28.476491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:28.499853 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbea0fe-6e6b-482d-800e-143919458a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:28.500471 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbea0fe-6e6b-482d-800e-143919458a5a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:28.500749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbea0fe-6e6b-482d-800e-143919458a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:28.501021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbea0fe-6e6b-482d-800e-143919458a5a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:28.501604 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbea0fe-6e6b-482d-800e-143919458a5a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:28.502959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbea0fe-6e6b-482d-800e-143919458a5a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-bfbea0fe-6e6b-482d-800e-143919458a5a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:28.512099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:28.515349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:28.516444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:28.516444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:28.516444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:28.516444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:28.516444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:28.516444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:28.516444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:28.516444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:28.516444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:28.516444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:28.516444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:09:28.516444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:09:28.516444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 01:09:28.516444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:28.516444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 650/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 13 01:09:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:28.519326 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fee845-0f98-474b-9c9d-d777a20021fa None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:28.615144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fee845-0f98-474b-9c9d-d777a20021fa None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:28.650468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88248e2e-ac8a-4ec7-a0c1-1aafff0cce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:28.650993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88248e2e-ac8a-4ec7-a0c1-1aafff0cce32 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:28.651294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88248e2e-ac8a-4ec7-a0c1-1aafff0cce32 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:28.651564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88248e2e-ac8a-4ec7-a0c1-1aafff0cce32 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:28.652401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88248e2e-ac8a-4ec7-a0c1-1aafff0cce32 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:28.652766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88248e2e-ac8a-4ec7-a0c1-1aafff0cce32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:28.654123 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88248e2e-ac8a-4ec7-a0c1-1aafff0cce32 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:28.658766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 641/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Sep 13 01:09:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:28.664742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbea0fe-6e6b-482d-800e-143919458a5a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:28.762956 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbea0fe-6e6b-482d-800e-143919458a5a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:28.795602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415787b-afcc-4f58-b985-a9bfccb654e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:28.796190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415787b-afcc-4f58-b985-a9bfccb654e2 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:28.796469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415787b-afcc-4f58-b985-a9bfccb654e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:28.796741 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415787b-afcc-4f58-b985-a9bfccb654e2 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:28.797361 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415787b-afcc-4f58-b985-a9bfccb654e2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:28.797664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415787b-afcc-4f58-b985-a9bfccb654e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:28.799027 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415787b-afcc-4f58-b985-a9bfccb654e2 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:28.803304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 651/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Sep 13 01:09:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:30.935668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05444c-f9db-40e6-ba92-8b9edd13bed0 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:30.936221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05444c-f9db-40e6-ba92-8b9edd13bed0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:30.936221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05444c-f9db-40e6-ba92-8b9edd13bed0 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:30.937535 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 642/1293] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:09:30.942715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf93be-023f-4dd8-9aa8-5800dae0e70f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:30.943167 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf93be-023f-4dd8-9aa8-5800dae0e70f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:30.943293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf93be-023f-4dd8-9aa8-5800dae0e70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:30.961980 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e1bf93be-023f-4dd8-9aa8-5800dae0e70f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:09:30.963278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e1bf93be-023f-4dd8-9aa8-5800dae0e70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:09:30.992388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:31.029049 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 652/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:09:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:09:31.296996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05444c-f9db-40e6-ba92-8b9edd13bed0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:31.328814 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:31.398628 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05444c-f9db-40e6-ba92-8b9edd13bed0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:31.434502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769e1dc-9a63-4697-bd82-05514e766aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:31.435124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769e1dc-9a63-4697-bd82-05514e766aa6 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:31.435402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769e1dc-9a63-4697-bd82-05514e766aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:31.435671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769e1dc-9a63-4697-bd82-05514e766aa6 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:31.436325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769e1dc-9a63-4697-bd82-05514e766aa6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:31.437684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769e1dc-9a63-4697-bd82-05514e766aa6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:31.453102 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 643/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 13 01:09:31 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:09:33.574465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dc064-acf4-439e-98df-2cd1629e3cd5 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:33.574986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dc064-acf4-439e-98df-2cd1629e3cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:33.574986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dc064-acf4-439e-98df-2cd1629e3cd5 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:33.576639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 653/1296] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:09:33.581855 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975345c1-951c-4306-bf34-3749b671532a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:33.582270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975345c1-951c-4306-bf34-3749b671532a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:33.582402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975345c1-951c-4306-bf34-3749b671532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:33.600692 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-975345c1-951c-4306-bf34-3749b671532a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:09:33.601867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-975345c1-951c-4306-bf34-3749b671532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:09:33.673481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 644/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:09:33 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:09:33.940742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dc064-acf4-439e-98df-2cd1629e3cd5 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:34.038650 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dc064-acf4-439e-98df-2cd1629e3cd5 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:34.082938 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1870083-da48-42aa-979c-bb5abf07835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:34.083856 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1870083-da48-42aa-979c-bb5abf07835f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:34.084307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1870083-da48-42aa-979c-bb5abf07835f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:34.084791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1870083-da48-42aa-979c-bb5abf07835f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:34.085626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1870083-da48-42aa-979c-bb5abf07835f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:34.087885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1870083-da48-42aa-979c-bb5abf07835f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-f1870083-da48-42aa-979c-bb5abf07835f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:34.099373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:34.100975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:34.101911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:34.101911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:34.101911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:34.101911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:34.101911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:34.101911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:34.101911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:34.101911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:34.101911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:34.101911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:34.101911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:09:34.101911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:09:34.101911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 01:09:34.101911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:34.101911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 654/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 13 01:09:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:34.106818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975345c1-951c-4306-bf34-3749b671532a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:34.129425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:34.208912 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975345c1-951c-4306-bf34-3749b671532a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:34.241476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7c19e-92cc-453c-8c83-b0c1b0faea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:34.242069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7c19e-92cc-453c-8c83-b0c1b0faea7a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:34.242343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7c19e-92cc-453c-8c83-b0c1b0faea7a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:34.242612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7c19e-92cc-453c-8c83-b0c1b0faea7a None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:34.243269 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7c19e-92cc-453c-8c83-b0c1b0faea7a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:34.243578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7c19e-92cc-453c-8c83-b0c1b0faea7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:34.244928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7c19e-92cc-453c-8c83-b0c1b0faea7a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:34.250545 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 645/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Sep 13 01:09:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:34.256543 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1870083-da48-42aa-979c-bb5abf07835f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:34.288114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:34.357806 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1870083-da48-42aa-979c-bb5abf07835f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:34.391507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ac565-a4e4-44bb-b7d2-e99a89e53cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:34.392101 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ac565-a4e4-44bb-b7d2-e99a89e53cba None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:34.392377 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ac565-a4e4-44bb-b7d2-e99a89e53cba None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:34.392645 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ac565-a4e4-44bb-b7d2-e99a89e53cba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:34.393338 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ac565-a4e4-44bb-b7d2-e99a89e53cba None admin] RBAC: Adding query filter params (interface=public, service_id=09761f694bb24c65811ee5e81f4b6cc0, region_id=RegionOne) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:34.393641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ac565-a4e4-44bb-b7d2-e99a89e53cba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:34.395001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ac565-a4e4-44bb-b7d2-e99a89e53cba None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:34.399891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 655/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 13 01:09:34 2022] GET /identity/v3/endpoints?service_id=09761f694bb24c65811ee5e81f4b6cc0&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:09:34.405658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7c19e-92cc-453c-8c83-b0c1b0faea7a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:34.487131 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:34.504888 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7c19e-92cc-453c-8c83-b0c1b0faea7a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:34.537520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d7ae9-cb9e-49e5-a3de-800861ee0fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:34.538111 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d7ae9-cb9e-49e5-a3de-800861ee0fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:34.538386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d7ae9-cb9e-49e5-a3de-800861ee0fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:34.538654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d7ae9-cb9e-49e5-a3de-800861ee0fd2 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:34.539279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d7ae9-cb9e-49e5-a3de-800861ee0fd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:34.540628 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d7ae9-cb9e-49e5-a3de-800861ee0fd2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:34.548179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 646/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 13 01:09:34 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:09:36.665736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d93dbd-10d7-4131-8f74-f8351ce2560e None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:36.666379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d93dbd-10d7-4131-8f74-f8351ce2560e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:36.666379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d93dbd-10d7-4131-8f74-f8351ce2560e None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:36.667772 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 656/1302] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:09:36.673023 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d95159-dbc7-44dd-8e89-a437c75bf997 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:36.673433 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d95159-dbc7-44dd-8e89-a437c75bf997 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:36.673529 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d95159-dbc7-44dd-8e89-a437c75bf997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:36.691854 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f0d95159-dbc7-44dd-8e89-a437c75bf997 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:09:36.693040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f0d95159-dbc7-44dd-8e89-a437c75bf997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:09:36.757561 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 647/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:09:36 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 01:09:37.029998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d93dbd-10d7-4131-8f74-f8351ce2560e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:37.138547 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:37.145493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d93dbd-10d7-4131-8f74-f8351ce2560e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:37.178092 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b341789-6426-4851-9844-d7467fbeda70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:37.178708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b341789-6426-4851-9844-d7467fbeda70 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:37.178986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b341789-6426-4851-9844-d7467fbeda70 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:37.179285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b341789-6426-4851-9844-d7467fbeda70 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:37.179861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b341789-6426-4851-9844-d7467fbeda70 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:37.181243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b341789-6426-4851-9844-d7467fbeda70 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-2b341789-6426-4851-9844-d7467fbeda70 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 01:09:37.190317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 01:09:37.191647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 01:09:37.192864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 01:09:37.192864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Sep 13 01:09:37.192864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 01:09:37.192864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Sep 13 01:09:37.192864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 01:09:37.192864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 01:09:37.192864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 01:09:37.192864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Sep 13 01:09:37.192864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 01:09:37.192864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Sep 13 01:09:37.192864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 01:09:37.192864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 01:09:37.192864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 01:09:37.192864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Sep 13 01:09:37.192864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 657/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 13 01:09:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 01:09:37.197431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d95159-dbc7-44dd-8e89-a437c75bf997 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:37.270336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:37.293253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d95159-dbc7-44dd-8e89-a437c75bf997 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:37.325846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7478b0-e398-4ac2-933d-e9f26eb8268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:37.326442 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7478b0-e398-4ac2-933d-e9f26eb8268a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:37.326717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7478b0-e398-4ac2-933d-e9f26eb8268a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:37.326986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7478b0-e398-4ac2-933d-e9f26eb8268a None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:37.327635 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7478b0-e398-4ac2-933d-e9f26eb8268a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:09:37.327935 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7478b0-e398-4ac2-933d-e9f26eb8268a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:37.329286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7478b0-e398-4ac2-933d-e9f26eb8268a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:37.334182 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 648/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Sep 13 01:09:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:09:37.340389 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b341789-6426-4851-9844-d7467fbeda70 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:09:37.437336 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b341789-6426-4851-9844-d7467fbeda70 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:09:37.470918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24ae6c-42fe-425f-be4d-c310799eaf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:09:37.471545 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24ae6c-42fe-425f-be4d-c310799eaf08 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:09:37.471825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24ae6c-42fe-425f-be4d-c310799eaf08 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:09:37.472099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24ae6c-42fe-425f-be4d-c310799eaf08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:09:37.472756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24ae6c-42fe-425f-be4d-c310799eaf08 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:09:37.474127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24ae6c-42fe-425f-be4d-c310799eaf08 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:09:37.493829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 658/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:09:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:09:47.331338 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=30 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:09:47.489614 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:10:41.941074 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a571e6c-9d26-46d1-9c04-31ff29fbb909 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:41.942159 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a571e6c-9d26-46d1-9c04-31ff29fbb909 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:41.944666 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a571e6c-9d26-46d1-9c04-31ff29fbb909 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:41.946490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 649/1307] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:10:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:10:41.952638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebe133-6b4b-4493-b744-8653159c5969 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:41.953195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebe133-6b4b-4493-b744-8653159c5969 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:41.953369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebe133-6b4b-4493-b744-8653159c5969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:42.041259 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-89ebe133-6b4b-4493-b744-8653159c5969 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:10:42.042769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-89ebe133-6b4b-4493-b744-8653159c5969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:42.148830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 659/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:10:42.450129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb053cf5-ec89-40bc-922f-2c09004451e5 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:42.450415 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb053cf5-ec89-40bc-922f-2c09004451e5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:42.450963 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb053cf5-ec89-40bc-922f-2c09004451e5 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:42.452575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 650/1309] 10.222.0.20 () {54 vars in 965 bytes} [Tue Sep 13 01:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:10:42.458952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f80bc3-7247-4ffe-baa1-468c0df4ced5 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:42.459277 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f80bc3-7247-4ffe-baa1-468c0df4ced5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:42.459554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f80bc3-7247-4ffe-baa1-468c0df4ced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:42.541565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-02f80bc3-7247-4ffe-baa1-468c0df4ced5 None None] MFA Rules not processed for user `a672e63fa5e345679bac3d67301fe875`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:10:42.542790 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-02f80bc3-7247-4ffe-baa1-468c0df4ced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:42.564674 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:10:42.625807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 660/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Tue Sep 13 01:10:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:10:42.634723 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb053cf5-ec89-40bc-922f-2c09004451e5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:10:42.636725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bb053cf5-ec89-40bc-922f-2c09004451e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:42.759703 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb053cf5-ec89-40bc-922f-2c09004451e5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:10:42.842240 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359604e-6bc0-49fb-bbd7-917aab4a3852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:10:42.842967 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359604e-6bc0-49fb-bbd7-917aab4a3852 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:42.843274 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359604e-6bc0-49fb-bbd7-917aab4a3852 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:42.843551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359604e-6bc0-49fb-bbd7-917aab4a3852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:42.845159 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4359604e-6bc0-49fb-bbd7-917aab4a3852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:42.904700 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:10:42.964865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359604e-6bc0-49fb-bbd7-917aab4a3852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:10:42.966317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359604e-6bc0-49fb-bbd7-917aab4a3852 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:10:42.989340 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 651/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:10:45.458488 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4184e-2f4a-4249-beac-06c069f4f7cb None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:45.459005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4184e-2f4a-4249-beac-06c069f4f7cb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:45.459141 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4184e-2f4a-4249-beac-06c069f4f7cb None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:45.460565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 661/1312] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:10:45.465903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f63c02-0a17-4ff6-a503-cb63081f9548 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:45.466310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f63c02-0a17-4ff6-a503-cb63081f9548 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:45.466455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f63c02-0a17-4ff6-a503-cb63081f9548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:45.550176 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-92f63c02-0a17-4ff6-a503-cb63081f9548 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:10:45.551432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-92f63c02-0a17-4ff6-a503-cb63081f9548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:45.647330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 652/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:10:45.936359 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4184e-2f4a-4249-beac-06c069f4f7cb None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:10:45.937983 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-12e4184e-2f4a-4249-beac-06c069f4f7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:46.051122 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4184e-2f4a-4249-beac-06c069f4f7cb None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:10:46.127776 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:10:46.130577 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc12e0f-2f97-4720-91c9-0bbd7a6d5f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:10:46.131398 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc12e0f-2f97-4720-91c9-0bbd7a6d5f62 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:46.131847 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc12e0f-2f97-4720-91c9-0bbd7a6d5f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:46.132307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc12e0f-2f97-4720-91c9-0bbd7a6d5f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:46.134040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bdc12e0f-2f97-4720-91c9-0bbd7a6d5f62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:46.243393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc12e0f-2f97-4720-91c9-0bbd7a6d5f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:10:46.244749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc12e0f-2f97-4720-91c9-0bbd7a6d5f62 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:10:46.262406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 662/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:10:48.731977 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81b146-86f6-4cb9-84fd-2dfe6f5d419f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:48.732490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81b146-86f6-4cb9-84fd-2dfe6f5d419f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:48.732490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81b146-86f6-4cb9-84fd-2dfe6f5d419f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:48.733778 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 653/1315] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:10:48.740690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e944e5-fc6c-40c9-b09b-59710a73247c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:48.741080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e944e5-fc6c-40c9-b09b-59710a73247c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:48.741215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e944e5-fc6c-40c9-b09b-59710a73247c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:48.806845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e9e944e5-fc6c-40c9-b09b-59710a73247c None None] MFA Rules not processed for user `fae5f077c4984c84b963e756212a526f`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:10:48.808091 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e9e944e5-fc6c-40c9-b09b-59710a73247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:48.859731 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:10:48.904838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 663/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:10:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:10:49.191507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81b146-86f6-4cb9-84fd-2dfe6f5d419f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:10:49.193082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ee81b146-86f6-4cb9-84fd-2dfe6f5d419f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:49.203365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:10:49.297046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81b146-86f6-4cb9-84fd-2dfe6f5d419f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:10:49.369693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc790b1f-15e9-4cf0-ac54-0ff86ed325aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:10:49.370218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc790b1f-15e9-4cf0-ac54-0ff86ed325aa service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:49.370493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc790b1f-15e9-4cf0-ac54-0ff86ed325aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:49.370763 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc790b1f-15e9-4cf0-ac54-0ff86ed325aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:49.372365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cc790b1f-15e9-4cf0-ac54-0ff86ed325aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:49.434685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:10:49.481135 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc790b1f-15e9-4cf0-ac54-0ff86ed325aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:10:49.482566 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc790b1f-15e9-4cf0-ac54-0ff86ed325aa service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:10:49.500201 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 654/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:10:49 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:10:52.157095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27722077-0c91-4a21-a7b9-505e84beda06 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:52.157635 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27722077-0c91-4a21-a7b9-505e84beda06 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:52.157635 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27722077-0c91-4a21-a7b9-505e84beda06 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:52.159020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 664/1318] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:10:52.164270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7c29a-1103-4d09-aa14-588d730f9ce3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:52.164657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7c29a-1103-4d09-aa14-588d730f9ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:52.165303 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7c29a-1103-4d09-aa14-588d730f9ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:52.230846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-38d7c29a-1103-4d09-aa14-588d730f9ce3 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:10:52.232111 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-38d7c29a-1103-4d09-aa14-588d730f9ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:52.324605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 655/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:10:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:10:52.612493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27722077-0c91-4a21-a7b9-505e84beda06 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:10:52.614050 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-27722077-0c91-4a21-a7b9-505e84beda06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:52.717492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27722077-0c91-4a21-a7b9-505e84beda06 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:10:52.801279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452c8c3-e9bf-4850-9dc7-931954fc3faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:10:52.801871 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452c8c3-e9bf-4850-9dc7-931954fc3faf service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:52.802146 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452c8c3-e9bf-4850-9dc7-931954fc3faf service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:52.802413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452c8c3-e9bf-4850-9dc7-931954fc3faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:52.804033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4452c8c3-e9bf-4850-9dc7-931954fc3faf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:52.811022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:10:52.911733 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452c8c3-e9bf-4850-9dc7-931954fc3faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:10:52.913157 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452c8c3-e9bf-4850-9dc7-931954fc3faf service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:10:52.932600 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 665/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:10:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:10:55.726696 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac2b95-b80a-4199-b169-7169e7e7aa78 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:55.727839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac2b95-b80a-4199-b169-7169e7e7aa78 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:55.727839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac2b95-b80a-4199-b169-7169e7e7aa78 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:55.729637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 656/1321] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:10:55.735187 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa705fa8-f02f-46f2-ac0f-00703d6f9d31 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:55.735630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa705fa8-f02f-46f2-ac0f-00703d6f9d31 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:55.735747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa705fa8-f02f-46f2-ac0f-00703d6f9d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:55.808587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-fa705fa8-f02f-46f2-ac0f-00703d6f9d31 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:10:55.809825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fa705fa8-f02f-46f2-ac0f-00703d6f9d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:55.873958 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:10:55.916807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 666/1322] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:10:56.198716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac2b95-b80a-4199-b169-7169e7e7aa78 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:10:56.200297 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-95ac2b95-b80a-4199-b169-7169e7e7aa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:56.221173 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:10:56.305727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac2b95-b80a-4199-b169-7169e7e7aa78 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:10:56.380378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf8539-51bc-4ba8-9fb4-5ea8da84c9fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:10:56.380988 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf8539-51bc-4ba8-9fb4-5ea8da84c9fa service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:56.381267 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf8539-51bc-4ba8-9fb4-5ea8da84c9fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:56.381537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf8539-51bc-4ba8-9fb4-5ea8da84c9fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:56.383275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-eebf8539-51bc-4ba8-9fb4-5ea8da84c9fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:56.458359 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:10:56.499107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf8539-51bc-4ba8-9fb4-5ea8da84c9fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:10:56.500543 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf8539-51bc-4ba8-9fb4-5ea8da84c9fa service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:10:56.519850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 657/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:10:58.725623 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1ead-644d-4474-b55f-fa6877c71ee8 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:58.726155 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1ead-644d-4474-b55f-fa6877c71ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:58.726155 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1ead-644d-4474-b55f-fa6877c71ee8 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:58.728571 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 667/1324] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:10:58.733583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20919737-ca85-47a3-9959-1dc6b3dcb343 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:58.733984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20919737-ca85-47a3-9959-1dc6b3dcb343 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:58.734134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20919737-ca85-47a3-9959-1dc6b3dcb343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:58.800848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-20919737-ca85-47a3-9959-1dc6b3dcb343 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:10:58.802071 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-20919737-ca85-47a3-9959-1dc6b3dcb343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:58.908465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 658/1325] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:10:59.205606 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41973aa-0de3-4f03-ad84-1761ea7433a6 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:59.205998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41973aa-0de3-4f03-ad84-1761ea7433a6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:59.206336 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41973aa-0de3-4f03-ad84-1761ea7433a6 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:59.207803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 668/1326] 10.222.0.20 () {54 vars in 965 bytes} [Tue Sep 13 01:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:10:59.214560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc21365-b13d-42e0-9724-ad8ebe1e1910 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:59.214908 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc21365-b13d-42e0-9724-ad8ebe1e1910 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:59.215300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc21365-b13d-42e0-9724-ad8ebe1e1910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:59.246872 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:10:59.290897 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2cc21365-b13d-42e0-9724-ad8ebe1e1910 None None] MFA Rules not processed for user `a672e63fa5e345679bac3d67301fe875`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:10:59.292202 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2cc21365-b13d-42e0-9724-ad8ebe1e1910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:59.368971 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 659/1327] 10.222.0.20 () {58 vars in 1062 bytes} [Tue Sep 13 01:10:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:10:59.377521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41973aa-0de3-4f03-ad84-1761ea7433a6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:10:59.379222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b41973aa-0de3-4f03-ad84-1761ea7433a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:59.490388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41973aa-0de3-4f03-ad84-1761ea7433a6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:10:59.565479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28b93f-97e3-4cd4-8142-51ffd5a0a97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:10:59.566084 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28b93f-97e3-4cd4-8142-51ffd5a0a97a service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:10:59.566359 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28b93f-97e3-4cd4-8142-51ffd5a0a97a service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:10:59.566625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28b93f-97e3-4cd4-8142-51ffd5a0a97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:10:59.568268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3c28b93f-97e3-4cd4-8142-51ffd5a0a97a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:10:59.585207 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:10:59.678879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28b93f-97e3-4cd4-8142-51ffd5a0a97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:10:59.680877 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28b93f-97e3-4cd4-8142-51ffd5a0a97a service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:10:59.699159 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 669/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:11:02.197881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677015c0-f1d2-4090-9619-9120a5d38873 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:02.198404 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677015c0-f1d2-4090-9619-9120a5d38873 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:02.198404 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677015c0-f1d2-4090-9619-9120a5d38873 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:02.199802 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 660/1329] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:02.205485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853f48a-14b0-4976-8c51-4cec27eca83e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:02.205884 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853f48a-14b0-4976-8c51-4cec27eca83e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:02.206041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853f48a-14b0-4976-8c51-4cec27eca83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:02.274195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3853f48a-14b0-4976-8c51-4cec27eca83e None None] MFA Rules not processed for user `fae5f077c4984c84b963e756212a526f`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:02.275658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3853f48a-14b0-4976-8c51-4cec27eca83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:02.341068 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:02.375314 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 670/1330] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:11:02 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:02.662993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677015c0-f1d2-4090-9619-9120a5d38873 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:11:02.665121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-677015c0-f1d2-4090-9619-9120a5d38873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:02.778258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677015c0-f1d2-4090-9619-9120a5d38873 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:11:02.799274 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:02.860456 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a70f69-3739-4dda-b065-cb82e4c5e1d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:11:02.861064 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a70f69-3739-4dda-b065-cb82e4c5e1d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:02.861346 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a70f69-3739-4dda-b065-cb82e4c5e1d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:02.861620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a70f69-3739-4dda-b065-cb82e4c5e1d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:02.863368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-81a70f69-3739-4dda-b065-cb82e4c5e1d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:02.988950 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a70f69-3739-4dda-b065-cb82e4c5e1d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:11:02.990395 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a70f69-3739-4dda-b065-cb82e4c5e1d1 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:11:03.012136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 661/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:11:02 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:11:05.529483 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9e846-946a-43a7-9625-e293be0c4ee0 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:05.530017 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9e846-946a-43a7-9625-e293be0c4ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:05.530017 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9e846-946a-43a7-9625-e293be0c4ee0 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:05.531400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 671/1332] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:05.536534 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1edb0b-e138-44e4-bdae-729cd37cb2b2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:05.536938 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1edb0b-e138-44e4-bdae-729cd37cb2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:05.537089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1edb0b-e138-44e4-bdae-729cd37cb2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:05.600275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:05.603347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8f1edb0b-e138-44e4-bdae-729cd37cb2b2 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:05.605104 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8f1edb0b-e138-44e4-bdae-729cd37cb2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:05.701684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 662/1333] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:11:05.980641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9e846-946a-43a7-9625-e293be0c4ee0 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:11:05.982156 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d1b9e846-946a-43a7-9625-e293be0c4ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:06.087248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9e846-946a-43a7-9625-e293be0c4ee0 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:11:06.159637 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafd696-a8f8-4a72-8586-f7b5c625b347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:11:06.160233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafd696-a8f8-4a72-8586-f7b5c625b347 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:06.160511 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafd696-a8f8-4a72-8586-f7b5c625b347 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:06.160782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafd696-a8f8-4a72-8586-f7b5c625b347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:06.162351 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1fafd696-a8f8-4a72-8586-f7b5c625b347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:06.188365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:06.268765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafd696-a8f8-4a72-8586-f7b5c625b347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:11:06.270219 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafd696-a8f8-4a72-8586-f7b5c625b347 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:11:06.287943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 672/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:11:08.490478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2e528-c9b0-4f11-b642-e15fbdeb16b6 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:08.490997 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2e528-c9b0-4f11-b642-e15fbdeb16b6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:08.490997 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2e528-c9b0-4f11-b642-e15fbdeb16b6 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:08.492387 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 663/1335] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:08.498280 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1a5e1-641e-4725-bd20-2fca7da1e6c7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:08.498682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1a5e1-641e-4725-bd20-2fca7da1e6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:08.498824 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1a5e1-641e-4725-bd20-2fca7da1e6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:08.564370 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1bf1a5e1-641e-4725-bd20-2fca7da1e6c7 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:08.565570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1bf1a5e1-641e-4725-bd20-2fca7da1e6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:08.647469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:08.670293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 673/1336] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:08.964240 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2e528-c9b0-4f11-b642-e15fbdeb16b6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:11:08.965776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1fd2e528-c9b0-4f11-b642-e15fbdeb16b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:09.068135 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2e528-c9b0-4f11-b642-e15fbdeb16b6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:11:09.097192 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:09.142857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899041e-d45c-4b99-8d8a-09f618e9cef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:11:09.143493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899041e-d45c-4b99-8d8a-09f618e9cef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:09.143774 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899041e-d45c-4b99-8d8a-09f618e9cef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:09.144046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899041e-d45c-4b99-8d8a-09f618e9cef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:09.145632 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b899041e-d45c-4b99-8d8a-09f618e9cef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:09.254647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899041e-d45c-4b99-8d8a-09f618e9cef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:11:09.256032 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899041e-d45c-4b99-8d8a-09f618e9cef2 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:11:09.273940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 664/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:11:11.768055 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456abf1-b195-45f4-ba93-5aa0c56ab338 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:11.768573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456abf1-b195-45f4-ba93-5aa0c56ab338 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:11.768573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456abf1-b195-45f4-ba93-5aa0c56ab338 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:11.769944 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 674/1338] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:11.775699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0751a3-4009-4715-b45c-9e6633cce1a1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:11.776126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0751a3-4009-4715-b45c-9e6633cce1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:11.776238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0751a3-4009-4715-b45c-9e6633cce1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:11.840985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8f0751a3-4009-4715-b45c-9e6633cce1a1 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:11.842222 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8f0751a3-4009-4715-b45c-9e6633cce1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:11.850378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:11.938258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 665/1339] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:11:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:12.218819 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456abf1-b195-45f4-ba93-5aa0c56ab338 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:11:12.220396 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7456abf1-b195-45f4-ba93-5aa0c56ab338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:12.323125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456abf1-b195-45f4-ba93-5aa0c56ab338 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:11:12.396931 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3cbff-788a-480a-b54e-10e8c0a3d710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:11:12.397529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3cbff-788a-480a-b54e-10e8c0a3d710 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:12.397807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3cbff-788a-480a-b54e-10e8c0a3d710 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:12.398079 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3cbff-788a-480a-b54e-10e8c0a3d710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:12.399685 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c6c3cbff-788a-480a-b54e-10e8c0a3d710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:12.436018 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:12.509168 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3cbff-788a-480a-b54e-10e8c0a3d710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:11:12.510539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3cbff-788a-480a-b54e-10e8c0a3d710 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:11:12.529162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 675/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:11:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:11:16.711347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c6237-08de-4b79-84e6-fe74aede9b35 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:16.711851 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c6237-08de-4b79-84e6-fe74aede9b35 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:16.711851 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c6237-08de-4b79-84e6-fe74aede9b35 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:16.713160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 666/1341] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:16.718345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba985330-80ff-474f-beeb-b5e54f291e1c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:16.718748 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba985330-80ff-474f-beeb-b5e54f291e1c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:16.718892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba985330-80ff-474f-beeb-b5e54f291e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:16.785012 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ba985330-80ff-474f-beeb-b5e54f291e1c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:16.786207 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ba985330-80ff-474f-beeb-b5e54f291e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:16.872568 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:16.884704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 676/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:17.173065 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c6237-08de-4b79-84e6-fe74aede9b35 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:11:17.174629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-085c6237-08de-4b79-84e6-fe74aede9b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:17.278015 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c6237-08de-4b79-84e6-fe74aede9b35 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:11:17.317238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:17.355562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868787e-745b-463f-b5c2-80541c6349d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:11:17.356174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868787e-745b-463f-b5c2-80541c6349d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:17.356521 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868787e-745b-463f-b5c2-80541c6349d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:17.356729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868787e-745b-463f-b5c2-80541c6349d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:17.358314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2868787e-745b-463f-b5c2-80541c6349d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:17.470481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868787e-745b-463f-b5c2-80541c6349d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:11:17.471982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868787e-745b-463f-b5c2-80541c6349d5 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:11:17.490277 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 667/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:11:20.341190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949847a-18a3-4cd3-be16-078701d89a89 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:20.341757 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949847a-18a3-4cd3-be16-078701d89a89 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:20.341757 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949847a-18a3-4cd3-be16-078701d89a89 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:20.343128 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 677/1344] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:20.348399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcba7db-8d2f-4dc6-9cec-02a2e69dcfdd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:20.348808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcba7db-8d2f-4dc6-9cec-02a2e69dcfdd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:20.348953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcba7db-8d2f-4dc6-9cec-02a2e69dcfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:20.416466 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6fcba7db-8d2f-4dc6-9cec-02a2e69dcfdd None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:20.417712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6fcba7db-8d2f-4dc6-9cec-02a2e69dcfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:20.437947 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:20.522077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 668/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:11:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:20.802082 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949847a-18a3-4cd3-be16-078701d89a89 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:11:20.803665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9949847a-18a3-4cd3-be16-078701d89a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:20.913714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949847a-18a3-4cd3-be16-078701d89a89 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:11:20.997839 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89de490-c706-44b6-bb17-6e292ee33eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:11:20.998359 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89de490-c706-44b6-bb17-6e292ee33eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:20.998639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89de490-c706-44b6-bb17-6e292ee33eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:20.998914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89de490-c706-44b6-bb17-6e292ee33eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:21.000529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d89de490-c706-44b6-bb17-6e292ee33eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:21.048268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:21.122749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89de490-c706-44b6-bb17-6e292ee33eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:11:21.124236 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89de490-c706-44b6-bb17-6e292ee33eb3 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:11:21.142940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 678/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:11:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:11:25.311198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974b8eb-ab21-4896-831c-4da01c63e4a1 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:25.311708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974b8eb-ab21-4896-831c-4da01c63e4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:25.311836 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974b8eb-ab21-4896-831c-4da01c63e4a1 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:25.313119 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 669/1347] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:25.319466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67151f4b-f6ce-4afe-9682-45bc34d9f677 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:25.319900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67151f4b-f6ce-4afe-9682-45bc34d9f677 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:25.320003 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67151f4b-f6ce-4afe-9682-45bc34d9f677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:25.390637 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-67151f4b-f6ce-4afe-9682-45bc34d9f677 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:25.391896 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-67151f4b-f6ce-4afe-9682-45bc34d9f677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:25.510289 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:25.512888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 679/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:25.795532 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974b8eb-ab21-4896-831c-4da01c63e4a1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:11:25.797061 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2974b8eb-ab21-4896-831c-4da01c63e4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:25.898749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974b8eb-ab21-4896-831c-4da01c63e4a1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:11:25.945821 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:25.972510 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dc989-f4cd-4b2c-a376-23e3081e24ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:11:25.973121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dc989-f4cd-4b2c-a376-23e3081e24ff service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:25.973394 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dc989-f4cd-4b2c-a376-23e3081e24ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:25.973660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dc989-f4cd-4b2c-a376-23e3081e24ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:25.975290 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bf2dc989-f4cd-4b2c-a376-23e3081e24ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:26.084743 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dc989-f4cd-4b2c-a376-23e3081e24ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:11:26.086646 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dc989-f4cd-4b2c-a376-23e3081e24ff service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:11:26.104714 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 670/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:11:30.993193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aed28e-751c-46ec-b005-98c288b4e664 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:30.993691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aed28e-751c-46ec-b005-98c288b4e664 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:30.994765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aed28e-751c-46ec-b005-98c288b4e664 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:30.997479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 680/1350] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 13 01:11:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:31.002925 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b06cb-9150-413f-9ee1-d0aafb4bcaaa None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:31.003726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b06cb-9150-413f-9ee1-d0aafb4bcaaa None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:31.004211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b06cb-9150-413f-9ee1-d0aafb4bcaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:31.122946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b74b06cb-9150-413f-9ee1-d0aafb4bcaaa None None] MFA Rules not processed for user `0c5e6dae854a44a0ad6628e7dd69dfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:31.124274 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b74b06cb-9150-413f-9ee1-d0aafb4bcaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:31.149591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:31.305905 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 671/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 13 01:11:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:35.564353 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4767-6e45-4633-8aa3-df633448d379 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:35.564787 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4767-6e45-4633-8aa3-df633448d379 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:35.564897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4767-6e45-4633-8aa3-df633448d379 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:35.566416 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 681/1352] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 13 01:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:35.573162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8c914-8a19-4454-a4c4-51e5a5dd906d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:35.573619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8c914-8a19-4454-a4c4-51e5a5dd906d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:35.573706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8c914-8a19-4454-a4c4-51e5a5dd906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:35.654090 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9ea8c914-8a19-4454-a4c4-51e5a5dd906d None None] MFA Rules not processed for user `0c5e6dae854a44a0ad6628e7dd69dfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:35.655343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9ea8c914-8a19-4454-a4c4-51e5a5dd906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:35.731528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:35.769827 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 672/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 13 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:37.105884 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ec158-552e-4f74-b4bd-1860b6f52eb3 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:37.106406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ec158-552e-4f74-b4bd-1860b6f52eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:37.106406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ec158-552e-4f74-b4bd-1860b6f52eb3 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:37.107791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 682/1354] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 13 01:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:37.113356 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a3498-3dfa-4449-843b-5211b27866e4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:37.113824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a3498-3dfa-4449-843b-5211b27866e4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:37.114026 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a3498-3dfa-4449-843b-5211b27866e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:37.192759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f01a3498-3dfa-4449-843b-5211b27866e4 None None] MFA Rules not processed for user `0c5e6dae854a44a0ad6628e7dd69dfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:37.193968 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f01a3498-3dfa-4449-843b-5211b27866e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:37.303996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 673/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 13 01:11:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:40.839893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b26f4-f3bd-42ad-aead-72f6cf68449e None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:40.840822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b26f4-f3bd-42ad-aead-72f6cf68449e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:40.841275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b26f4-f3bd-42ad-aead-72f6cf68449e None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:40.842809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 683/1356] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:40.850331 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac230-cbed-4bdb-8a4d-3ab4e3c57ab2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:40.852734 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac230-cbed-4bdb-8a4d-3ab4e3c57ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:40.855326 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac230-cbed-4bdb-8a4d-3ab4e3c57ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:40.899391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:40.933027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cd9ac230-cbed-4bdb-8a4d-3ab4e3c57ab2 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:40.934143 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cd9ac230-cbed-4bdb-8a4d-3ab4e3c57ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:41.039154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 674/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:41.342710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5f62e-5ad9-4fcb-9e0e-adb685e5e9d2 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:41.343345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5f62e-5ad9-4fcb-9e0e-adb685e5e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:41.343784 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5f62e-5ad9-4fcb-9e0e-adb685e5e9d2 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:41.345522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 684/1358] 10.222.0.20 () {54 vars in 962 bytes} [Tue Sep 13 01:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:41.357185 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b002f-fe74-4ad0-9871-1bbdfd0bac0b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:41.357960 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b002f-fe74-4ad0-9871-1bbdfd0bac0b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:41.358345 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b002f-fe74-4ad0-9871-1bbdfd0bac0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:41.445945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8a3b002f-fe74-4ad0-9871-1bbdfd0bac0b None None] MFA Rules not processed for user `fadc83bec6be41979e1aa4d71f8fc2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:41.447328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8a3b002f-fe74-4ad0-9871-1bbdfd0bac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:41.499375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:41.578055 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 675/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Sep 13 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:41.586769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5f62e-5ad9-4fcb-9e0e-adb685e5e9d2 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:11:41.588365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-92e5f62e-5ad9-4fcb-9e0e-adb685e5e9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:41.746051 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5f62e-5ad9-4fcb-9e0e-adb685e5e9d2 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:11:41.824222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:41.867405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a437c-c04f-49aa-8b0e-642b16872f54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:11:41.868058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a437c-c04f-49aa-8b0e-642b16872f54 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:41.868437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a437c-c04f-49aa-8b0e-642b16872f54 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:41.868833 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a437c-c04f-49aa-8b0e-642b16872f54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:41.870548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-928a437c-c04f-49aa-8b0e-642b16872f54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:41.977826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a437c-c04f-49aa-8b0e-642b16872f54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:11:41.979492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a437c-c04f-49aa-8b0e-642b16872f54 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:11:41.999530 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 685/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:11:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:11:44.401157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd52719-dcbf-4640-b649-8e3b7867744c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:44.401686 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd52719-dcbf-4640-b649-8e3b7867744c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:44.401686 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd52719-dcbf-4640-b649-8e3b7867744c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:44.403285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 676/1361] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:44.408432 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6601f3a-be01-4161-a119-8a5fbfd12674 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:44.408814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6601f3a-be01-4161-a119-8a5fbfd12674 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:44.409004 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6601f3a-be01-4161-a119-8a5fbfd12674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:44.491204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a6601f3a-be01-4161-a119-8a5fbfd12674 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:44.493299 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a6601f3a-be01-4161-a119-8a5fbfd12674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:44.534313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:44.608462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 686/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:44.900927 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd52719-dcbf-4640-b649-8e3b7867744c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:11:44.902423 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dfd52719-dcbf-4640-b649-8e3b7867744c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:45.078950 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd52719-dcbf-4640-b649-8e3b7867744c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:11:45.092071 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:45.238994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2449d-089f-4448-a416-b819ee87fd37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:11:45.239649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2449d-089f-4448-a416-b819ee87fd37 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:45.239934 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2449d-089f-4448-a416-b819ee87fd37 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:45.240208 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2449d-089f-4448-a416-b819ee87fd37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:45.241848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-94e2449d-089f-4448-a416-b819ee87fd37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:45.337682 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2449d-089f-4448-a416-b819ee87fd37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:11:45.339235 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2449d-089f-4448-a416-b819ee87fd37 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:11:45.358175 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 677/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:11:47.878263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e827085-a13d-4e75-a406-051862005e22 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:47.878796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e827085-a13d-4e75-a406-051862005e22 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:47.878796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e827085-a13d-4e75-a406-051862005e22 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:47.880353 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 687/1364] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:47.885801 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b48ccf-e3b8-43d9-a481-41a0852b0275 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:47.886255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b48ccf-e3b8-43d9-a481-41a0852b0275 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:47.886339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b48ccf-e3b8-43d9-a481-41a0852b0275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:47.902475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:47.956425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c2b48ccf-e3b8-43d9-a481-41a0852b0275 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:47.957635 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c2b48ccf-e3b8-43d9-a481-41a0852b0275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:48.064376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 678/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:48.357823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fcd8b-0117-4ffe-b7bc-6c5fe55f161a None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:48.358377 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fcd8b-0117-4ffe-b7bc-6c5fe55f161a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:48.358756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fcd8b-0117-4ffe-b7bc-6c5fe55f161a None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:48.360399 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 688/1366] 10.222.0.20 () {54 vars in 962 bytes} [Tue Sep 13 01:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:48.365691 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b293ab0-da7e-431a-aadd-d39d13722878 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:48.365982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b293ab0-da7e-431a-aadd-d39d13722878 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:48.366254 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b293ab0-da7e-431a-aadd-d39d13722878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:48.451430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8b293ab0-da7e-431a-aadd-d39d13722878 None None] MFA Rules not processed for user `fadc83bec6be41979e1aa4d71f8fc2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:48.452721 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8b293ab0-da7e-431a-aadd-d39d13722878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:48.489256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:48.575112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 679/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Sep 13 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:48.583247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fcd8b-0117-4ffe-b7bc-6c5fe55f161a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:11:48.584802 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b59fcd8b-0117-4ffe-b7bc-6c5fe55f161a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:48.743133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fcd8b-0117-4ffe-b7bc-6c5fe55f161a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:11:48.765292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:48.870940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1c921-dffa-4af9-ae74-566c6619b3b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:11:48.871935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c921-dffa-4af9-ae74-566c6619b3b2 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:48.872367 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c921-dffa-4af9-ae74-566c6619b3b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:48.872789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c921-dffa-4af9-ae74-566c6619b3b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:48.875217 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a0e1c921-dffa-4af9-ae74-566c6619b3b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:48.977235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1c921-dffa-4af9-ae74-566c6619b3b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:11:48.979085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1c921-dffa-4af9-ae74-566c6619b3b2 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:11:49.001139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 689/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:11:49.125836 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f035e-1d80-4752-85df-9ca102ec8fac None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:49.126539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f035e-1d80-4752-85df-9ca102ec8fac None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:49.126539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f035e-1d80-4752-85df-9ca102ec8fac None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:49.128664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 680/1369] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:49.140704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20d118-47dd-41a5-aacc-fc2a688817ba None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:49.141145 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20d118-47dd-41a5-aacc-fc2a688817ba None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:49.141428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20d118-47dd-41a5-aacc-fc2a688817ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:49.180413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:49.231250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8f20d118-47dd-41a5-aacc-fc2a688817ba None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:49.239323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8f20d118-47dd-41a5-aacc-fc2a688817ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:49.356934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 690/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:49.659425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe47623-3b1c-4dc5-9ecc-ab21a42b7415 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:49.659713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe47623-3b1c-4dc5-9ecc-ab21a42b7415 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:49.659987 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe47623-3b1c-4dc5-9ecc-ab21a42b7415 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:49.661535 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 681/1371] 10.222.0.20 () {54 vars in 964 bytes} [Tue Sep 13 01:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:49.667058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17842f-9379-41b0-8a14-d1ea21c91253 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:49.667378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17842f-9379-41b0-8a14-d1ea21c91253 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:49.667652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17842f-9379-41b0-8a14-d1ea21c91253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:49.752523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7d17842f-9379-41b0-8a14-d1ea21c91253 None None] MFA Rules not processed for user `ff33b1a82c4c42f6ab4a0588d5b616db`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:49.753873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7d17842f-9379-41b0-8a14-d1ea21c91253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:49.807672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:49.841387 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 691/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Tue Sep 13 01:11:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:49.849330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe47623-3b1c-4dc5-9ecc-ab21a42b7415 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:11:49.851660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cfe47623-3b1c-4dc5-9ecc-ab21a42b7415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:49.968491 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe47623-3b1c-4dc5-9ecc-ab21a42b7415 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:11:50.025112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:50.058785 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc6471-ab41-4ba7-b7dd-b609fa6410ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:11:50.059562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc6471-ab41-4ba7-b7dd-b609fa6410ba service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:50.059850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc6471-ab41-4ba7-b7dd-b609fa6410ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:50.060125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc6471-ab41-4ba7-b7dd-b609fa6410ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:50.061750 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-09bc6471-ab41-4ba7-b7dd-b609fa6410ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:50.189342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc6471-ab41-4ba7-b7dd-b609fa6410ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:11:50.190844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc6471-ab41-4ba7-b7dd-b609fa6410ba service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:11:50.211955 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 682/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:11:51.288691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd646d9f-2df4-4aec-833e-c7db5c0cdd2c None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:51.289369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd646d9f-2df4-4aec-833e-c7db5c0cdd2c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:51.289369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd646d9f-2df4-4aec-833e-c7db5c0cdd2c None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:51.290755 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 692/1374] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:51.296704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f70f-5f1e-470b-8f87-d6c68c17b659 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:51.297163 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f70f-5f1e-470b-8f87-d6c68c17b659 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:51.297444 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f70f-5f1e-470b-8f87-d6c68c17b659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:51.373209 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-00f2f70f-5f1e-470b-8f87-d6c68c17b659 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:51.374453 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-00f2f70f-5f1e-470b-8f87-d6c68c17b659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:51.395679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:51.483192 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 683/1375] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:51.775815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd646d9f-2df4-4aec-833e-c7db5c0cdd2c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:11:51.777489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bd646d9f-2df4-4aec-833e-c7db5c0cdd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:51.943695 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd646d9f-2df4-4aec-833e-c7db5c0cdd2c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:11:51.999523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:52.066546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2e9bd-7fa4-499c-81af-c0916c28077a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:11:52.067109 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2e9bd-7fa4-499c-81af-c0916c28077a service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:52.067406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2e9bd-7fa4-499c-81af-c0916c28077a service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:52.067693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2e9bd-7fa4-499c-81af-c0916c28077a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:52.069406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-00a2e9bd-7fa4-499c-81af-c0916c28077a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:52.166992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2e9bd-7fa4-499c-81af-c0916c28077a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:11:52.168657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2e9bd-7fa4-499c-81af-c0916c28077a service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:11:52.189523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 693/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:11:54.440681 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86905fbb-84b1-4faf-a520-c4a2af16e3f9 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:54.441211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86905fbb-84b1-4faf-a520-c4a2af16e3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:54.441211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86905fbb-84b1-4faf-a520-c4a2af16e3f9 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:54.442619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 684/1377] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:54.448101 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc871e-74bd-428e-b57a-910a061b6f87 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:54.448525 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc871e-74bd-428e-b57a-910a061b6f87 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:54.448648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc871e-74bd-428e-b57a-910a061b6f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:54.521631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f5bc871e-74bd-428e-b57a-910a061b6f87 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:54.523544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f5bc871e-74bd-428e-b57a-910a061b6f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:54.531890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:54.635105 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 694/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:54.931505 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86905fbb-84b1-4faf-a520-c4a2af16e3f9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:11:54.933292 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-86905fbb-84b1-4faf-a520-c4a2af16e3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:55.091421 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86905fbb-84b1-4faf-a520-c4a2af16e3f9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:11:55.095708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:55.212103 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc89a8-a4a8-4966-bf13-b78b0c9b1e17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:11:55.212626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc89a8-a4a8-4966-bf13-b78b0c9b1e17 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:55.212930 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc89a8-a4a8-4966-bf13-b78b0c9b1e17 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:55.213179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc89a8-a4a8-4966-bf13-b78b0c9b1e17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:55.214741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0cfc89a8-a4a8-4966-bf13-b78b0c9b1e17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:55.321203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc89a8-a4a8-4966-bf13-b78b0c9b1e17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:11:55.322796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc89a8-a4a8-4966-bf13-b78b0c9b1e17 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:11:55.342654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 685/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:11:57.569857 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bad7cc-437f-46ba-b6b4-56751d25ff75 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:57.570312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bad7cc-437f-46ba-b6b4-56751d25ff75 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:57.570409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bad7cc-437f-46ba-b6b4-56751d25ff75 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:57.571812 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 695/1380] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:11:57.577550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c057f1-b919-49df-b2b1-448d51c0e1c8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:57.577939 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c057f1-b919-49df-b2b1-448d51c0e1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:57.578099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c057f1-b919-49df-b2b1-448d51c0e1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:57.591426 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:57.664841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-92c057f1-b919-49df-b2b1-448d51c0e1c8 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:11:57.667927 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-92c057f1-b919-49df-b2b1-448d51c0e1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:57.822126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 686/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:11:58.171889 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bad7cc-437f-46ba-b6b4-56751d25ff75 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:11:58.173681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-42bad7cc-437f-46ba-b6b4-56751d25ff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:58.325114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:58.337045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bad7cc-437f-46ba-b6b4-56751d25ff75 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:11:58.471226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328fc64-2816-4aaf-9135-a0f6bd92330b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:11:58.472280 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328fc64-2816-4aaf-9135-a0f6bd92330b service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:11:58.472814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328fc64-2816-4aaf-9135-a0f6bd92330b service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:11:58.473170 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328fc64-2816-4aaf-9135-a0f6bd92330b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:11:58.475226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9328fc64-2816-4aaf-9135-a0f6bd92330b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:11:58.589202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328fc64-2816-4aaf-9135-a0f6bd92330b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:11:58.591111 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328fc64-2816-4aaf-9135-a0f6bd92330b service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:11:58.605485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:58.618344 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 696/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:00.966383 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f482de8-8e84-48e3-8388-7b73ee3929d1 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:00.966974 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f482de8-8e84-48e3-8388-7b73ee3929d1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:00.967503 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f482de8-8e84-48e3-8388-7b73ee3929d1 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:00.970122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 687/1383] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:12:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:00.976060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccf8cd-ac44-416c-a6ea-84d86a200fab None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:00.976469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccf8cd-ac44-416c-a6ea-84d86a200fab None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:00.976677 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccf8cd-ac44-416c-a6ea-84d86a200fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:01.055034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-24ccf8cd-ac44-416c-a6ea-84d86a200fab None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:01.056423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-24ccf8cd-ac44-416c-a6ea-84d86a200fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:01.173119 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 697/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:01.480516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f482de8-8e84-48e3-8388-7b73ee3929d1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:01.481984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0f482de8-8e84-48e3-8388-7b73ee3929d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:01.586505 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:01.650936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f482de8-8e84-48e3-8388-7b73ee3929d1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:01.774418 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5043ba-7397-46fe-8955-b3371c62ace4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:01.775081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5043ba-7397-46fe-8955-b3371c62ace4 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:01.775363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5043ba-7397-46fe-8955-b3371c62ace4 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:01.775638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5043ba-7397-46fe-8955-b3371c62ace4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:01.777396 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cd5043ba-7397-46fe-8955-b3371c62ace4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:01.832299 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:01.875263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5043ba-7397-46fe-8955-b3371c62ace4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:01.876857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5043ba-7397-46fe-8955-b3371c62ace4 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:01.894823 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 688/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:04.117726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ddb91-fe84-4495-b8d6-25736b524ede None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:04.118297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ddb91-fe84-4495-b8d6-25736b524ede None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:04.118297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ddb91-fe84-4495-b8d6-25736b524ede None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:04.119665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 698/1386] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:04.125042 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04e72b-e638-404b-bbf1-7ea39432f3bf None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:04.125464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04e72b-e638-404b-bbf1-7ea39432f3bf None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:04.125598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04e72b-e638-404b-bbf1-7ea39432f3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:04.192403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cd04e72b-e638-404b-bbf1-7ea39432f3bf None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:04.193608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cd04e72b-e638-404b-bbf1-7ea39432f3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:04.291514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 689/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:04.584336 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ddb91-fe84-4495-b8d6-25736b524ede None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:04.585894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-267ddb91-fe84-4495-b8d6-25736b524ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:04.664311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:04.735996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ddb91-fe84-4495-b8d6-25736b524ede None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:04.848016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bcf4b-e639-4ab7-a4d3-e42768e694f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:04.848624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bcf4b-e639-4ab7-a4d3-e42768e694f1 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:04.848901 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bcf4b-e639-4ab7-a4d3-e42768e694f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:04.849168 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bcf4b-e639-4ab7-a4d3-e42768e694f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:04.851267 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-497bcf4b-e639-4ab7-a4d3-e42768e694f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:04.889594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:04.964824 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bcf4b-e639-4ab7-a4d3-e42768e694f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:04.966433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bcf4b-e639-4ab7-a4d3-e42768e694f1 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:04.985110 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 699/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:05.561762 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37a147-316b-44a3-9324-767659f4775a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:05.562386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37a147-316b-44a3-9324-767659f4775a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:05.562386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37a147-316b-44a3-9324-767659f4775a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:05.563684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 690/1389] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:05.569431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9cac2-6173-41ab-8bbb-79f0eb2d180c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:05.569841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9cac2-6173-41ab-8bbb-79f0eb2d180c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:05.570143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9cac2-6173-41ab-8bbb-79f0eb2d180c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:05.637821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ecb9cac2-6173-41ab-8bbb-79f0eb2d180c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:05.639029 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ecb9cac2-6173-41ab-8bbb-79f0eb2d180c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:05.736906 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 700/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:12:06.035863 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74244af-6094-4ced-bfe8-f5e79fef41ea None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:06.036174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74244af-6094-4ced-bfe8-f5e79fef41ea None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:06.036452 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74244af-6094-4ced-bfe8-f5e79fef41ea None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:06.038365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 691/1391] 10.222.0.20 () {54 vars in 966 bytes} [Tue Sep 13 01:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:06.043951 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609b639-16d4-44c4-8b22-41b4c63f2f09 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:06.044313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609b639-16d4-44c4-8b22-41b4c63f2f09 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:06.044666 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609b639-16d4-44c4-8b22-41b4c63f2f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:06.060496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:06.125275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3609b639-16d4-44c4-8b22-41b4c63f2f09 None None] MFA Rules not processed for user `50c78d95e6774755b11508fc1954ad5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:06.126505 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3609b639-16d4-44c4-8b22-41b4c63f2f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:06.202642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 701/1392] 10.222.0.20 () {58 vars in 1063 bytes} [Tue Sep 13 01:12:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:06.212422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74244af-6094-4ced-bfe8-f5e79fef41ea None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:06.214014 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f74244af-6094-4ced-bfe8-f5e79fef41ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:06.245375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:06.318247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74244af-6094-4ced-bfe8-f5e79fef41ea None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:06.391903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad4aca-27fd-4dbe-b8af-b82ab020e663 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c78d95e6774755b11508fc1954ad5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:06.392511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad4aca-27fd-4dbe-b8af-b82ab020e663 service glance] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:06.392792 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad4aca-27fd-4dbe-b8af-b82ab020e663 service glance] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:06.393068 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad4aca-27fd-4dbe-b8af-b82ab020e663 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:06.394706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d4ad4aca-27fd-4dbe-b8af-b82ab020e663 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:06.479777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:06.516484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad4aca-27fd-4dbe-b8af-b82ab020e663 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:06.518205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad4aca-27fd-4dbe-b8af-b82ab020e663 service glance] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:06.538371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 692/1393] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:07.204179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ae2d4-6c45-47fb-9a41-234fc015d27e None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:07.204742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ae2d4-6c45-47fb-9a41-234fc015d27e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:07.204742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ae2d4-6c45-47fb-9a41-234fc015d27e None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:07.206248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 702/1394] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:07.212280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875b48-5bbe-42dd-9a2a-ae6350a3f043 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:07.212743 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875b48-5bbe-42dd-9a2a-ae6350a3f043 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:07.212866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875b48-5bbe-42dd-9a2a-ae6350a3f043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:07.282018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-95875b48-5bbe-42dd-9a2a-ae6350a3f043 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:07.284500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-95875b48-5bbe-42dd-9a2a-ae6350a3f043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:07.307422 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefbcab-d93d-4233-8886-8908abdfd3b0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:07.307704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefbcab-d93d-4233-8886-8908abdfd3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:07.307981 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefbcab-d93d-4233-8886-8908abdfd3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:07.376778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bbefbcab-d93d-4233-8886-8908abdfd3b0 None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:07.378003 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bbefbcab-d93d-4233-8886-8908abdfd3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:07.389552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 693/1395] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:07.437261 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:07.470817 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 703/1396] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 13 01:12:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:07.515466 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21c5d-0429-456a-be8b-6090e10c534d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:07.515751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21c5d-0429-456a-be8b-6090e10c534d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:07.516024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21c5d-0429-456a-be8b-6090e10c534d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:07.517575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 694/1397] 10.222.0.20 () {54 vars in 943 bytes} [Tue Sep 13 01:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:07.524067 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e40753-4960-4c20-aa90-c3b59bf1afc1 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:07.524452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e40753-4960-4c20-aa90-c3b59bf1afc1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:07.524832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e40753-4960-4c20-aa90-c3b59bf1afc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:07.604665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e1e40753-4960-4c20-aa90-c3b59bf1afc1 None None] MFA Rules not processed for user `e2414e53593b4e2084c895651fd0d0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:07.605785 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e1e40753-4960-4c20-aa90-c3b59bf1afc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:07.684703 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a21c5d-0429-456a-be8b-6090e10c534d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:07.686313 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b1a21c5d-0429-456a-be8b-6090e10c534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:07.717139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 704/1398] 10.222.0.20 () {58 vars in 1040 bytes} [Tue Sep 13 01:12:07 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:07.727307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e40753-4960-4c20-aa90-c3b59bf1afc1 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:07.730456 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:07.736906 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e40753-4960-4c20-aa90-c3b59bf1afc1 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:07.763308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:07.839860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a21c5d-0429-456a-be8b-6090e10c534d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:07.845517 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8f7d8-c3e4-457a-9ffe-39365716d5eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:07.846124 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f7d8-c3e4-457a-9ffe-39365716d5eb service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:07.846394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f7d8-c3e4-457a-9ffe-39365716d5eb service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:07.846658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f7d8-c3e4-457a-9ffe-39365716d5eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:07.848755 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bcf8f7d8-c3e4-457a-9ffe-39365716d5eb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:07.933019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8f7d8-c3e4-457a-9ffe-39365716d5eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:07.934542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8f7d8-c3e4-457a-9ffe-39365716d5eb service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:07.942396 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 705/1399] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:12:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 01:12:07.954666 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:07.957016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377b1ae-0c69-46e4-8712-d8026a545c2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:07.957719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377b1ae-0c69-46e4-8712-d8026a545c2e service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:07.958011 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377b1ae-0c69-46e4-8712-d8026a545c2e service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:07.958293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377b1ae-0c69-46e4-8712-d8026a545c2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:07.960493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8377b1ae-0c69-46e4-8712-d8026a545c2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:08.056209 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377b1ae-0c69-46e4-8712-d8026a545c2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:08.058575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377b1ae-0c69-46e4-8712-d8026a545c2e service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:08.080552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 695/1400] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:12:10.424993 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85244d69-9079-4011-98be-9e869fc432b6 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:10.424993 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85244d69-9079-4011-98be-9e869fc432b6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:10.424993 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85244d69-9079-4011-98be-9e869fc432b6 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:10.428362 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 706/1401] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:12:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:10.431462 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f337791-3920-4a24-98ee-fa15b416147b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:10.431914 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f337791-3920-4a24-98ee-fa15b416147b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:10.432283 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f337791-3920-4a24-98ee-fa15b416147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:10.502312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6f337791-3920-4a24-98ee-fa15b416147b None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:10.503755 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6f337791-3920-4a24-98ee-fa15b416147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:10.580842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:10.615352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 696/1402] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:10.909493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85244d69-9079-4011-98be-9e869fc432b6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:10.911283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-85244d69-9079-4011-98be-9e869fc432b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:10.981539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:11.081969 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85244d69-9079-4011-98be-9e869fc432b6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:11.214092 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab2dc8-c32a-42d5-9750-61bf03a68c3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:11.214730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2dc8-c32a-42d5-9750-61bf03a68c3a service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:11.215173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2dc8-c32a-42d5-9750-61bf03a68c3a service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:11.215462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2dc8-c32a-42d5-9750-61bf03a68c3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:11.217060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-62ab2dc8-c32a-42d5-9750-61bf03a68c3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:11.248218 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:11.342641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab2dc8-c32a-42d5-9750-61bf03a68c3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:11.344295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab2dc8-c32a-42d5-9750-61bf03a68c3a service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:11.362988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 707/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:13.644096 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95f1d7-b973-4459-b076-6c6c6fbcdd11 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:13.644666 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95f1d7-b973-4459-b076-6c6c6fbcdd11 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:13.644666 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95f1d7-b973-4459-b076-6c6c6fbcdd11 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:13.645999 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 697/1404] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:13.652364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b9ba5-9193-4d39-933a-6d91058485e8 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:13.652848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b9ba5-9193-4d39-933a-6d91058485e8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:13.652974 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b9ba5-9193-4d39-933a-6d91058485e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:13.729762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8d7b9ba5-9193-4d39-933a-6d91058485e8 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:13.730921 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8d7b9ba5-9193-4d39-933a-6d91058485e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:13.833585 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:13.841481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 708/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:12:14.136966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95f1d7-b973-4459-b076-6c6c6fbcdd11 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:14.138538 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-aa95f1d7-b973-4459-b076-6c6c6fbcdd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:14.298740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95f1d7-b973-4459-b076-6c6c6fbcdd11 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:14.359759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:14.426567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ed966-3ad3-4089-a597-69580ae97992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:14.427235 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ed966-3ad3-4089-a597-69580ae97992 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:14.427515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ed966-3ad3-4089-a597-69580ae97992 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:14.427790 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ed966-3ad3-4089-a597-69580ae97992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:14.429438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7e5ed966-3ad3-4089-a597-69580ae97992 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:14.529817 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ed966-3ad3-4089-a597-69580ae97992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:14.531461 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ed966-3ad3-4089-a597-69580ae97992 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:14.550390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 698/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:16.773678 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca486da-f5a2-444e-986f-0dd14fe0dc77 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:16.774219 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca486da-f5a2-444e-986f-0dd14fe0dc77 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:16.774219 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca486da-f5a2-444e-986f-0dd14fe0dc77 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:16.775605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 709/1407] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:16.780788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632c930-8830-44b0-9aac-dee8e797016f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:16.781205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632c930-8830-44b0-9aac-dee8e797016f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:16.781383 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632c930-8830-44b0-9aac-dee8e797016f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:16.852284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c632c930-8830-44b0-9aac-dee8e797016f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:16.853879 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c632c930-8830-44b0-9aac-dee8e797016f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:16.867101 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:16.970652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 699/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:17.264975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca486da-f5a2-444e-986f-0dd14fe0dc77 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:17.269109 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3ca486da-f5a2-444e-986f-0dd14fe0dc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:17.440447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca486da-f5a2-444e-986f-0dd14fe0dc77 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:17.520609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:17.574578 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59cbd53-4e92-4b95-ba09-ee127c7ce56b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:17.575597 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cbd53-4e92-4b95-ba09-ee127c7ce56b service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:17.575876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cbd53-4e92-4b95-ba09-ee127c7ce56b service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:17.576145 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cbd53-4e92-4b95-ba09-ee127c7ce56b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:17.578139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c59cbd53-4e92-4b95-ba09-ee127c7ce56b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:17.685582 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59cbd53-4e92-4b95-ba09-ee127c7ce56b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:17.687137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59cbd53-4e92-4b95-ba09-ee127c7ce56b service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:17.707279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 710/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:26.969076 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=38 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:27.704778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=64 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:31.103916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6ed4b-f149-4596-928c-ba288b748847 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:31.104461 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6ed4b-f149-4596-928c-ba288b748847 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:31.104461 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6ed4b-f149-4596-928c-ba288b748847 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:31.105794 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 700/1410] 10.222.0.20 () {54 vars in 918 bytes} [Tue Sep 13 01:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:31.110770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef6c33-c415-4f8e-9978-ffd0969a4b14 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:31.111222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef6c33-c415-4f8e-9978-ffd0969a4b14 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:31.111348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef6c33-c415-4f8e-9978-ffd0969a4b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:31.188813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-55ef6c33-c415-4f8e-9978-ffd0969a4b14 None None] MFA Rules not processed for user `0c5e6dae854a44a0ad6628e7dd69dfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:31.190029 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-55ef6c33-c415-4f8e-9978-ffd0969a4b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:31.296049 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 711/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Sep 13 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:31.310294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caac96-3f92-459d-929b-0a665448b6dd None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:31.310570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caac96-3f92-459d-929b-0a665448b6dd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:31.310858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caac96-3f92-459d-929b-0a665448b6dd None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:31.312210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 701/1412] 10.222.0.20 () {54 vars in 918 bytes} [Tue Sep 13 01:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:31.317040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093e354-c53b-44a2-9c8b-93c743adb887 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:31.317321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093e354-c53b-44a2-9c8b-93c743adb887 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:31.317590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093e354-c53b-44a2-9c8b-93c743adb887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:31.391279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:31.394515 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a093e354-c53b-44a2-9c8b-93c743adb887 None None] MFA Rules not processed for user `fadc83bec6be41979e1aa4d71f8fc2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:31.396363 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a093e354-c53b-44a2-9c8b-93c743adb887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:31.516683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 712/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Sep 13 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:12:34.113371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ff456-411b-4d9e-930d-584817d65432 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:34.113940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ff456-411b-4d9e-930d-584817d65432 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:34.113940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ff456-411b-4d9e-930d-584817d65432 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:34.115864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 01:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:34.121165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebec36-b9ca-46eb-a0d0-eaf5dbb519c0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:34.121585 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebec36-b9ca-46eb-a0d0-eaf5dbb519c0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:34.121721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebec36-b9ca-46eb-a0d0-eaf5dbb519c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:34.188142 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-59ebec36-b9ca-46eb-a0d0-eaf5dbb519c0 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:34.189344 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-59ebec36-b9ca-46eb-a0d0-eaf5dbb519c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:34.243648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:34.284919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 01:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:34.576421 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ff456-411b-4d9e-930d-584817d65432 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:34.578223 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ff8ff456-411b-4d9e-930d-584817d65432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:34.722124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ff456-411b-4d9e-930d-584817d65432 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:34.793712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:34.836274 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a329675-81b2-4f25-9a90-c35fe0bffdb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:34.836880 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a329675-81b2-4f25-9a90-c35fe0bffdb9 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:34.837156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a329675-81b2-4f25-9a90-c35fe0bffdb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:34.837423 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a329675-81b2-4f25-9a90-c35fe0bffdb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:34.838999 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9a329675-81b2-4f25-9a90-c35fe0bffdb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:34.926894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a329675-81b2-4f25-9a90-c35fe0bffdb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:34.929398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a329675-81b2-4f25-9a90-c35fe0bffdb9 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:34.947825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 703/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:36.094711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847340e-bf56-4196-959b-9fab1db70cd7 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:36.095427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847340e-bf56-4196-959b-9fab1db70cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:36.095427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847340e-bf56-4196-959b-9fab1db70cd7 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:36.096670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 01:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:36.104170 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33256c6e-ea36-4c9f-8e6b-05881e0c633a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:36.104630 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33256c6e-ea36-4c9f-8e6b-05881e0c633a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:36.104750 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33256c6e-ea36-4c9f-8e6b-05881e0c633a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:36.181392 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-33256c6e-ea36-4c9f-8e6b-05881e0c633a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:36.182604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-33256c6e-ea36-4c9f-8e6b-05881e0c633a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:36.208847 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:36.278367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 01:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:36.427494 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847340e-bf56-4196-959b-9fab1db70cd7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:36.429554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c847340e-bf56-4196-959b-9fab1db70cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:36.574382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847340e-bf56-4196-959b-9fab1db70cd7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:36.613868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:36.686118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063ac1f-9656-4bc0-aa8c-0074176a076e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:36.686643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063ac1f-9656-4bc0-aa8c-0074176a076e service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:36.686923 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063ac1f-9656-4bc0-aa8c-0074176a076e service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:36.687230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063ac1f-9656-4bc0-aa8c-0074176a076e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:36.688829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a063ac1f-9656-4bc0-aa8c-0074176a076e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:36.777963 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063ac1f-9656-4bc0-aa8c-0074176a076e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:36.779588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063ac1f-9656-4bc0-aa8c-0074176a076e service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:36.797316 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 715/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:37.926402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bd4db-690e-4885-9c77-6e183d00a1a1 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:37.926947 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bd4db-690e-4885-9c77-6e183d00a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:37.926947 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bd4db-690e-4885-9c77-6e183d00a1a1 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:37.929089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 01:12:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:37.935226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c025853-5311-4fcd-b7e4-16652947c596 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:37.935638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c025853-5311-4fcd-b7e4-16652947c596 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:37.935774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c025853-5311-4fcd-b7e4-16652947c596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:37.991627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:38.013709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5c025853-5311-4fcd-b7e4-16652947c596 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:38.014926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5c025853-5311-4fcd-b7e4-16652947c596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:38.109116 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:38.260888 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bd4db-690e-4885-9c77-6e183d00a1a1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:38.262414 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bf3bd4db-690e-4885-9c77-6e183d00a1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:38.409779 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bd4db-690e-4885-9c77-6e183d00a1a1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:38.422157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:38.525381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2e8f9-8dcd-4397-aa70-2923ab3274e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:38.525993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2e8f9-8dcd-4397-aa70-2923ab3274e1 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:38.526273 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2e8f9-8dcd-4397-aa70-2923ab3274e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:38.526568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2e8f9-8dcd-4397-aa70-2923ab3274e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:38.528201 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-73a2e8f9-8dcd-4397-aa70-2923ab3274e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:38.617387 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2e8f9-8dcd-4397-aa70-2923ab3274e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:38.618973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2e8f9-8dcd-4397-aa70-2923ab3274e1 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:38.637215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 706/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:39.759334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cbaa7-80cb-4113-adb2-4d6884ea0a6f None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:39.759866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cbaa7-80cb-4113-adb2-4d6884ea0a6f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:39.759866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cbaa7-80cb-4113-adb2-4d6884ea0a6f None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:39.761166 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 01:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:39.767424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083788b-7687-4300-a03c-a66c82e4c096 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:39.767824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083788b-7687-4300-a03c-a66c82e4c096 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:39.767967 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083788b-7687-4300-a03c-a66c82e4c096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:39.788542 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:39.844589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1083788b-7687-4300-a03c-a66c82e4c096 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:39.845822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1083788b-7687-4300-a03c-a66c82e4c096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:39.939625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:40.090691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cbaa7-80cb-4113-adb2-4d6884ea0a6f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:40.092262 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b42cbaa7-80cb-4113-adb2-4d6884ea0a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:40.202409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:40.238493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cbaa7-80cb-4113-adb2-4d6884ea0a6f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:40.349652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c6222-3096-416e-ae60-623cbeacf439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:40.350179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c6222-3096-416e-ae60-623cbeacf439 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:40.350464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c6222-3096-416e-ae60-623cbeacf439 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:40.350754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c6222-3096-416e-ae60-623cbeacf439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:40.352899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ae7c6222-3096-416e-ae60-623cbeacf439 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:40.430340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:40.444152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c6222-3096-416e-ae60-623cbeacf439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:40.446036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c6222-3096-416e-ae60-623cbeacf439 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:40.464631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 718/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:41.582167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5372166-418b-46e4-8d06-b5b6f3a4f41d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:41.582773 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5372166-418b-46e4-8d06-b5b6f3a4f41d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:41.582773 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5372166-418b-46e4-8d06-b5b6f3a4f41d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:41.584111 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 01:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:41.591227 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aacd41-18c1-4905-9e98-203ff4f8d078 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:41.591675 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aacd41-18c1-4905-9e98-203ff4f8d078 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:41.591788 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aacd41-18c1-4905-9e98-203ff4f8d078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:41.667216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-d4aacd41-18c1-4905-9e98-203ff4f8d078 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:41.668456 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d4aacd41-18c1-4905-9e98-203ff4f8d078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:41.766469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 01:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:41.916932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5372166-418b-46e4-8d06-b5b6f3a4f41d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:41.918453 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f5372166-418b-46e4-8d06-b5b6f3a4f41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:42.004906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:42.066748 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5372166-418b-46e4-8d06-b5b6f3a4f41d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:42.178846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f47a9-4abc-4280-ac25-8daf47c34fe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:42.180053 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f47a9-4abc-4280-ac25-8daf47c34fe1 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:42.180331 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f47a9-4abc-4280-ac25-8daf47c34fe1 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:42.180602 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f47a9-4abc-4280-ac25-8daf47c34fe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:42.182209 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-601f47a9-4abc-4280-ac25-8daf47c34fe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:42.231535 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:42.272721 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f47a9-4abc-4280-ac25-8daf47c34fe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:42.274674 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f47a9-4abc-4280-ac25-8daf47c34fe1 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:42.293003 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 709/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:43.348232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae4cef-c285-4367-9fc8-7b1891d456e6 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:43.348769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae4cef-c285-4367-9fc8-7b1891d456e6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:43.348769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae4cef-c285-4367-9fc8-7b1891d456e6 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:43.350121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 01:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:43.356778 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e383e-37af-4290-af5e-f1c46b846b6c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:43.357222 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e383e-37af-4290-af5e-f1c46b846b6c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:43.357339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e383e-37af-4290-af5e-f1c46b846b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:43.435120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7f6e383e-37af-4290-af5e-f1c46b846b6c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:43.436404 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7f6e383e-37af-4290-af5e-f1c46b846b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:43.535698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 01:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:12:43.688176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae4cef-c285-4367-9fc8-7b1891d456e6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:43.689597 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-99ae4cef-c285-4367-9fc8-7b1891d456e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:43.740519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:43.840530 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae4cef-c285-4367-9fc8-7b1891d456e6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:43.952884 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3d0fe-5f6e-4a9d-8d6a-94d8722708b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:43.953404 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3d0fe-5f6e-4a9d-8d6a-94d8722708b7 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:43.953677 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3d0fe-5f6e-4a9d-8d6a-94d8722708b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:43.953947 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3d0fe-5f6e-4a9d-8d6a-94d8722708b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:43.955566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ead3d0fe-5f6e-4a9d-8d6a-94d8722708b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:43.962536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:44.045968 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3d0fe-5f6e-4a9d-8d6a-94d8722708b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:44.047599 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3d0fe-5f6e-4a9d-8d6a-94d8722708b7 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:44.065172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 721/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:45.114002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5e8f5-15b8-4d2d-9cc6-a7e47d9c7a6e None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:45.114541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5e8f5-15b8-4d2d-9cc6-a7e47d9c7a6e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:45.114541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5e8f5-15b8-4d2d-9cc6-a7e47d9c7a6e None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:45.115881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 01:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:45.122780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef90472-73aa-4962-9bea-c26a8250c3b2 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:45.123224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef90472-73aa-4962-9bea-c26a8250c3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:45.123365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef90472-73aa-4962-9bea-c26a8250c3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:45.198613 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7ef90472-73aa-4962-9bea-c26a8250c3b2 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:45.199858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7ef90472-73aa-4962-9bea-c26a8250c3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:45.266508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:45.295467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 01:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:45.444699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5e8f5-15b8-4d2d-9cc6-a7e47d9c7a6e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:45.446301 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-06c5e8f5-15b8-4d2d-9cc6-a7e47d9c7a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:45.464454 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:45.593514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5e8f5-15b8-4d2d-9cc6-a7e47d9c7a6e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:45.680333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:45.705888 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530859a-6d0f-4e3d-881e-52b24b25ab79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:45.706496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530859a-6d0f-4e3d-881e-52b24b25ab79 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:45.706775 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530859a-6d0f-4e3d-881e-52b24b25ab79 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:45.707046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530859a-6d0f-4e3d-881e-52b24b25ab79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:45.708675 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8530859a-6d0f-4e3d-881e-52b24b25ab79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:45.798001 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530859a-6d0f-4e3d-881e-52b24b25ab79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:45.799635 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530859a-6d0f-4e3d-881e-52b24b25ab79 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:45.818788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 712/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:46.872488 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f161a-e126-4b63-a12a-7abe953ca2d4 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:46.872997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f161a-e126-4b63-a12a-7abe953ca2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:46.873120 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f161a-e126-4b63-a12a-7abe953ca2d4 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:46.874468 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 01:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:46.880654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f6cd7-caac-40c6-9e45-43c7f3e5aae4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:46.881074 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f6cd7-caac-40c6-9e45-43c7f3e5aae4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:46.881210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f6cd7-caac-40c6-9e45-43c7f3e5aae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:46.955779 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cb9f6cd7-caac-40c6-9e45-43c7f3e5aae4 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:46.956998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cb9f6cd7-caac-40c6-9e45-43c7f3e5aae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:46.998564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:47.052824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 01:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:47.201366 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f161a-e126-4b63-a12a-7abe953ca2d4 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:47.203248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b30f161a-e126-4b63-a12a-7abe953ca2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:47.349540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f161a-e126-4b63-a12a-7abe953ca2d4 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:47.403578 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:47.464092 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b89929-6a6f-44b5-83f7-3e280adbef9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:47.464702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89929-6a6f-44b5-83f7-3e280adbef9c service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:47.464983 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89929-6a6f-44b5-83f7-3e280adbef9c service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:47.465256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89929-6a6f-44b5-83f7-3e280adbef9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:47.466863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b1b89929-6a6f-44b5-83f7-3e280adbef9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:47.555873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b89929-6a6f-44b5-83f7-3e280adbef9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:47.557491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b89929-6a6f-44b5-83f7-3e280adbef9c service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:47.576589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 724/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:48.635507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be498a2-9b1a-444f-aa8d-65a8cba06fdb None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:48.636047 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be498a2-9b1a-444f-aa8d-65a8cba06fdb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:48.636047 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be498a2-9b1a-444f-aa8d-65a8cba06fdb None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:48.637436 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 01:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:48.643755 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e36aa0-aede-4995-8632-399a708bf861 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:48.644199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e36aa0-aede-4995-8632-399a708bf861 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:48.644302 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e36aa0-aede-4995-8632-399a708bf861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:48.719567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b6e36aa0-aede-4995-8632-399a708bf861 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:48.720692 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b6e36aa0-aede-4995-8632-399a708bf861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:48.722690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:48.818818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 01:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:48.970185 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be498a2-9b1a-444f-aa8d-65a8cba06fdb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:48.971648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3be498a2-9b1a-444f-aa8d-65a8cba06fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:49.118124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be498a2-9b1a-444f-aa8d-65a8cba06fdb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:49.144413 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:49.232115 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a8069-1ca6-4529-973b-9ed5a2f2cfaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:49.232655 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a8069-1ca6-4529-973b-9ed5a2f2cfaa service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:49.232932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a8069-1ca6-4529-973b-9ed5a2f2cfaa service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:49.233201 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a8069-1ca6-4529-973b-9ed5a2f2cfaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:49.234803 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5c5a8069-1ca6-4529-973b-9ed5a2f2cfaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:49.322058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a8069-1ca6-4529-973b-9ed5a2f2cfaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:49.323679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a8069-1ca6-4529-973b-9ed5a2f2cfaa service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:49.341760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 715/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:51.422452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ba143-80df-42e5-a5a2-e00733bda87f None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:51.422970 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ba143-80df-42e5-a5a2-e00733bda87f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:51.422970 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ba143-80df-42e5-a5a2-e00733bda87f None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:51.424318 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 01:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:51.430096 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a92671-1351-4d85-b08d-ef01456379fb None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:51.430530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a92671-1351-4d85-b08d-ef01456379fb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:51.430683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a92671-1351-4d85-b08d-ef01456379fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:51.471910 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:51.497797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c5a92671-1351-4d85-b08d-ef01456379fb None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:51.499041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c5a92671-1351-4d85-b08d-ef01456379fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:51.598396 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:51.887583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ba143-80df-42e5-a5a2-e00733bda87f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:51.889120 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-854ba143-80df-42e5-a5a2-e00733bda87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:51.992553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ba143-80df-42e5-a5a2-e00733bda87f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:52.024930 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:52.065154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df84aa-e192-4cca-b0e2-930032ef0c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:52.065748 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df84aa-e192-4cca-b0e2-930032ef0c11 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:52.066024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df84aa-e192-4cca-b0e2-930032ef0c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:52.066290 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df84aa-e192-4cca-b0e2-930032ef0c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:52.067980 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-19df84aa-e192-4cca-b0e2-930032ef0c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:52.182377 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df84aa-e192-4cca-b0e2-930032ef0c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:52.183772 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df84aa-e192-4cca-b0e2-930032ef0c11 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:52.201855 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 727/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:54.496391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf4b3c-7d91-497f-ad33-73395cd39371 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:54.496911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf4b3c-7d91-497f-ad33-73395cd39371 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:54.496911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf4b3c-7d91-497f-ad33-73395cd39371 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:54.498265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 01:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:54.503524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604b670-cc37-433e-bd3f-ba15388c72e8 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:54.503941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604b670-cc37-433e-bd3f-ba15388c72e8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:54.504099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604b670-cc37-433e-bd3f-ba15388c72e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:54.570899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8604b670-cc37-433e-bd3f-ba15388c72e8 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:54.572150 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8604b670-cc37-433e-bd3f-ba15388c72e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:54.585743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:54.669394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:54.955443 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf4b3c-7d91-497f-ad33-73395cd39371 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:54.957004 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ceaf4b3c-7d91-497f-ad33-73395cd39371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:55.060264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf4b3c-7d91-497f-ad33-73395cd39371 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:55.073876 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:55.135589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ebd9a-840a-444f-906c-b13efc506f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:55.136197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ebd9a-840a-444f-906c-b13efc506f31 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:55.136475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ebd9a-840a-444f-906c-b13efc506f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:55.136745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ebd9a-840a-444f-906c-b13efc506f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:55.138362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d62ebd9a-840a-444f-906c-b13efc506f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:55.248308 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ebd9a-840a-444f-906c-b13efc506f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:55.249675 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ebd9a-840a-444f-906c-b13efc506f31 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:55.267680 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 718/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:57.722601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba028d5-d1d6-4994-af8f-40719b1148db None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:57.723154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba028d5-d1d6-4994-af8f-40719b1148db None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:57.723154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba028d5-d1d6-4994-af8f-40719b1148db None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:57.724468 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 01:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:12:57.729956 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857538b-7048-4adf-97df-b656ff889b96 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:57.730389 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857538b-7048-4adf-97df-b656ff889b96 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:57.730492 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857538b-7048-4adf-97df-b656ff889b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:57.778140 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:57.796844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9857538b-7048-4adf-97df-b656ff889b96 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:12:57.798101 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9857538b-7048-4adf-97df-b656ff889b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:57.893391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 01:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:12:58.183644 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba028d5-d1d6-4994-af8f-40719b1148db None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:12:58.185211 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bba028d5-d1d6-4994-af8f-40719b1148db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:58.286136 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba028d5-d1d6-4994-af8f-40719b1148db None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:12:58.326309 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:58.361621 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7f24e-5ae9-438a-a825-1d0dd9447162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:12:58.362225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7f24e-5ae9-438a-a825-1d0dd9447162 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:12:58.362507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7f24e-5ae9-438a-a825-1d0dd9447162 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:12:58.362786 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7f24e-5ae9-438a-a825-1d0dd9447162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:12:58.364409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-10d7f24e-5ae9-438a-a825-1d0dd9447162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:12:58.474337 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7f24e-5ae9-438a-a825-1d0dd9447162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:12:58.476351 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7f24e-5ae9-438a-a825-1d0dd9447162 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:12:58.494080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 730/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:13:00.808469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5071f5-96df-4d8d-a750-b9f2b814e30c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:00.809031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5071f5-96df-4d8d-a750-b9f2b814e30c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:00.809031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5071f5-96df-4d8d-a750-b9f2b814e30c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:00.810356 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 01:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:13:00.815806 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbffd51-45d5-456d-8569-657ae1d0c9cd None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:00.816222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbffd51-45d5-456d-8569-657ae1d0c9cd None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:00.816354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbffd51-45d5-456d-8569-657ae1d0c9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:00.882427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-dcbffd51-45d5-456d-8569-657ae1d0c9cd None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:13:00.883946 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-dcbffd51-45d5-456d-8569-657ae1d0c9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:00.904802 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:00.980820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 01:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:13:01.266558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5071f5-96df-4d8d-a750-b9f2b814e30c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:13:01.268161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3e5071f5-96df-4d8d-a750-b9f2b814e30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:01.371861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5071f5-96df-4d8d-a750-b9f2b814e30c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:13:01.392466 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:01.447195 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d20307-571c-425b-807b-10f3c8daef96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:13:01.447805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d20307-571c-425b-807b-10f3c8daef96 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:01.448085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d20307-571c-425b-807b-10f3c8daef96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:01.448359 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d20307-571c-425b-807b-10f3c8daef96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:01.449940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-41d20307-571c-425b-807b-10f3c8daef96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:01.558161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d20307-571c-425b-807b-10f3c8daef96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:13:01.559629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d20307-571c-425b-807b-10f3c8daef96 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:13:01.577833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 721/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:13:03.800503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226cfe8-9fbc-4e1e-b432-baa938005eec None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:03.801048 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226cfe8-9fbc-4e1e-b432-baa938005eec None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:03.801048 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226cfe8-9fbc-4e1e-b432-baa938005eec None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:03.802405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 01:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:13:03.807854 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f96023-e617-4427-a548-fad0a9bc6406 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:03.808280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f96023-e617-4427-a548-fad0a9bc6406 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:03.808412 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f96023-e617-4427-a548-fad0a9bc6406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:03.989038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:03.991904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d3f96023-e617-4427-a548-fad0a9bc6406 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:13:03.993674 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d3f96023-e617-4427-a548-fad0a9bc6406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:04.090924 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:13:04.376477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226cfe8-9fbc-4e1e-b432-baa938005eec None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:13:04.378044 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a226cfe8-9fbc-4e1e-b432-baa938005eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:04.482280 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226cfe8-9fbc-4e1e-b432-baa938005eec None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:13:04.531457 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:04.556611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21534601-a242-45fd-8aad-cf446034c365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:13:04.557215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21534601-a242-45fd-8aad-cf446034c365 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:04.557494 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21534601-a242-45fd-8aad-cf446034c365 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:04.557768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21534601-a242-45fd-8aad-cf446034c365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:04.559392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-21534601-a242-45fd-8aad-cf446034c365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:04.670376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21534601-a242-45fd-8aad-cf446034c365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:13:04.671769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21534601-a242-45fd-8aad-cf446034c365 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:13:04.689987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 733/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:13:06.971622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04390596-6b30-4687-b0f5-1bdc759f6241 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:06.972280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04390596-6b30-4687-b0f5-1bdc759f6241 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:06.972280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04390596-6b30-4687-b0f5-1bdc759f6241 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:06.973517 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 01:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:13:06.979114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406819a-fdca-480c-ab25-5ad1da5593b1 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:06.979601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406819a-fdca-480c-ab25-5ad1da5593b1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:06.979710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406819a-fdca-480c-ab25-5ad1da5593b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:07.045017 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3406819a-fdca-480c-ab25-5ad1da5593b1 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:13:07.046220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3406819a-fdca-480c-ab25-5ad1da5593b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:07.075059 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:07.142172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 01:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:13:07.424690 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04390596-6b30-4687-b0f5-1bdc759f6241 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:13:07.426254 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-04390596-6b30-4687-b0f5-1bdc759f6241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:07.529756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04390596-6b30-4687-b0f5-1bdc759f6241 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:13:07.559112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:07.609166 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08265415-9ba7-4cf6-8486-d372b4d6ad7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:13:07.609772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08265415-9ba7-4cf6-8486-d372b4d6ad7c service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:07.610048 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08265415-9ba7-4cf6-8486-d372b4d6ad7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:07.610318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08265415-9ba7-4cf6-8486-d372b4d6ad7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:07.611942 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-08265415-9ba7-4cf6-8486-d372b4d6ad7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:07.719421 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08265415-9ba7-4cf6-8486-d372b4d6ad7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:13:07.720796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08265415-9ba7-4cf6-8486-d372b4d6ad7c service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:13:07.740564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 724/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:13:09.956637 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9088c-7ecb-4bba-b697-fc7f513eb83a None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:09.957204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9088c-7ecb-4bba-b697-fc7f513eb83a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:09.957204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9088c-7ecb-4bba-b697-fc7f513eb83a None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:09.958536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 01:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:13:09.964547 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe4c2f-f677-4ca3-b304-410b1d2ae497 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:09.964969 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe4c2f-f677-4ca3-b304-410b1d2ae497 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:09.965098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe4c2f-f677-4ca3-b304-410b1d2ae497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:10.038795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-97fe4c2f-f677-4ca3-b304-410b1d2ae497 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:13:10.040048 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-97fe4c2f-f677-4ca3-b304-410b1d2ae497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:10.048311 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:10.136430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 01:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:13:10.422487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9088c-7ecb-4bba-b697-fc7f513eb83a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:13:10.424075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2ea9088c-7ecb-4bba-b697-fc7f513eb83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:10.532754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9088c-7ecb-4bba-b697-fc7f513eb83a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:13:10.589325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:10.607698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68714c1-b867-45de-bc4e-385efbaeb4ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:13:10.608296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68714c1-b867-45de-bc4e-385efbaeb4ae service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:10.608570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68714c1-b867-45de-bc4e-385efbaeb4ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:10.608841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68714c1-b867-45de-bc4e-385efbaeb4ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:10.610418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f68714c1-b867-45de-bc4e-385efbaeb4ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:10.720704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68714c1-b867-45de-bc4e-385efbaeb4ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:13:10.722095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68714c1-b867-45de-bc4e-385efbaeb4ae service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:13:10.740642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 736/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:13:12.950610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bd7be-7eb8-4889-8199-61f2b2d18aef None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:12.951200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bd7be-7eb8-4889-8199-61f2b2d18aef None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:12.951200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bd7be-7eb8-4889-8199-61f2b2d18aef None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:12.952427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 01:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:13:12.958039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a2787-e563-4cb0-8c93-dad8f61268f4 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:12.958438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a2787-e563-4cb0-8c93-dad8f61268f4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:12.958590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a2787-e563-4cb0-8c93-dad8f61268f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:13.027540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-dc9a2787-e563-4cb0-8c93-dad8f61268f4 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:13:13.028780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-dc9a2787-e563-4cb0-8c93-dad8f61268f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:13.067299 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:13.126356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:13:13.415213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bd7be-7eb8-4889-8199-61f2b2d18aef None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:13:13.416835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-265bd7be-7eb8-4889-8199-61f2b2d18aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:13.526681 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bd7be-7eb8-4889-8199-61f2b2d18aef None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:13:13.568311 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:13.604232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17d085-250f-4ee3-9a6b-10b7d398e46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:13:13.604829 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17d085-250f-4ee3-9a6b-10b7d398e46f service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:13.605105 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17d085-250f-4ee3-9a6b-10b7d398e46f service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:13.605370 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17d085-250f-4ee3-9a6b-10b7d398e46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:13.606966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0b17d085-250f-4ee3-9a6b-10b7d398e46f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:13.714066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17d085-250f-4ee3-9a6b-10b7d398e46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:13:13.715453 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17d085-250f-4ee3-9a6b-10b7d398e46f service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:13:13.733779 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 727/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:13:15.949258 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94caa0-a1ed-4009-a178-5116dffb34bf None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:15.949821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94caa0-a1ed-4009-a178-5116dffb34bf None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:15.949821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94caa0-a1ed-4009-a178-5116dffb34bf None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:15.951200 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 01:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:13:15.956808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c90da2-d928-4733-90f8-2d3b4ac984b7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:15.957216 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c90da2-d928-4733-90f8-2d3b4ac984b7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:15.957357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c90da2-d928-4733-90f8-2d3b4ac984b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:16.022431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-72c90da2-d928-4733-90f8-2d3b4ac984b7 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:13:16.023709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-72c90da2-d928-4733-90f8-2d3b4ac984b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:16.042369 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:16.121601 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:13:16.403824 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94caa0-a1ed-4009-a178-5116dffb34bf None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:13:16.405383 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5f94caa0-a1ed-4009-a178-5116dffb34bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:16.509381 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94caa0-a1ed-4009-a178-5116dffb34bf None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:13:16.577116 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:16.584470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19931b-4a7b-4964-9bc7-18b0b8d2b1e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:13:16.585641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19931b-4a7b-4964-9bc7-18b0b8d2b1e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:16.586022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19931b-4a7b-4964-9bc7-18b0b8d2b1e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:16.586307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19931b-4a7b-4964-9bc7-18b0b8d2b1e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:16.587975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ee19931b-4a7b-4964-9bc7-18b0b8d2b1e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:16.694683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19931b-4a7b-4964-9bc7-18b0b8d2b1e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:13:16.696063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19931b-4a7b-4964-9bc7-18b0b8d2b1e3 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:13:16.716012 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 739/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:13:18.903352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bfbf9-8ebb-4a32-bb90-ce7ef6bb4345 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:18.903921 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bfbf9-8ebb-4a32-bb90-ce7ef6bb4345 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:18.903921 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bfbf9-8ebb-4a32-bb90-ce7ef6bb4345 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:18.905305 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 01:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:13:18.910502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb7d4f-62e6-494d-8903-35c0052990ab None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:18.910952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb7d4f-62e6-494d-8903-35c0052990ab None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:18.911086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb7d4f-62e6-494d-8903-35c0052990ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:19.094971 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-99cb7d4f-62e6-494d-8903-35c0052990ab None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:13:19.096232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-99cb7d4f-62e6-494d-8903-35c0052990ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:19.143228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:19.191727 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:13:19.473843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bfbf9-8ebb-4a32-bb90-ce7ef6bb4345 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:13:19.476116 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0c7bfbf9-8ebb-4a32-bb90-ce7ef6bb4345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:19.587406 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bfbf9-8ebb-4a32-bb90-ce7ef6bb4345 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:13:19.634876 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:19.659818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2ee2a-c9d0-4a72-aec1-fe4e43bc0474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:13:19.660422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2ee2a-c9d0-4a72-aec1-fe4e43bc0474 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:19.660700 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2ee2a-c9d0-4a72-aec1-fe4e43bc0474 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:19.660969 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2ee2a-c9d0-4a72-aec1-fe4e43bc0474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:19.662555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c3c2ee2a-c9d0-4a72-aec1-fe4e43bc0474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:19.771485 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2ee2a-c9d0-4a72-aec1-fe4e43bc0474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:13:19.772981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2ee2a-c9d0-4a72-aec1-fe4e43bc0474 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:13:19.792108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 730/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:13:29.190213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=22 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:29.789580 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=66 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:39.772292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca461fe4-546f-4da4-a949-b0227f30092c None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:39.773127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca461fe4-546f-4da4-a949-b0227f30092c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:39.773127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca461fe4-546f-4da4-a949-b0227f30092c None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:39.774230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 741/1471] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:13:39.779663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414056db-022d-4617-9132-f6820d600cdc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:39.780211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414056db-022d-4617-9132-f6820d600cdc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:39.780497 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414056db-022d-4617-9132-f6820d600cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:39.847526 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-414056db-022d-4617-9132-f6820d600cdc None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:13:39.848736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-414056db-022d-4617-9132-f6820d600cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:39.949658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 731/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:13:40.245943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d84fe-44ea-49f1-aa10-2cfaefc00f8e None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:40.246228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d84fe-44ea-49f1-aa10-2cfaefc00f8e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:40.246505 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d84fe-44ea-49f1-aa10-2cfaefc00f8e None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:40.247871 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 742/1473] 10.222.0.20 () {54 vars in 966 bytes} [Tue Sep 13 01:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:13:40.253970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab187c-fc44-4d7f-a463-dcde2325f1af None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:40.254254 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab187c-fc44-4d7f-a463-dcde2325f1af None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:40.254523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab187c-fc44-4d7f-a463-dcde2325f1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:40.329880 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-bdab187c-fc44-4d7f-a463-dcde2325f1af None None] MFA Rules not processed for user `50c78d95e6774755b11508fc1954ad5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:13:40.331094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bdab187c-fc44-4d7f-a463-dcde2325f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:40.351758 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:40.407496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 732/1474] 10.222.0.20 () {58 vars in 1063 bytes} [Tue Sep 13 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:13:40.415766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d84fe-44ea-49f1-aa10-2cfaefc00f8e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:13:40.417287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-332d84fe-44ea-49f1-aa10-2cfaefc00f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:40.520644 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d84fe-44ea-49f1-aa10-2cfaefc00f8e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:13:40.594951 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af40a6-db28-4812-a288-e207daba795b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c78d95e6774755b11508fc1954ad5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:13:40.595667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af40a6-db28-4812-a288-e207daba795b service glance] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:40.595985 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af40a6-db28-4812-a288-e207daba795b service glance] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:40.596272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af40a6-db28-4812-a288-e207daba795b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:40.597999 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d2af40a6-db28-4812-a288-e207daba795b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:40.652480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:40.708458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af40a6-db28-4812-a288-e207daba795b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:13:40.710252 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af40a6-db28-4812-a288-e207daba795b service glance] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:13:40.728705 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 743/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:13:42.967003 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11089c0f-1b52-476f-9079-99419a7b0e78 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:42.967628 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11089c0f-1b52-476f-9079-99419a7b0e78 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:42.967628 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11089c0f-1b52-476f-9079-99419a7b0e78 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:42.968914 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 733/1476] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:13:42.974083 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2aaee3-aa59-4e5e-b1a4-44dec93ebd9b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:42.974510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2aaee3-aa59-4e5e-b1a4-44dec93ebd9b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:42.974644 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2aaee3-aa59-4e5e-b1a4-44dec93ebd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:43.040243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3d2aaee3-aa59-4e5e-b1a4-44dec93ebd9b None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:13:43.041452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3d2aaee3-aa59-4e5e-b1a4-44dec93ebd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:43.137307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 744/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:13:43.408099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11089c0f-1b52-476f-9079-99419a7b0e78 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:13:43.409625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-11089c0f-1b52-476f-9079-99419a7b0e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:43.540799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11089c0f-1b52-476f-9079-99419a7b0e78 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:13:43.591752 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:43.636149 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c37d8d-364b-4afb-80d9-8504f5508d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:13:43.636755 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c37d8d-364b-4afb-80d9-8504f5508d6d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:43.637032 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c37d8d-364b-4afb-80d9-8504f5508d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:43.637294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c37d8d-364b-4afb-80d9-8504f5508d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:43.637928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c37d8d-364b-4afb-80d9-8504f5508d6d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:13:43.639695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-42c37d8d-364b-4afb-80d9-8504f5508d6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 01:13:43.639695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Sep 13 01:13:43.639695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: Sep 13 01:13:43.640825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c37d8d-364b-4afb-80d9-8504f5508d6d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:13:43.660287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 734/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 13 01:13:43 2022] GET /identity/v3/projects => generated 2553 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:13:45.833863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18b97a-9023-4154-a844-261fd7bab948 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:45.834474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18b97a-9023-4154-a844-261fd7bab948 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:45.834644 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18b97a-9023-4154-a844-261fd7bab948 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:45.836241 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 745/1479] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:13:45.841558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f2483-b72a-4a00-9007-2d74bf3c42fa None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:45.841974 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f2483-b72a-4a00-9007-2d74bf3c42fa None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:45.842099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f2483-b72a-4a00-9007-2d74bf3c42fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:45.907468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b12f2483-b72a-4a00-9007-2d74bf3c42fa None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:13:45.908681 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b12f2483-b72a-4a00-9007-2d74bf3c42fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:46.005317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 735/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:13:46.299601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18b97a-9023-4154-a844-261fd7bab948 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:13:46.301243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-cd18b97a-9023-4154-a844-261fd7bab948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:46.311523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:46.446886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18b97a-9023-4154-a844-261fd7bab948 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:13:46.525948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:46.559957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1574978-1120-4a5d-aacd-b66a433dd97b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:13:46.560813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1574978-1120-4a5d-aacd-b66a433dd97b service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:46.561106 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1574978-1120-4a5d-aacd-b66a433dd97b service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:46.561388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1574978-1120-4a5d-aacd-b66a433dd97b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:46.562986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a1574978-1120-4a5d-aacd-b66a433dd97b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:46.651932 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1574978-1120-4a5d-aacd-b66a433dd97b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:13:46.653509 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1574978-1120-4a5d-aacd-b66a433dd97b service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:13:46.671635 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 746/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:13:49.019548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84760cbd-fbcd-4eff-b3b7-6bc8c3ec5687 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:49.020123 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84760cbd-fbcd-4eff-b3b7-6bc8c3ec5687 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:49.020123 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84760cbd-fbcd-4eff-b3b7-6bc8c3ec5687 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:49.021435 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 736/1482] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:13:49.027213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd754368-2e50-42f9-bea2-35f3536b7ba1 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:49.027649 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd754368-2e50-42f9-bea2-35f3536b7ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:49.027787 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd754368-2e50-42f9-bea2-35f3536b7ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:49.093362 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-dd754368-2e50-42f9-bea2-35f3536b7ba1 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:13:49.094574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-dd754368-2e50-42f9-bea2-35f3536b7ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:49.140482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:49.191094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 747/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:13:49.480574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84760cbd-fbcd-4eff-b3b7-6bc8c3ec5687 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:13:49.482121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-84760cbd-fbcd-4eff-b3b7-6bc8c3ec5687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:49.506756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:49.586620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84760cbd-fbcd-4eff-b3b7-6bc8c3ec5687 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:13:49.658291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f5aa6-52cb-42b7-8911-22bc2aad3de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:13:49.658893 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f5aa6-52cb-42b7-8911-22bc2aad3de8 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:49.659199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f5aa6-52cb-42b7-8911-22bc2aad3de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:49.659473 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f5aa6-52cb-42b7-8911-22bc2aad3de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:49.661054 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5b6f5aa6-52cb-42b7-8911-22bc2aad3de8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:49.736629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:49.771412 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f5aa6-52cb-42b7-8911-22bc2aad3de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:13:49.773567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f5aa6-52cb-42b7-8911-22bc2aad3de8 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:13:49.791657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 737/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:13:52.003523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7b5e5-f9d7-4996-9049-90b41a923cae None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:52.004099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7b5e5-f9d7-4996-9049-90b41a923cae None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:52.004099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7b5e5-f9d7-4996-9049-90b41a923cae None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:52.005454 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 748/1485] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:13:52.011461 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8030bcd-a46c-4dd0-b140-28546fae9fd7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:52.011867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8030bcd-a46c-4dd0-b140-28546fae9fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:52.012005 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8030bcd-a46c-4dd0-b140-28546fae9fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:52.077295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c8030bcd-a46c-4dd0-b140-28546fae9fd7 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:13:52.078755 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c8030bcd-a46c-4dd0-b140-28546fae9fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:52.174614 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 738/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:13:52.469049 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7b5e5-f9d7-4996-9049-90b41a923cae None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:13:52.470574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-50e7b5e5-f9d7-4996-9049-90b41a923cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:52.573580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7b5e5-f9d7-4996-9049-90b41a923cae None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:13:52.646541 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:52.648194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc4568-aaf1-4bc1-9cda-b56c251fc685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:13:52.648876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4568-aaf1-4bc1-9cda-b56c251fc685 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:52.649150 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4568-aaf1-4bc1-9cda-b56c251fc685 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:52.649478 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4568-aaf1-4bc1-9cda-b56c251fc685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:52.651735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e2bc4568-aaf1-4bc1-9cda-b56c251fc685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:52.762354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc4568-aaf1-4bc1-9cda-b56c251fc685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:13:52.763828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc4568-aaf1-4bc1-9cda-b56c251fc685 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:13:52.782400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 749/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:13:55.033829 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1335984-a883-4c9a-9cad-b2bee2430369 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:55.034403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1335984-a883-4c9a-9cad-b2bee2430369 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:55.034403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1335984-a883-4c9a-9cad-b2bee2430369 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:55.035788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 739/1488] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:13:55.041391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61282b-cc8e-4d70-bef6-56cb2c64d94e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:55.041824 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61282b-cc8e-4d70-bef6-56cb2c64d94e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:55.041937 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61282b-cc8e-4d70-bef6-56cb2c64d94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:55.107326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0f61282b-cc8e-4d70-bef6-56cb2c64d94e None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:13:55.108539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0f61282b-cc8e-4d70-bef6-56cb2c64d94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:55.161016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:55.206339 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 750/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:13:55.500685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1335984-a883-4c9a-9cad-b2bee2430369 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:13:55.502218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e1335984-a883-4c9a-9cad-b2bee2430369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:55.539903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:55.608345 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1335984-a883-4c9a-9cad-b2bee2430369 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:13:55.681212 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dd65f-4db5-4c41-9241-d7ce4153ec38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:13:55.681736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd65f-4db5-4c41-9241-d7ce4153ec38 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:55.682018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd65f-4db5-4c41-9241-d7ce4153ec38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:55.682292 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd65f-4db5-4c41-9241-d7ce4153ec38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:55.683916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cb5dd65f-4db5-4c41-9241-d7ce4153ec38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:55.764052 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:55.793355 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dd65f-4db5-4c41-9241-d7ce4153ec38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:13:55.794794 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dd65f-4db5-4c41-9241-d7ce4153ec38 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:13:55.812905 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 740/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:13:58.143263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0dad-6cad-4619-a4a3-eb9972ff1664 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:58.143796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0dad-6cad-4619-a4a3-eb9972ff1664 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:58.143796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0dad-6cad-4619-a4a3-eb9972ff1664 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:58.145081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 751/1491] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 13 01:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:13:58.150874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08116be-5a69-4511-8863-dba08e00923b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:58.151349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08116be-5a69-4511-8863-dba08e00923b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:58.151466 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08116be-5a69-4511-8863-dba08e00923b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:58.216163 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d08116be-5a69-4511-8863-dba08e00923b None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:13:58.217371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d08116be-5a69-4511-8863-dba08e00923b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:58.310805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 741/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 13 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:13:58.600949 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf0dad-6cad-4619-a4a3-eb9972ff1664 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:13:58.602493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b1cf0dad-6cad-4619-a4a3-eb9972ff1664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:58.704349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf0dad-6cad-4619-a4a3-eb9972ff1664 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:13:58.777216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcfb9a-f1cd-4c53-9af8-2193b0b664ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:13:58.777819 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcfb9a-f1cd-4c53-9af8-2193b0b664ab service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:13:58.778094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcfb9a-f1cd-4c53-9af8-2193b0b664ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:13:58.778362 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcfb9a-f1cd-4c53-9af8-2193b0b664ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:13:58.779972 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-02bcfb9a-f1cd-4c53-9af8-2193b0b664ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:13:58.788929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:58.891497 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcfb9a-f1cd-4c53-9af8-2193b0b664ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:13:58.892933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcfb9a-f1cd-4c53-9af8-2193b0b664ab service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:13:58.911669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 752/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:14:08.309325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=82 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:14:08.909411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=50 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:15:11.988560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfbf02-f897-49de-b23e-71f081681ec8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:11.989063 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfbf02-f897-49de-b23e-71f081681ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:11.989172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfbf02-f897-49de-b23e-71f081681ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:12.063784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-76bfbf02-f897-49de-b23e-71f081681ec8 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:15:12.065024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-76bfbf02-f897-49de-b23e-71f081681ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:12.160749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 742/1494] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:15:12.168894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d57629-9443-40c8-b569-f001d8359ca2 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:12.169414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d57629-9443-40c8-b569-f001d8359ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:12.169414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d57629-9443-40c8-b569-f001d8359ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:12.243893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-23d57629-9443-40c8-b569-f001d8359ca2 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:15:12.245120 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-23d57629-9443-40c8-b569-f001d8359ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:12.339892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 753/1495] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:15:12.344479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfbf02-f897-49de-b23e-71f081681ec8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:15:12.345663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-76bfbf02-f897-49de-b23e-71f081681ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:12.356806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfbf02-f897-49de-b23e-71f081681ec8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:15:12.417114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:15:12.455406 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a141e-7813-4fb8-8bf0-16c13a0dbad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:15:12.456014 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a141e-7813-4fb8-8bf0-16c13a0dbad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:12.456291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a141e-7813-4fb8-8bf0-16c13a0dbad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:12.456565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a141e-7813-4fb8-8bf0-16c13a0dbad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:12.457230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a141e-7813-4fb8-8bf0-16c13a0dbad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:15:12.457514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a141e-7813-4fb8-8bf0-16c13a0dbad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:15:12.458563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-fb1a141e-7813-4fb8-8bf0-16c13a0dbad5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 01:15:12.458563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Sep 13 01:15:12.458563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: Sep 13 01:15:12.459480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a141e-7813-4fb8-8bf0-16c13a0dbad5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:15:12.470549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 743/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:15:12.479033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d57629-9443-40c8-b569-f001d8359ca2 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:15:12.488476 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d57629-9443-40c8-b569-f001d8359ca2 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:15:12.549519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:15:12.583899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f39dcd-f8f6-4f6d-bf83-1595b2fb4ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:15:12.584503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f39dcd-f8f6-4f6d-bf83-1595b2fb4ebf admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:12.584777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f39dcd-f8f6-4f6d-bf83-1595b2fb4ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:12.585049 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f39dcd-f8f6-4f6d-bf83-1595b2fb4ebf admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:12.585680 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f39dcd-f8f6-4f6d-bf83-1595b2fb4ebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:15:12.587463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: WARNING py.warnings [None req-46f39dcd-f8f6-4f6d-bf83-1595b2fb4ebf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 01:15:12.587463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: warnings.warn(msg) Sep 13 01:15:12.587463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: Sep 13 01:15:12.588641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f39dcd-f8f6-4f6d-bf83-1595b2fb4ebf admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:15:12.648035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 754/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:15:12 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:15:12.652143 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a141e-7813-4fb8-8bf0-16c13a0dbad5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:15:12.653697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fb1a141e-7813-4fb8-8bf0-16c13a0dbad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:12.687581 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a141e-7813-4fb8-8bf0-16c13a0dbad5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:15:12.784635 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadbb85-a355-4f46-9cd9-0621059fb28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:15:12.785237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadbb85-a355-4f46-9cd9-0621059fb28a admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:12.785512 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadbb85-a355-4f46-9cd9-0621059fb28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:12.785781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadbb85-a355-4f46-9cd9-0621059fb28a admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:12.786881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadbb85-a355-4f46-9cd9-0621059fb28a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:15:12.788302 dv-cinder-856941-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-7aadbb85-a355-4f46-9cd9-0621059fb28a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 01:15:12.788302 dv-cinder-856941-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Sep 13 01:15:12.788302 dv-cinder-856941-3-smb devstack@keystone.service[81466]: Sep 13 01:15:12.789494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadbb85-a355-4f46-9cd9-0621059fb28a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:15:12.831302 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 744/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:15:12 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:15:12.835743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f39dcd-f8f6-4f6d-bf83-1595b2fb4ebf admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:15:12.837305 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-46f39dcd-f8f6-4f6d-bf83-1595b2fb4ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:12.898766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f39dcd-f8f6-4f6d-bf83-1595b2fb4ebf admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:15:12.982725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:15:12.995464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3812465-9037-475d-9f8d-bd74cc0dd56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:15:12.996069 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3812465-9037-475d-9f8d-bd74cc0dd56c admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:12.996347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3812465-9037-475d-9f8d-bd74cc0dd56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:12.996619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3812465-9037-475d-9f8d-bd74cc0dd56c admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:12.997254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3812465-9037-475d-9f8d-bd74cc0dd56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:15:12.998304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: WARNING py.warnings [None req-f3812465-9037-475d-9f8d-bd74cc0dd56c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 01:15:12.998304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: warnings.warn(msg) Sep 13 01:15:12.998304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: Sep 13 01:15:12.999224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3812465-9037-475d-9f8d-bd74cc0dd56c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:15:13.011335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 755/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:15:13.015396 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadbb85-a355-4f46-9cd9-0621059fb28a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:15:13.016902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7aadbb85-a355-4f46-9cd9-0621059fb28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:13.028045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadbb85-a355-4f46-9cd9-0621059fb28a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:15:13.053835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:15:13.124903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438031c7-b476-4628-80dd-ec5676934c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:15:13.125511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438031c7-b476-4628-80dd-ec5676934c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:13.125792 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438031c7-b476-4628-80dd-ec5676934c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:13.126068 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438031c7-b476-4628-80dd-ec5676934c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:13.126712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438031c7-b476-4628-80dd-ec5676934c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:15:13.127770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-438031c7-b476-4628-80dd-ec5676934c17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 01:15:13.127770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Sep 13 01:15:13.127770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: Sep 13 01:15:13.128650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438031c7-b476-4628-80dd-ec5676934c17 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:15:13.140845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 745/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:15:13.145068 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3812465-9037-475d-9f8d-bd74cc0dd56c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:15:13.147414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f3812465-9037-475d-9f8d-bd74cc0dd56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:13.181093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3812465-9037-475d-9f8d-bd74cc0dd56c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:15:13.273967 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e79b94-6152-4a66-ba01-0ef2c550e273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:15:13.274614 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79b94-6152-4a66-ba01-0ef2c550e273 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:13.274891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79b94-6152-4a66-ba01-0ef2c550e273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:13.275196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79b94-6152-4a66-ba01-0ef2c550e273 admin admin] PATH_INFO: `/v3/projects/fe24a8d6c50e4f28a71f9e040d7d56fd/users/806eed90fc4a42c29f79cdd1771354b7/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:13.297418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e79b94-6152-4a66-ba01-0ef2c550e273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe24a8d6c50e4f28a71f9e040d7d56fd, user_id=806eed90fc4a42c29f79cdd1771354b7, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:15:13.298453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: WARNING py.warnings [None req-44e79b94-6152-4a66-ba01-0ef2c550e273 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 01:15:13.298453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: warnings.warn(msg) Sep 13 01:15:13.298453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: Sep 13 01:15:13.300418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e79b94-6152-4a66-ba01-0ef2c550e273 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:15:13.324009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 756/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:15:13 2022] PUT /identity/v3/projects/fe24a8d6c50e4f28a71f9e040d7d56fd/users/806eed90fc4a42c29f79cdd1771354b7/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:15:13.337086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab4584-d1c3-49ff-b2f0-fb0c32b75296 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:13.337362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab4584-d1c3-49ff-b2f0-fb0c32b75296 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:13.337639 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab4584-d1c3-49ff-b2f0-fb0c32b75296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:13.394051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a4ab4584-d1c3-49ff-b2f0-fb0c32b75296 None None] MFA Rules not processed for user `806eed90fc4a42c29f79cdd1771354b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:15:13.395341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a4ab4584-d1c3-49ff-b2f0-fb0c32b75296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:13.478135 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 746/1502] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:15:13.492255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c3266-99a6-4681-9d12-a8b571fbc8c1 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:13.492545 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c3266-99a6-4681-9d12-a8b571fbc8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:13.492826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c3266-99a6-4681-9d12-a8b571fbc8c1 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:13.495785 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 757/1503] 10.222.0.20 () {54 vars in 964 bytes} [Tue Sep 13 01:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:15:13.500720 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba580190-65d7-4b71-af71-bf7cdc949423 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:13.501016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba580190-65d7-4b71-af71-bf7cdc949423 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:13.501304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba580190-65d7-4b71-af71-bf7cdc949423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:13.534602 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:15:13.581548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ba580190-65d7-4b71-af71-bf7cdc949423 None None] MFA Rules not processed for user `ff33b1a82c4c42f6ab4a0588d5b616db`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:15:13.582758 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ba580190-65d7-4b71-af71-bf7cdc949423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:13.657362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 747/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Tue Sep 13 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:15:13.667171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c3266-99a6-4681-9d12-a8b571fbc8c1 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:15:13.668699 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f21c3266-99a6-4681-9d12-a8b571fbc8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:13.718932 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:15:13.773028 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c3266-99a6-4681-9d12-a8b571fbc8c1 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:15:13.846354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36970f8-1298-450b-80ad-76edb1ea9b3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:15:13.846962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36970f8-1298-450b-80ad-76edb1ea9b3a service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:13.847271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36970f8-1298-450b-80ad-76edb1ea9b3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:13.847548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36970f8-1298-450b-80ad-76edb1ea9b3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:13.849210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b36970f8-1298-450b-80ad-76edb1ea9b3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:13.948538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36970f8-1298-450b-80ad-76edb1ea9b3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:15:13.949970 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36970f8-1298-450b-80ad-76edb1ea9b3a service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:15:13.953447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:15:13.969337 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 758/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:15:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:15:14.014858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955908c-4016-4b6a-bdac-371e55cd412c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:14.015181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955908c-4016-4b6a-bdac-371e55cd412c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:14.015458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955908c-4016-4b6a-bdac-371e55cd412c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:14.016717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 748/1506] 10.222.0.20 () {52 vars in 830 bytes} [Tue Sep 13 01:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:15:14.020592 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36970f8-1298-450b-80ad-76edb1ea9b3a service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:15:14.022615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b36970f8-1298-450b-80ad-76edb1ea9b3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:14.120192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36970f8-1298-450b-80ad-76edb1ea9b3a service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:15:14.212100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf924b91-943f-4e20-98fb-5e44c56f470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:15:14.212751 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf924b91-943f-4e20-98fb-5e44c56f470d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:14.212980 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf924b91-943f-4e20-98fb-5e44c56f470d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:14.213250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf924b91-943f-4e20-98fb-5e44c56f470d admin admin] PATH_INFO: `/v3/users/806eed90fc4a42c29f79cdd1771354b7` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:14.226805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf924b91-943f-4e20-98fb-5e44c56f470d admin admin] RBAC: Authorizing `identity:delete_user(user_id=806eed90fc4a42c29f79cdd1771354b7)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:15:14.227815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: WARNING py.warnings [None req-cf924b91-943f-4e20-98fb-5e44c56f470d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 01:15:14.227815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: warnings.warn(msg) Sep 13 01:15:14.227815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: Sep 13 01:15:14.229009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf924b91-943f-4e20-98fb-5e44c56f470d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:15:14.238409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:15:14.296419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-cf924b91-943f-4e20-98fb-5e44c56f470d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806eed90fc4a42c29f79cdd1771354b7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:15:14.296854 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-cf924b91-943f-4e20-98fb-5e44c56f470d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806eed90fc4a42c29f79cdd1771354b7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:15:14.311421 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-cf924b91-943f-4e20-98fb-5e44c56f470d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806eed90fc4a42c29f79cdd1771354b7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:15:14.334272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-cf924b91-943f-4e20-98fb-5e44c56f470d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806eed90fc4a42c29f79cdd1771354b7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:15:14.334827 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-cf924b91-943f-4e20-98fb-5e44c56f470d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806eed90fc4a42c29f79cdd1771354b7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:15:14.348780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 759/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:15:14 2022] DELETE /identity/v3/users/806eed90fc4a42c29f79cdd1771354b7 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:15:14.353728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c017eba-0742-4efe-ab50-2ee003eddf02 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:14.354012 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c017eba-0742-4efe-ab50-2ee003eddf02 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:14.354282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c017eba-0742-4efe-ab50-2ee003eddf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:14.410730 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9c017eba-0742-4efe-ab50-2ee003eddf02 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:15:14.412349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9c017eba-0742-4efe-ab50-2ee003eddf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:14.489033 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:15:14.501945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 749/1508] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:15:14.512080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf924b91-943f-4e20-98fb-5e44c56f470d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:15:14.513325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-cf924b91-943f-4e20-98fb-5e44c56f470d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:14.614941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf924b91-943f-4e20-98fb-5e44c56f470d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:15:14.670050 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:15:14.691627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc257d1-43b0-48e6-8f83-c2edce216548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:15:14.692238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc257d1-43b0-48e6-8f83-c2edce216548 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:14.692515 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc257d1-43b0-48e6-8f83-c2edce216548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:14.693321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc257d1-43b0-48e6-8f83-c2edce216548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:14.694903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5bc257d1-43b0-48e6-8f83-c2edce216548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:14.803753 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc257d1-43b0-48e6-8f83-c2edce216548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:15:14.805196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc257d1-43b0-48e6-8f83-c2edce216548 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:15:14.823834 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 760/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:15:15.176662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c017eba-0742-4efe-ab50-2ee003eddf02 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:15:15.178569 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9c017eba-0742-4efe-ab50-2ee003eddf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:15:15.190197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c017eba-0742-4efe-ab50-2ee003eddf02 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:15:15.294312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0296e5-36ef-41c0-b377-57673f729e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:15:15.294941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0296e5-36ef-41c0-b377-57673f729e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:15:15.295248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0296e5-36ef-41c0-b377-57673f729e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:15:15.295517 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0296e5-36ef-41c0-b377-57673f729e1d admin admin] PATH_INFO: `/v3/projects/fe24a8d6c50e4f28a71f9e040d7d56fd` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:15:15.306017 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0296e5-36ef-41c0-b377-57673f729e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe24a8d6c50e4f28a71f9e040d7d56fd)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:15:15.306969 dv-cinder-856941-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-3c0296e5-36ef-41c0-b377-57673f729e1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 01:15:15.306969 dv-cinder-856941-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Sep 13 01:15:15.306969 dv-cinder-856941-3-smb devstack@keystone.service[81466]: Sep 13 01:15:15.308186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0296e5-36ef-41c0-b377-57673f729e1d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:15:15.364175 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3c0296e5-36ef-41c0-b377-57673f729e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe24a8d6c50e4f28a71f9e040d7d56fd', 'request_id': 'req-3c0296e5-36ef-41c0-b377-57673f729e1d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:15:15.373609 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3c0296e5-36ef-41c0-b377-57673f729e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe24a8d6c50e4f28a71f9e040d7d56fd', 'request_id': 'req-3c0296e5-36ef-41c0-b377-57673f729e1d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:15:15.387761 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3c0296e5-36ef-41c0-b377-57673f729e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe24a8d6c50e4f28a71f9e040d7d56fd', 'request_id': 'req-3c0296e5-36ef-41c0-b377-57673f729e1d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:15:15.410215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3c0296e5-36ef-41c0-b377-57673f729e1d admin admin] The token cache is being invalidate because project fe24a8d6c50e4f28a71f9e040d7d56fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:15:15.410506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3c0296e5-36ef-41c0-b377-57673f729e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:15:15.411031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3c0296e5-36ef-41c0-b377-57673f729e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:15:15.412959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 750/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:15:15 2022] DELETE /identity/v3/projects/fe24a8d6c50e4f28a71f9e040d7d56fd => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:15:24.821578 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=62 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:15:25.408409 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:16:51.118508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbac4a-af65-4c23-97ac-afea67235a00 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:16:51.119134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbac4a-af65-4c23-97ac-afea67235a00 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:16:51.119134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbac4a-af65-4c23-97ac-afea67235a00 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:16:51.120435 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 01:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:16:51.125184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84f3cd-1391-48ad-a19b-3097c04eaf94 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:16:51.125642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84f3cd-1391-48ad-a19b-3097c04eaf94 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:16:51.125754 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84f3cd-1391-48ad-a19b-3097c04eaf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:16:51.206657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4f84f3cd-1391-48ad-a19b-3097c04eaf94 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:16:51.207907 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4f84f3cd-1391-48ad-a19b-3097c04eaf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:16:51.313068 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 01:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:16:51.470319 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbac4a-af65-4c23-97ac-afea67235a00 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:16:51.473615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-75cbac4a-af65-4c23-97ac-afea67235a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:16:51.591979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbac4a-af65-4c23-97ac-afea67235a00 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:16:51.598473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b42684-aceb-495c-874d-5de5af905e1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:16:51.599099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b42684-aceb-495c-874d-5de5af905e1c service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:16:51.599375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b42684-aceb-495c-874d-5de5af905e1c service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:16:51.599649 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b42684-aceb-495c-874d-5de5af905e1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:16:51.607790 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b42684-aceb-495c-874d-5de5af905e1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:16:51.609368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b42684-aceb-495c-874d-5de5af905e1c service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:16:51.618972 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 762/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:16:52.698262 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0846e8f-3d4a-4a9b-b27e-b56033f1a6a9 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:16:52.698800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0846e8f-3d4a-4a9b-b27e-b56033f1a6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:16:52.698800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0846e8f-3d4a-4a9b-b27e-b56033f1a6a9 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:16:52.700129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 01:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:16:52.706189 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c318b35-4db2-4680-977d-e043373f8bc9 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:16:52.707627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c318b35-4db2-4680-977d-e043373f8bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:16:52.707809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c318b35-4db2-4680-977d-e043373f8bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:16:52.728077 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6c318b35-4db2-4680-977d-e043373f8bc9 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:16:52.729298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6c318b35-4db2-4680-977d-e043373f8bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:16:52.739996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 01:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:16:52.893398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0846e8f-3d4a-4a9b-b27e-b56033f1a6a9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:16:52.908146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0846e8f-3d4a-4a9b-b27e-b56033f1a6a9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:16:52.914425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43532846-1a79-495e-9a91-af29338a6134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:16:52.915026 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43532846-1a79-495e-9a91-af29338a6134 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:16:52.915342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43532846-1a79-495e-9a91-af29338a6134 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:16:52.915618 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43532846-1a79-495e-9a91-af29338a6134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:16:52.927107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43532846-1a79-495e-9a91-af29338a6134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:16:52.928693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43532846-1a79-495e-9a91-af29338a6134 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:16:52.938013 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 753/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:16:53.398218 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5d142-2969-498c-ac0e-cd7249552c12 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:16:53.398503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5d142-2969-498c-ac0e-cd7249552c12 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:16:53.398779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5d142-2969-498c-ac0e-cd7249552c12 None None] PATH_INFO: `/v3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:16:53.400102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 764/1517] 10.222.0.42 () {54 vars in 925 bytes} [Tue Sep 13 01:16:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:16:53.409366 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc35d5-0fe5-4cfa-b0a5-91fa664e4106 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:16:53.409743 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc35d5-0fe5-4cfa-b0a5-91fa664e4106 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:16:53.410020 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc35d5-0fe5-4cfa-b0a5-91fa664e4106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:16:53.470068 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cfdc35d5-0fe5-4cfa-b0a5-91fa664e4106 None None] MFA Rules not processed for user `0c5e6dae854a44a0ad6628e7dd69dfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:16:53.471344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cfdc35d5-0fe5-4cfa-b0a5-91fa664e4106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:16:53.488824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:16:53.545022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 754/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Sep 13 01:16:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:17:02.722326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=56 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:17:02.822339 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5cebc-42a2-4a35-a2a6-52dc2ee5b63e None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:02.822620 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5cebc-42a2-4a35-a2a6-52dc2ee5b63e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:02.822894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5cebc-42a2-4a35-a2a6-52dc2ee5b63e None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:02.824277 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 765/1519] 10.222.0.20 () {54 vars in 961 bytes} [Tue Sep 13 01:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:17:02.829146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dd841-22bf-41a9-8470-ed21bb54040d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:02.829609 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dd841-22bf-41a9-8470-ed21bb54040d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:02.829721 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dd841-22bf-41a9-8470-ed21bb54040d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:02.849888 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-179dd841-22bf-41a9-8470-ed21bb54040d None None] MFA Rules not processed for user `0c5e6dae854a44a0ad6628e7dd69dfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:17:02.851119 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-179dd841-22bf-41a9-8470-ed21bb54040d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:17:02.859549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 755/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Sep 13 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:17:02.867743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5cebc-42a2-4a35-a2a6-52dc2ee5b63e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:17:02.881857 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5cebc-42a2-4a35-a2a6-52dc2ee5b63e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:17:02.887016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd9283-6258-4753-86e1-9c25c8c4873c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c5e6dae854a44a0ad6628e7dd69dfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:17:02.887672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd9283-6258-4753-86e1-9c25c8c4873c service placement] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:02.887955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd9283-6258-4753-86e1-9c25c8c4873c service placement] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:02.888230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd9283-6258-4753-86e1-9c25c8c4873c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:02.897165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd9283-6258-4753-86e1-9c25c8c4873c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:17:02.898747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd9283-6258-4753-86e1-9c25c8c4873c service placement] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:17:02.908368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 766/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:17:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:17:04.417745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98e839-b008-473e-a999-46ddd3ae86f3 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:04.418328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98e839-b008-473e-a999-46ddd3ae86f3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:04.418328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98e839-b008-473e-a999-46ddd3ae86f3 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:04.419834 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 01:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:17:04.426532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c207b5-9b87-4269-a5de-44056db7fc43 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:04.427225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c207b5-9b87-4269-a5de-44056db7fc43 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:04.427225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c207b5-9b87-4269-a5de-44056db7fc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:04.447274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e2c207b5-9b87-4269-a5de-44056db7fc43 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:17:04.448459 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e2c207b5-9b87-4269-a5de-44056db7fc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:17:04.456193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 01:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:17:04.610871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98e839-b008-473e-a999-46ddd3ae86f3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:17:04.625973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98e839-b008-473e-a999-46ddd3ae86f3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:17:04.631468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a23bf4-f6f6-4523-a920-7da80f0bc955 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:17:04.632062 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a23bf4-f6f6-4523-a920-7da80f0bc955 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:04.632343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a23bf4-f6f6-4523-a920-7da80f0bc955 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:04.632619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a23bf4-f6f6-4523-a920-7da80f0bc955 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:04.640734 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a23bf4-f6f6-4523-a920-7da80f0bc955 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:17:04.642342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a23bf4-f6f6-4523-a920-7da80f0bc955 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:17:04.651991 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 757/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:17:05.717905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc6b72-57c5-4fc5-b74b-4edb63e9fb02 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:05.718447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc6b72-57c5-4fc5-b74b-4edb63e9fb02 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:05.718447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc6b72-57c5-4fc5-b74b-4edb63e9fb02 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:05.719783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 01:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:17:05.726441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40214c-34f6-4b3c-876a-91c03a8b7e77 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:05.726899 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40214c-34f6-4b3c-876a-91c03a8b7e77 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:05.727013 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40214c-34f6-4b3c-876a-91c03a8b7e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:05.747611 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7e40214c-34f6-4b3c-876a-91c03a8b7e77 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:17:05.748808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7e40214c-34f6-4b3c-876a-91c03a8b7e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:17:05.757087 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:17:05.909756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc6b72-57c5-4fc5-b74b-4edb63e9fb02 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:17:05.924501 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc6b72-57c5-4fc5-b74b-4edb63e9fb02 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:17:05.930197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfddca7-26a7-4181-956a-d51363ab3899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:17:05.930782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfddca7-26a7-4181-956a-d51363ab3899 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:05.931056 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfddca7-26a7-4181-956a-d51363ab3899 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:05.931359 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfddca7-26a7-4181-956a-d51363ab3899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:05.939220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfddca7-26a7-4181-956a-d51363ab3899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:17:05.940791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfddca7-26a7-4181-956a-d51363ab3899 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:17:05.950313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 769/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:17:10.288897 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc258601-fe8d-42f8-a25b-3f9c4bf4140b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:10.289505 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc258601-fe8d-42f8-a25b-3f9c4bf4140b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:10.289505 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc258601-fe8d-42f8-a25b-3f9c4bf4140b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:10.290798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 01:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:17:10.296202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce8a09-395a-4e18-9fce-56767190580d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:10.296650 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce8a09-395a-4e18-9fce-56767190580d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:10.296754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce8a09-395a-4e18-9fce-56767190580d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:10.316109 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-03ce8a09-395a-4e18-9fce-56767190580d None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:17:10.317333 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-03ce8a09-395a-4e18-9fce-56767190580d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:17:10.325141 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:17:10.614624 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc258601-fe8d-42f8-a25b-3f9c4bf4140b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:17:10.616438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bc258601-fe8d-42f8-a25b-3f9c4bf4140b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:17:10.695348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc258601-fe8d-42f8-a25b-3f9c4bf4140b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:17:10.698967 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c1809-ea57-4143-bf85-c63c15d04500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:17:10.699597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c1809-ea57-4143-bf85-c63c15d04500 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:10.699908 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c1809-ea57-4143-bf85-c63c15d04500 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:10.700183 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c1809-ea57-4143-bf85-c63c15d04500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:10.710099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c1809-ea57-4143-bf85-c63c15d04500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:17:10.711615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c1809-ea57-4143-bf85-c63c15d04500 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:17:10.721028 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 760/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:17:12.881857 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ab55b-3165-4242-af31-4a0cc33ddc3d None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:12.882462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ab55b-3165-4242-af31-4a0cc33ddc3d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:12.882462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ab55b-3165-4242-af31-4a0cc33ddc3d None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:12.883784 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 01:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:17:12.889010 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d96ba-ee3a-44ae-a7c7-1ce8e21903ac None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:12.889468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d96ba-ee3a-44ae-a7c7-1ce8e21903ac None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:12.889578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d96ba-ee3a-44ae-a7c7-1ce8e21903ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:12.910429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-651d96ba-ee3a-44ae-a7c7-1ce8e21903ac None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:17:12.911707 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-651d96ba-ee3a-44ae-a7c7-1ce8e21903ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:17:12.919577 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 01:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:17:13.214747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ab55b-3165-4242-af31-4a0cc33ddc3d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:17:13.226124 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ab55b-3165-4242-af31-4a0cc33ddc3d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:17:13.229644 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801f5d7-42b5-479f-a9cd-82a7d9b5f74f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:17:13.230234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801f5d7-42b5-479f-a9cd-82a7d9b5f74f service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:13.230512 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801f5d7-42b5-479f-a9cd-82a7d9b5f74f service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:13.230784 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801f5d7-42b5-479f-a9cd-82a7d9b5f74f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:13.239557 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801f5d7-42b5-479f-a9cd-82a7d9b5f74f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:17:13.240979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801f5d7-42b5-479f-a9cd-82a7d9b5f74f service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:17:13.250208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 772/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:17:16.992130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e085dc-8e5d-4ea8-aa5b-1435e520e292 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:16.992719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e085dc-8e5d-4ea8-aa5b-1435e520e292 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:16.992719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e085dc-8e5d-4ea8-aa5b-1435e520e292 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:16.994101 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 01:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:17:16.999417 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bad15-9fcc-41ca-92da-5cf6a9efd08c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:16.999859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bad15-9fcc-41ca-92da-5cf6a9efd08c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:16.999989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bad15-9fcc-41ca-92da-5cf6a9efd08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:17.020994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5b3bad15-9fcc-41ca-92da-5cf6a9efd08c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:17:17.022176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5b3bad15-9fcc-41ca-92da-5cf6a9efd08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:17:17.029829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:17:17.338429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e085dc-8e5d-4ea8-aa5b-1435e520e292 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:17:17.340151 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-84e085dc-8e5d-4ea8-aa5b-1435e520e292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:17:17.404212 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:17:17.420297 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e085dc-8e5d-4ea8-aa5b-1435e520e292 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:17:17.423544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dbf43-a962-47c6-bb56-39667a95969b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:17:17.424153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dbf43-a962-47c6-bb56-39667a95969b service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:17.424429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dbf43-a962-47c6-bb56-39667a95969b service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:17.424700 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dbf43-a962-47c6-bb56-39667a95969b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:17.435124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223dbf43-a962-47c6-bb56-39667a95969b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:17:17.436550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223dbf43-a962-47c6-bb56-39667a95969b service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:17:17.445915 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 763/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:17:19.740174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f0837-b9e9-4fe6-a0a0-54801e266521 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:19.740735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f0837-b9e9-4fe6-a0a0-54801e266521 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:19.740735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f0837-b9e9-4fe6-a0a0-54801e266521 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:19.742029 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 01:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:17:19.747154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc832ddb-e4f5-4e77-aae4-3dbb85589e17 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:19.747564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc832ddb-e4f5-4e77-aae4-3dbb85589e17 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:19.747731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc832ddb-e4f5-4e77-aae4-3dbb85589e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:19.767550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cc832ddb-e4f5-4e77-aae4-3dbb85589e17 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:17:19.768753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cc832ddb-e4f5-4e77-aae4-3dbb85589e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:17:19.777174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 01:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:17:20.079155 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f0837-b9e9-4fe6-a0a0-54801e266521 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:17:20.080827 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c84f0837-b9e9-4fe6-a0a0-54801e266521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:17:20.094582 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f0837-b9e9-4fe6-a0a0-54801e266521 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:17:20.098271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d5571-6c2e-4cca-a33e-0eb5738d2da8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:17:20.098858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d5571-6c2e-4cca-a33e-0eb5738d2da8 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:17:20.099165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d5571-6c2e-4cca-a33e-0eb5738d2da8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:17:20.099441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d5571-6c2e-4cca-a33e-0eb5738d2da8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:17:20.108560 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d5571-6c2e-4cca-a33e-0eb5738d2da8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:17:20.110012 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d5571-6c2e-4cca-a33e-0eb5738d2da8 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:17:20.119941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 775/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:17:29.762798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=11 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:17:30.115873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=33 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:54.502181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9cad4-b3f3-45a1-baf3-a00ac3cec73c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:54.503329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9cad4-b3f3-45a1-baf3-a00ac3cec73c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:54.503855 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9cad4-b3f3-45a1-baf3-a00ac3cec73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:54.532659 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-adf9cad4-b3f3-45a1-baf3-a00ac3cec73c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:54.533948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-adf9cad4-b3f3-45a1-baf3-a00ac3cec73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:54.546825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 765/1540] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:54.556683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a4e4d-f284-4c90-8d95-e90bd2971a06 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:54.557714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a4e4d-f284-4c90-8d95-e90bd2971a06 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:54.558189 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a4e4d-f284-4c90-8d95-e90bd2971a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:54.597811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-334a4e4d-f284-4c90-8d95-e90bd2971a06 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:54.599115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-334a4e4d-f284-4c90-8d95-e90bd2971a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:54.617300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 776/1541] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:54.621877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9cad4-b3f3-45a1-baf3-a00ac3cec73c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:54.632811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9cad4-b3f3-45a1-baf3-a00ac3cec73c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:54.649518 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75971839-4a4f-43b2-a29e-e37786152849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:54.650173 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75971839-4a4f-43b2-a29e-e37786152849 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:54.650454 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75971839-4a4f-43b2-a29e-e37786152849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:54.650728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75971839-4a4f-43b2-a29e-e37786152849 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:54.655095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75971839-4a4f-43b2-a29e-e37786152849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:18:54.655095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75971839-4a4f-43b2-a29e-e37786152849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:54.655095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75971839-4a4f-43b2-a29e-e37786152849 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:54.676525 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 766/1542] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:18:54.693170 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a4e4d-f284-4c90-8d95-e90bd2971a06 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:54.706925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a4e4d-f284-4c90-8d95-e90bd2971a06 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:54.719855 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ce219-1c01-4a38-927c-988404684f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:54.720508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ce219-1c01-4a38-927c-988404684f64 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:54.720793 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ce219-1c01-4a38-927c-988404684f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:54.721071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ce219-1c01-4a38-927c-988404684f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:54.721921 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ce219-1c01-4a38-927c-988404684f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:54.723923 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ce219-1c01-4a38-927c-988404684f64 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:54.785781 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 777/1543] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:18:54 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:54.791493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75971839-4a4f-43b2-a29e-e37786152849 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:54.809692 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8065d4-aa63-4513-9844-d645881f1a8b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:54.810262 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8065d4-aa63-4513-9844-d645881f1a8b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:54.810770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8065d4-aa63-4513-9844-d645881f1a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:54.813451 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75971839-4a4f-43b2-a29e-e37786152849 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:54.858221 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7a8065d4-aa63-4513-9844-d645881f1a8b None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:54.859917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7a8065d4-aa63-4513-9844-d645881f1a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:54.904811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a9bb0-1c42-41ba-b41b-298f1029710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:54.905449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a9bb0-1c42-41ba-b41b-298f1029710d admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:54.905730 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a9bb0-1c42-41ba-b41b-298f1029710d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:54.906004 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a9bb0-1c42-41ba-b41b-298f1029710d admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:54.906653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a9bb0-1c42-41ba-b41b-298f1029710d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:54.908938 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a9bb0-1c42-41ba-b41b-298f1029710d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:54.951233 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 767/1544] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:18:54 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:54.952544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124a5b7-b5e8-4075-9cbd-5a5180145bbd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:54.952814 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124a5b7-b5e8-4075-9cbd-5a5180145bbd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:54.953095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124a5b7-b5e8-4075-9cbd-5a5180145bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:54.991480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6124a5b7-b5e8-4075-9cbd-5a5180145bbd None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:54.992720 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6124a5b7-b5e8-4075-9cbd-5a5180145bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:54.994080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 778/1545] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:18:54.995352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8065d4-aa63-4513-9844-d645881f1a8b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.009105 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8065d4-aa63-4513-9844-d645881f1a8b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.010821 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 768/1546] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:55.015141 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef6b75-bcec-4cb0-b19a-9e01018b4c06 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.015141 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef6b75-bcec-4cb0-b19a-9e01018b4c06 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.015141 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef6b75-bcec-4cb0-b19a-9e01018b4c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.021958 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521a9dc-1662-42f4-ae94-b86a5ef46acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.023697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521a9dc-1662-42f4-ae94-b86a5ef46acd admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.024018 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521a9dc-1662-42f4-ae94-b86a5ef46acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.024300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521a9dc-1662-42f4-ae94-b86a5ef46acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.024972 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521a9dc-1662-42f4-ae94-b86a5ef46acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.026610 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521a9dc-1662-42f4-ae94-b86a5ef46acd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.034557 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a9ef6b75-bcec-4cb0-b19a-9e01018b4c06 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:55.035794 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a9ef6b75-bcec-4cb0-b19a-9e01018b4c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:55.037656 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 779/1547] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:55.038687 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae547260-23da-429c-9a41-74b697c2798f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.038978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae547260-23da-429c-9a41-74b697c2798f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.042224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae547260-23da-429c-9a41-74b697c2798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.044368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 769/1548] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:55.050691 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2de34-3e1a-456d-94a1-78a64e6dac1a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.050691 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2de34-3e1a-456d-94a1-78a64e6dac1a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.050691 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2de34-3e1a-456d-94a1-78a64e6dac1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.069600 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ae547260-23da-429c-9a41-74b697c2798f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:55.070737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6db2de34-3e1a-456d-94a1-78a64e6dac1a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:55.070878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ae547260-23da-429c-9a41-74b697c2798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:55.071968 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6db2de34-3e1a-456d-94a1-78a64e6dac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:55.079567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 780/1549] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:55.080693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 770/1550] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:55.080830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e1820-d71b-4a57-b509-bc5c8bc4b1db None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.081035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e1820-d71b-4a57-b509-bc5c8bc4b1db None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.081297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e1820-d71b-4a57-b509-bc5c8bc4b1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.081698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e1c49-2c66-4221-bacf-bd1b93e6c6c3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.081978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e1c49-2c66-4221-bacf-bd1b93e6c6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.082256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e1c49-2c66-4221-bacf-bd1b93e6c6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.102911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5c2e1820-d71b-4a57-b509-bc5c8bc4b1db None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:55.103716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-302e1c49-2c66-4221-bacf-bd1b93e6c6c3 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:55.104149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5c2e1820-d71b-4a57-b509-bc5c8bc4b1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:55.104896 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-302e1c49-2c66-4221-bacf-bd1b93e6c6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:55.112129 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 781/1551] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:55.116411 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 771/1552] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:55.116611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418c02d-c224-439f-aeda-51a686b24cf3 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.116611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418c02d-c224-439f-aeda-51a686b24cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.116832 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e1c49-2c66-4221-bacf-bd1b93e6c6c3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.116920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418c02d-c224-439f-aeda-51a686b24cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.126325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e1c49-2c66-4221-bacf-bd1b93e6c6c3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.131408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b29d60-9b2d-4577-b744-74894c497ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.132073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b29d60-9b2d-4577-b744-74894c497ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.132351 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b29d60-9b2d-4577-b744-74894c497ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.132622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b29d60-9b2d-4577-b744-74894c497ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.133263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b29d60-9b2d-4577-b744-74894c497ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.133945 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-9418c02d-c224-439f-aeda-51a686b24cf3 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:55.134852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b29d60-9b2d-4577-b744-74894c497ff2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.135168 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9418c02d-c224-439f-aeda-51a686b24cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:55.142874 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 782/1553] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:55.144090 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352cc8f-d0a9-4c4c-b46e-93d4414aab3c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.144370 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352cc8f-d0a9-4c4c-b46e-93d4414aab3c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.144642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352cc8f-d0a9-4c4c-b46e-93d4414aab3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.145093 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 772/1554] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:55.146077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db5366-4090-4cd9-b333-3dc471ba3315 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.146928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db5366-4090-4cd9-b333-3dc471ba3315 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.147389 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db5366-4090-4cd9-b333-3dc471ba3315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.164426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7352cc8f-d0a9-4c4c-b46e-93d4414aab3c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:55.165614 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7352cc8f-d0a9-4c4c-b46e-93d4414aab3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:55.166779 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-14db5366-4090-4cd9-b333-3dc471ba3315 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:55.167969 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-14db5366-4090-4cd9-b333-3dc471ba3315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:55.173462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 783/1555] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:55.174402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47f853-2310-461f-851d-7708e2fbc1c0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.174739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47f853-2310-461f-851d-7708e2fbc1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.174953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47f853-2310-461f-851d-7708e2fbc1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.176139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 773/1556] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:55.177150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0942eec-d1ab-4254-87f9-a4403c26d923 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.177426 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0942eec-d1ab-4254-87f9-a4403c26d923 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.178328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0942eec-d1ab-4254-87f9-a4403c26d923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.198080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3c47f853-2310-461f-851d-7708e2fbc1c0 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:55.199413 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b0942eec-d1ab-4254-87f9-a4403c26d923 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:55.199538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3c47f853-2310-461f-851d-7708e2fbc1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:55.200578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b0942eec-d1ab-4254-87f9-a4403c26d923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:55.207464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 784/1557] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:55.212962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47f853-2310-461f-851d-7708e2fbc1c0 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.213108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 774/1558] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:55.213108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0789f94-7307-4094-a230-34a5d6f7f84b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.213108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0789f94-7307-4094-a230-34a5d6f7f84b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.213108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0789f94-7307-4094-a230-34a5d6f7f84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.222356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47f853-2310-461f-851d-7708e2fbc1c0 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.227820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abff393-865d-49ef-83aa-e747d198d29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.228420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abff393-865d-49ef-83aa-e747d198d29c admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.228702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abff393-865d-49ef-83aa-e747d198d29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.228977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abff393-865d-49ef-83aa-e747d198d29c admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.229618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abff393-865d-49ef-83aa-e747d198d29c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:18:55.229925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abff393-865d-49ef-83aa-e747d198d29c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.230031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f0789f94-7307-4094-a230-34a5d6f7f84b None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:55.230955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: WARNING py.warnings [None req-2abff393-865d-49ef-83aa-e747d198d29c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 01:18:55.230955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: warnings.warn(msg) Sep 13 01:18:55.230955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: Sep 13 01:18:55.231239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f0789f94-7307-4094-a230-34a5d6f7f84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:55.231876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abff393-865d-49ef-83aa-e747d198d29c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.238901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 775/1559] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:55.239674 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0789f94-7307-4094-a230-34a5d6f7f84b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.250651 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 785/1560] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:18:55.250651 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abff393-865d-49ef-83aa-e747d198d29c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.255716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0789f94-7307-4094-a230-34a5d6f7f84b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.256705 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abff393-865d-49ef-83aa-e747d198d29c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.260376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbab93b-431d-4a6b-8d02-3c85f87498ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.261039 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbab93b-431d-4a6b-8d02-3c85f87498ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.261155 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac293d-342c-4a83-a9d0-c980ca3d8efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.261318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbab93b-431d-4a6b-8d02-3c85f87498ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.261594 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbab93b-431d-4a6b-8d02-3c85f87498ff admin admin] PATH_INFO: `/v3/projects/66797ec16d1a43dea20097378ed1f11d/users/70bd3281a28d4bc9929f1ddf7415b11b/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.261721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac293d-342c-4a83-a9d0-c980ca3d8efa admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.261999 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac293d-342c-4a83-a9d0-c980ca3d8efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.262272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac293d-342c-4a83-a9d0-c980ca3d8efa admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.262898 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac293d-342c-4a83-a9d0-c980ca3d8efa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:18:55.263223 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac293d-342c-4a83-a9d0-c980ca3d8efa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.264845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac293d-342c-4a83-a9d0-c980ca3d8efa admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.277078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbab93b-431d-4a6b-8d02-3c85f87498ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=66797ec16d1a43dea20097378ed1f11d, user_id=70bd3281a28d4bc9929f1ddf7415b11b, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.277928 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 786/1561] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:18:55.278114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-ecbab93b-431d-4a6b-8d02-3c85f87498ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 01:18:55.278114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Sep 13 01:18:55.278114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: Sep 13 01:18:55.278746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac293d-342c-4a83-a9d0-c980ca3d8efa admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.280069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbab93b-431d-4a6b-8d02-3c85f87498ff admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.288803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac293d-342c-4a83-a9d0-c980ca3d8efa admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.294314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 776/1562] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:18:55 2022] PUT /identity/v3/projects/66797ec16d1a43dea20097378ed1f11d/users/70bd3281a28d4bc9929f1ddf7415b11b/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:18:55.295585 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bbab4-bb1a-4d3f-80f3-7d73c16ba91f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.295865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bbab4-bb1a-4d3f-80f3-7d73c16ba91f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.296144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bbab4-bb1a-4d3f-80f3-7d73c16ba91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.319265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-663bbab4-bb1a-4d3f-80f3-7d73c16ba91f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:55.320498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-663bbab4-bb1a-4d3f-80f3-7d73c16ba91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:55.346604 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:55.357591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1a94b-5a7f-41c5-8a98-1ab394215423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.358221 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1a94b-5a7f-41c5-8a98-1ab394215423 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.358503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1a94b-5a7f-41c5-8a98-1ab394215423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.358780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1a94b-5a7f-41c5-8a98-1ab394215423 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.359458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1a94b-5a7f-41c5-8a98-1ab394215423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:18:55.359765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1a94b-5a7f-41c5-8a98-1ab394215423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.361383 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1a94b-5a7f-41c5-8a98-1ab394215423 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.368620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:55.374378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 787/1563] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:18:55.375469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1a94b-5a7f-41c5-8a98-1ab394215423 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.385810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1a94b-5a7f-41c5-8a98-1ab394215423 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.386587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 777/1564] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:55.387455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bbab4-bb1a-4d3f-80f3-7d73c16ba91f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.390780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf8197-3cf9-4f43-90db-e1323a292967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.391413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf8197-3cf9-4f43-90db-e1323a292967 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.391698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf8197-3cf9-4f43-90db-e1323a292967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.391976 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf8197-3cf9-4f43-90db-e1323a292967 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.392615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf8197-3cf9-4f43-90db-e1323a292967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:18:55.392917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf8197-3cf9-4f43-90db-e1323a292967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.394515 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf8197-3cf9-4f43-90db-e1323a292967 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.398175 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bbab4-bb1a-4d3f-80f3-7d73c16ba91f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.402763 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0559d7-1994-4bb9-82df-dbd05a245d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.403400 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0559d7-1994-4bb9-82df-dbd05a245d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.403677 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0559d7-1994-4bb9-82df-dbd05a245d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.403947 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0559d7-1994-4bb9-82df-dbd05a245d72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.404584 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0559d7-1994-4bb9-82df-dbd05a245d72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:18:55.404885 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0559d7-1994-4bb9-82df-dbd05a245d72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.406464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0559d7-1994-4bb9-82df-dbd05a245d72 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.417054 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 788/1565] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:18:55.417054 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf8197-3cf9-4f43-90db-e1323a292967 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.421867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf8197-3cf9-4f43-90db-e1323a292967 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.423475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 778/1566] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:18:55.424483 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0559d7-1994-4bb9-82df-dbd05a245d72 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.426940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea806d2-3163-4442-95d3-b1f9f8733123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.427710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea806d2-3163-4442-95d3-b1f9f8733123 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.428554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea806d2-3163-4442-95d3-b1f9f8733123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.428928 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea806d2-3163-4442-95d3-b1f9f8733123 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.429662 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea806d2-3163-4442-95d3-b1f9f8733123 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:18:55.430049 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea806d2-3163-4442-95d3-b1f9f8733123 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.431967 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea806d2-3163-4442-95d3-b1f9f8733123 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.436316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0559d7-1994-4bb9-82df-dbd05a245d72 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.441074 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8111e6-50df-4d60-8440-7c79213999d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.441766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8111e6-50df-4d60-8440-7c79213999d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.442051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8111e6-50df-4d60-8440-7c79213999d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.442328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8111e6-50df-4d60-8440-7c79213999d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.443096 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8111e6-50df-4d60-8440-7c79213999d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.444238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-eb8111e6-50df-4d60-8440-7c79213999d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 01:18:55.444238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Sep 13 01:18:55.444238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: Sep 13 01:18:55.444598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 789/1567] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:18:55.445359 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea806d2-3163-4442-95d3-b1f9f8733123 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.445985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8111e6-50df-4d60-8440-7c79213999d2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.455058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea806d2-3163-4442-95d3-b1f9f8733123 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.460397 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635bf4e-c30f-401d-8806-c60c2c9e2906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.461039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635bf4e-c30f-401d-8806-c60c2c9e2906 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.461324 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635bf4e-c30f-401d-8806-c60c2c9e2906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.461594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635bf4e-c30f-401d-8806-c60c2c9e2906 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.462218 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635bf4e-c30f-401d-8806-c60c2c9e2906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.464121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635bf4e-c30f-401d-8806-c60c2c9e2906 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.479249 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 779/1568] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:55.481059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadfc17-8230-4070-a308-7aa8e5febd3d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.481346 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadfc17-8230-4070-a308-7aa8e5febd3d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.481619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadfc17-8230-4070-a308-7aa8e5febd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.492631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 790/1569] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:55.493837 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635bf4e-c30f-401d-8806-c60c2c9e2906 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.511623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7aadfc17-8230-4070-a308-7aa8e5febd3d None None] MFA Rules not processed for user `70bd3281a28d4bc9929f1ddf7415b11b`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:55.513010 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7aadfc17-8230-4070-a308-7aa8e5febd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:55.557326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635bf4e-c30f-401d-8806-c60c2c9e2906 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.562034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3370a-2d9a-4cae-80d9-6a3151b5f872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.562642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3370a-2d9a-4cae-80d9-6a3151b5f872 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.562919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3370a-2d9a-4cae-80d9-6a3151b5f872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.563226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3370a-2d9a-4cae-80d9-6a3151b5f872 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.563858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3370a-2d9a-4cae-80d9-6a3151b5f872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.565758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3370a-2d9a-4cae-80d9-6a3151b5f872 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.582085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 780/1570] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:55.583487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadfc17-8230-4070-a308-7aa8e5febd3d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.594658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadfc17-8230-4070-a308-7aa8e5febd3d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.599120 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 791/1571] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:55.599272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eba39d-f1e8-4657-b89d-52e59e9c002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.600593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eba39d-f1e8-4657-b89d-52e59e9c002c admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.600884 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eba39d-f1e8-4657-b89d-52e59e9c002c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.601162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eba39d-f1e8-4657-b89d-52e59e9c002c admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.601391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3370a-2d9a-4cae-80d9-6a3151b5f872 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.601829 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eba39d-f1e8-4657-b89d-52e59e9c002c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:18:55.602131 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eba39d-f1e8-4657-b89d-52e59e9c002c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.603768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eba39d-f1e8-4657-b89d-52e59e9c002c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.618035 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 781/1572] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:18:55.618871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eba39d-f1e8-4657-b89d-52e59e9c002c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.629621 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eba39d-f1e8-4657-b89d-52e59e9c002c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.675849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3370a-2d9a-4cae-80d9-6a3151b5f872 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.680658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec4acd-d6df-47f9-b19a-482fc59a6cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.681271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec4acd-d6df-47f9-b19a-482fc59a6cac admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.681555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec4acd-d6df-47f9-b19a-482fc59a6cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.681832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec4acd-d6df-47f9-b19a-482fc59a6cac admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.682496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec4acd-d6df-47f9-b19a-482fc59a6cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.684511 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec4acd-d6df-47f9-b19a-482fc59a6cac admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.685880 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f60f2-d4ae-4b7f-9a32-33e0fff69a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.686497 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f60f2-d4ae-4b7f-9a32-33e0fff69a64 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.686781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f60f2-d4ae-4b7f-9a32-33e0fff69a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.687054 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f60f2-d4ae-4b7f-9a32-33e0fff69a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.687738 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f60f2-d4ae-4b7f-9a32-33e0fff69a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.689633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f60f2-d4ae-4b7f-9a32-33e0fff69a64 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.715444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 792/1573] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:55.716316 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec4acd-d6df-47f9-b19a-482fc59a6cac admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.720134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 782/1574] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:55.721022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f60f2-d4ae-4b7f-9a32-33e0fff69a64 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.727277 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:55.741048 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:55.781482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec4acd-d6df-47f9-b19a-482fc59a6cac admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.785159 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f60f2-d4ae-4b7f-9a32-33e0fff69a64 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.786183 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc7712-5315-43d9-8414-b2069a5f528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.786835 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc7712-5315-43d9-8414-b2069a5f528e admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.787716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc7712-5315-43d9-8414-b2069a5f528e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.788182 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc7712-5315-43d9-8414-b2069a5f528e admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.789101 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc7712-5315-43d9-8414-b2069a5f528e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.791026 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dea69-e22e-42d0-b026-8678b178686b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.791211 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc7712-5315-43d9-8414-b2069a5f528e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.791665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dea69-e22e-42d0-b026-8678b178686b admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.791945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dea69-e22e-42d0-b026-8678b178686b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.792220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dea69-e22e-42d0-b026-8678b178686b admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.792864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dea69-e22e-42d0-b026-8678b178686b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.794761 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dea69-e22e-42d0-b026-8678b178686b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.819167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 783/1575] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:55.819167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dea69-e22e-42d0-b026-8678b178686b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.822328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 793/1576] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:55.823541 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc7712-5315-43d9-8414-b2069a5f528e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.826723 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dea69-e22e-42d0-b026-8678b178686b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.885493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89c445-652e-41ba-8c25-880a29cdfbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.886620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89c445-652e-41ba-8c25-880a29cdfbcf admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.886934 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89c445-652e-41ba-8c25-880a29cdfbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.887247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89c445-652e-41ba-8c25-880a29cdfbcf admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.887897 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89c445-652e-41ba-8c25-880a29cdfbcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.889852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89c445-652e-41ba-8c25-880a29cdfbcf admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.890015 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc7712-5315-43d9-8414-b2069a5f528e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.894464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faec0e-a521-4568-aa11-736cf2f9c082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.895092 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faec0e-a521-4568-aa11-736cf2f9c082 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.895381 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faec0e-a521-4568-aa11-736cf2f9c082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.895682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faec0e-a521-4568-aa11-736cf2f9c082 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.896809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42faec0e-a521-4568-aa11-736cf2f9c082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.897973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: WARNING py.warnings [None req-42faec0e-a521-4568-aa11-736cf2f9c082 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 01:18:55.897973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: warnings.warn(msg) Sep 13 01:18:55.897973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: Sep 13 01:18:55.899204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42faec0e-a521-4568-aa11-736cf2f9c082 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.912660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 784/1577] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:55.914297 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c72383-ca3a-4451-b329-dbb81b48830e None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.914591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c72383-ca3a-4451-b329-dbb81b48830e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.914871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c72383-ca3a-4451-b329-dbb81b48830e None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.916444 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 785/1578] 10.222.0.20 () {54 vars in 962 bytes} [Tue Sep 13 01:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:18:55.916970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c72383-ca3a-4451-b329-dbb81b48830e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.923908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 794/1579] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:55.924908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faec0e-a521-4568-aa11-736cf2f9c082 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.931672 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c72383-ca3a-4451-b329-dbb81b48830e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.936409 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50096fc2-fc00-47e8-b9c8-aa04c0d95fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.936580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faec0e-a521-4568-aa11-736cf2f9c082 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:55.937062 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50096fc2-fc00-47e8-b9c8-aa04c0d95fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.937290 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50096fc2-fc00-47e8-b9c8-aa04c0d95fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.937571 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50096fc2-fc00-47e8-b9c8-aa04c0d95fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.938235 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50096fc2-fc00-47e8-b9c8-aa04c0d95fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.940248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50096fc2-fc00-47e8-b9c8-aa04c0d95fc4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.941036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914ec2e-3f34-43f6-89b9-1c58e9b018b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:55.941620 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914ec2e-3f34-43f6-89b9-1c58e9b018b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:55.941899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914ec2e-3f34-43f6-89b9-1c58e9b018b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:55.942169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914ec2e-3f34-43f6-89b9-1c58e9b018b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:55.942783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914ec2e-3f34-43f6-89b9-1c58e9b018b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:55.945296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914ec2e-3f34-43f6-89b9-1c58e9b018b1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:55.968413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 795/1580] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:55.969205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914ec2e-3f34-43f6-89b9-1c58e9b018b1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.970419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 786/1581] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:55.971164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50096fc2-fc00-47e8-b9c8-aa04c0d95fc4 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:55.978841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914ec2e-3f34-43f6-89b9-1c58e9b018b1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.034538 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50096fc2-fc00-47e8-b9c8-aa04c0d95fc4 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.036033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7d0f5-bf86-4048-870f-657128b4150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.036647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7d0f5-bf86-4048-870f-657128b4150b admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.036938 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7d0f5-bf86-4048-870f-657128b4150b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.037267 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7d0f5-bf86-4048-870f-657128b4150b admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.038194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7d0f5-bf86-4048-870f-657128b4150b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.039314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b67c6f-de02-4b79-81ae-30f3e3b5f4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.039916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b67c6f-de02-4b79-81ae-30f3e3b5f4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.040138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7d0f5-bf86-4048-870f-657128b4150b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.040238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b67c6f-de02-4b79-81ae-30f3e3b5f4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.040451 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b67c6f-de02-4b79-81ae-30f3e3b5f4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.041087 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b67c6f-de02-4b79-81ae-30f3e3b5f4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.042746 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b67c6f-de02-4b79-81ae-30f3e3b5f4b8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.051450 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:56.053458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 787/1582] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:56.055130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b67c6f-de02-4b79-81ae-30f3e3b5f4b8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.064106 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b67c6f-de02-4b79-81ae-30f3e3b5f4b8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.067479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 796/1583] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:18:55 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:56.067479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7d0f5-bf86-4048-870f-657128b4150b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.071972 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6a98e-2e01-442f-8cb3-26e7434f6920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.072577 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6a98e-2e01-442f-8cb3-26e7434f6920 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.072852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6a98e-2e01-442f-8cb3-26e7434f6920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.073119 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6a98e-2e01-442f-8cb3-26e7434f6920 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.073745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6a98e-2e01-442f-8cb3-26e7434f6920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.075681 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6a98e-2e01-442f-8cb3-26e7434f6920 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.078093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7d0f5-bf86-4048-870f-657128b4150b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.082723 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baa524-0c34-4e59-8333-285f30ce65e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.083626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baa524-0c34-4e59-8333-285f30ce65e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.084244 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baa524-0c34-4e59-8333-285f30ce65e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.084521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baa524-0c34-4e59-8333-285f30ce65e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.085160 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baa524-0c34-4e59-8333-285f30ce65e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.085287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:56.086897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baa524-0c34-4e59-8333-285f30ce65e5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.098632 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 797/1584] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:56.101920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 788/1585] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:18:56 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:56.102012 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad88ac-d961-4282-aae6-a43ef3ac3d3b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.102090 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6a98e-2e01-442f-8cb3-26e7434f6920 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.102174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad88ac-d961-4282-aae6-a43ef3ac3d3b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.102174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad88ac-d961-4282-aae6-a43ef3ac3d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.111167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6a98e-2e01-442f-8cb3-26e7434f6920 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.116408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c72335-6b04-4a1c-b3ef-59008517afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.117001 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c72335-6b04-4a1c-b3ef-59008517afbf admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.117283 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c72335-6b04-4a1c-b3ef-59008517afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.117556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c72335-6b04-4a1c-b3ef-59008517afbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.118199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c72335-6b04-4a1c-b3ef-59008517afbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.119845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c72335-6b04-4a1c-b3ef-59008517afbf admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.130265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 789/1586] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:56.131908 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c72335-6b04-4a1c-b3ef-59008517afbf admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.141550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c72335-6b04-4a1c-b3ef-59008517afbf admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.141710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c1ad88ac-d961-4282-aae6-a43ef3ac3d3b None None] MFA Rules not processed for user `fadc83bec6be41979e1aa4d71f8fc2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:56.142864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c1ad88ac-d961-4282-aae6-a43ef3ac3d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:56.146319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc592003-0141-4c4e-9e8a-09187df4f331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.147209 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc592003-0141-4c4e-9e8a-09187df4f331 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.147518 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc592003-0141-4c4e-9e8a-09187df4f331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.147796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc592003-0141-4c4e-9e8a-09187df4f331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.148430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc592003-0141-4c4e-9e8a-09187df4f331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.149998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc592003-0141-4c4e-9e8a-09187df4f331 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.160007 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 790/1587] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:56.160630 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc592003-0141-4c4e-9e8a-09187df4f331 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.172382 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc592003-0141-4c4e-9e8a-09187df4f331 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.176941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b21efb-1ae5-45e5-b605-ca3843a28350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.177537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b21efb-1ae5-45e5-b605-ca3843a28350 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.177848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b21efb-1ae5-45e5-b605-ca3843a28350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.178122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b21efb-1ae5-45e5-b605-ca3843a28350 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.178741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b21efb-1ae5-45e5-b605-ca3843a28350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.180690 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b21efb-1ae5-45e5-b605-ca3843a28350 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.202323 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 791/1588] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:18:56 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:56.203468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b21efb-1ae5-45e5-b605-ca3843a28350 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.215108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 798/1589] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Sep 13 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:56.216035 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b21efb-1ae5-45e5-b605-ca3843a28350 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.216280 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad88ac-d961-4282-aae6-a43ef3ac3d3b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.221006 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21fc4d-c569-4449-90ce-b3a60ccdc23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.221744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21fc4d-c569-4449-90ce-b3a60ccdc23f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.222028 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21fc4d-c569-4449-90ce-b3a60ccdc23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.222312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21fc4d-c569-4449-90ce-b3a60ccdc23f admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.223528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21fc4d-c569-4449-90ce-b3a60ccdc23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.225707 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21fc4d-c569-4449-90ce-b3a60ccdc23f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.226669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad88ac-d961-4282-aae6-a43ef3ac3d3b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.231216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b337c6-6c9e-40d5-b790-703617d101b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.231837 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b337c6-6c9e-40d5-b790-703617d101b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.232100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b337c6-6c9e-40d5-b790-703617d101b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.232375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b337c6-6c9e-40d5-b790-703617d101b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.233037 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b337c6-6c9e-40d5-b790-703617d101b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.234630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b337c6-6c9e-40d5-b790-703617d101b3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.236947 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 792/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:56.237763 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21fc4d-c569-4449-90ce-b3a60ccdc23f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.245144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 799/1591] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:56.245820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b337c6-6c9e-40d5-b790-703617d101b3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.247745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21fc4d-c569-4449-90ce-b3a60ccdc23f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.252270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f47328-aac4-4b21-9a01-f5f0157c5f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.252858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47328-aac4-4b21-9a01-f5f0157c5f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.253139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47328-aac4-4b21-9a01-f5f0157c5f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.253412 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47328-aac4-4b21-9a01-f5f0157c5f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.254042 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f47328-aac4-4b21-9a01-f5f0157c5f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.256190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f47328-aac4-4b21-9a01-f5f0157c5f3a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.257702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b337c6-6c9e-40d5-b790-703617d101b3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.262285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef528b67-a50b-4ca3-951a-670f4e9b77db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.262866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef528b67-a50b-4ca3-951a-670f4e9b77db admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.263181 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef528b67-a50b-4ca3-951a-670f4e9b77db admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.263454 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef528b67-a50b-4ca3-951a-670f4e9b77db admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.264084 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef528b67-a50b-4ca3-951a-670f4e9b77db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.265685 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef528b67-a50b-4ca3-951a-670f4e9b77db admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.266520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 793/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:56.267432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f47328-aac4-4b21-9a01-f5f0157c5f3a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.276634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 800/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:56.277387 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f47328-aac4-4b21-9a01-f5f0157c5f3a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.277515 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef528b67-a50b-4ca3-951a-670f4e9b77db admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.282301 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02414c0-c550-4104-bc32-212b20991357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.282885 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02414c0-c550-4104-bc32-212b20991357 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.283704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02414c0-c550-4104-bc32-212b20991357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.283985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02414c0-c550-4104-bc32-212b20991357 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.284618 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02414c0-c550-4104-bc32-212b20991357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.286203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02414c0-c550-4104-bc32-212b20991357 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.286758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef528b67-a50b-4ca3-951a-670f4e9b77db admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.292542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4811cc4-5e06-4ad8-8450-0085db499895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.293129 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4811cc4-5e06-4ad8-8450-0085db499895 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.293406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4811cc4-5e06-4ad8-8450-0085db499895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.293676 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4811cc4-5e06-4ad8-8450-0085db499895 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.294306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4811cc4-5e06-4ad8-8450-0085db499895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.295964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4811cc4-5e06-4ad8-8450-0085db499895 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.297359 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 794/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:56.298165 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02414c0-c550-4104-bc32-212b20991357 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.307858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02414c0-c550-4104-bc32-212b20991357 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.313434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 801/1595] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:56.313434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4811cc4-5e06-4ad8-8450-0085db499895 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.315892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4f9c1-c93a-4f8b-b967-06c06a6e4a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.316490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4f9c1-c93a-4f8b-b967-06c06a6e4a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.316777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4f9c1-c93a-4f8b-b967-06c06a6e4a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.317081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4f9c1-c93a-4f8b-b967-06c06a6e4a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.317720 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4f9c1-c93a-4f8b-b967-06c06a6e4a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.319900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4f9c1-c93a-4f8b-b967-06c06a6e4a12 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.324652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4811cc4-5e06-4ad8-8450-0085db499895 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.330093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df6e85-cff5-4e96-9c03-89e7b4342fae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.330303 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 795/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:56.330681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df6e85-cff5-4e96-9c03-89e7b4342fae service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.330960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df6e85-cff5-4e96-9c03-89e7b4342fae service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.331089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4f9c1-c93a-4f8b-b967-06c06a6e4a12 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.331265 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df6e85-cff5-4e96-9c03-89e7b4342fae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.342792 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4f9c1-c93a-4f8b-b967-06c06a6e4a12 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.347476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7555cb-14ff-4f69-9473-c295c510c701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.348108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7555cb-14ff-4f69-9473-c295c510c701 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.348387 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7555cb-14ff-4f69-9473-c295c510c701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.348661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7555cb-14ff-4f69-9473-c295c510c701 admin admin] PATH_INFO: `/v3/projects/0ec99e4c4ac548b387aab76d66b4b1a9/users/ffc41d95c81a4288806ed5e614d8c81f/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.363335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7555cb-14ff-4f69-9473-c295c510c701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec99e4c4ac548b387aab76d66b4b1a9, user_id=ffc41d95c81a4288806ed5e614d8c81f, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.366002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7555cb-14ff-4f69-9473-c295c510c701 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.379413 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 796/1597] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:18:56 2022] PUT /identity/v3/projects/0ec99e4c4ac548b387aab76d66b4b1a9/users/ffc41d95c81a4288806ed5e614d8c81f/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:18:56.380222 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7555cb-14ff-4f69-9473-c295c510c701 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.396994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df6e85-cff5-4e96-9c03-89e7b4342fae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.399002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df6e85-cff5-4e96-9c03-89e7b4342fae service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.407897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 802/1598] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:18:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:18:56.412012 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df6e85-cff5-4e96-9c03-89e7b4342fae service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.424796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df6e85-cff5-4e96-9c03-89e7b4342fae service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.453155 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:56.460466 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7555cb-14ff-4f69-9473-c295c510c701 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.465374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aae69d-2e03-44fd-a3b5-bf3da58daa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.466002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aae69d-2e03-44fd-a3b5-bf3da58daa91 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.466270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aae69d-2e03-44fd-a3b5-bf3da58daa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.466544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aae69d-2e03-44fd-a3b5-bf3da58daa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.467244 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aae69d-2e03-44fd-a3b5-bf3da58daa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.468839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aae69d-2e03-44fd-a3b5-bf3da58daa91 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.479455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 797/1599] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:56.480158 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aae69d-2e03-44fd-a3b5-bf3da58daa91 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.486645 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a6e8d-9e38-422f-8de7-ae268cf4d47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.487033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a6e8d-9e38-422f-8de7-ae268cf4d47d admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.487477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a6e8d-9e38-422f-8de7-ae268cf4d47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.487755 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a6e8d-9e38-422f-8de7-ae268cf4d47d admin admin] PATH_INFO: `/v3/projects/dce77c7fd554406c868912521fc8f2d9/users/c9aaa44d0a8d4cfd97c3f1314fac2b85/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.490856 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aae69d-2e03-44fd-a3b5-bf3da58daa91 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.495551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533853aa-2305-4ed6-a194-c0979f964191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.496172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533853aa-2305-4ed6-a194-c0979f964191 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.496467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533853aa-2305-4ed6-a194-c0979f964191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.496793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533853aa-2305-4ed6-a194-c0979f964191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.497451 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533853aa-2305-4ed6-a194-c0979f964191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.499034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533853aa-2305-4ed6-a194-c0979f964191 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.504104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a6e8d-9e38-422f-8de7-ae268cf4d47d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce77c7fd554406c868912521fc8f2d9, user_id=c9aaa44d0a8d4cfd97c3f1314fac2b85, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.507310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a6e8d-9e38-422f-8de7-ae268cf4d47d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.511408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 798/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:56.512498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533853aa-2305-4ed6-a194-c0979f964191 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.521197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 803/1601] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:18:56 2022] PUT /identity/v3/projects/dce77c7fd554406c868912521fc8f2d9/users/c9aaa44d0a8d4cfd97c3f1314fac2b85/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:18:56.522799 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a6e8d-9e38-422f-8de7-ae268cf4d47d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.524920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533853aa-2305-4ed6-a194-c0979f964191 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.555848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:56.589463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a6e8d-9e38-422f-8de7-ae268cf4d47d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.594320 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39911d61-1da6-4b5e-af57-d80e0a9c7fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.594460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c66cb-d1ec-49b8-a918-726be48e8d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.594993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39911d61-1da6-4b5e-af57-d80e0a9c7fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.595202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c66cb-d1ec-49b8-a918-726be48e8d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.595375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39911d61-1da6-4b5e-af57-d80e0a9c7fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.595481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c66cb-d1ec-49b8-a918-726be48e8d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.595650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39911d61-1da6-4b5e-af57-d80e0a9c7fbc admin admin] PATH_INFO: `/v3/projects/4a563b327667409da32f6c952e94ccdb/users/0045078bffae45078b815d78e67599ec/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.595809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c66cb-d1ec-49b8-a918-726be48e8d7c admin admin] PATH_INFO: `/v3/projects/14f7c7ed4b314451b97bb6121bdace75/users/29bab436248f42fcab44454cd6c78d70/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.611772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39911d61-1da6-4b5e-af57-d80e0a9c7fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a563b327667409da32f6c952e94ccdb, user_id=0045078bffae45078b815d78e67599ec, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.612553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c66cb-d1ec-49b8-a918-726be48e8d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f7c7ed4b314451b97bb6121bdace75, user_id=29bab436248f42fcab44454cd6c78d70, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.614449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39911d61-1da6-4b5e-af57-d80e0a9c7fbc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.615879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c66cb-d1ec-49b8-a918-726be48e8d7c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.630054 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 799/1602] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:18:56 2022] PUT /identity/v3/projects/4a563b327667409da32f6c952e94ccdb/users/0045078bffae45078b815d78e67599ec/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:18:56.641763 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39911d61-1da6-4b5e-af57-d80e0a9c7fbc admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.641921 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 804/1603] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:18:56 2022] PUT /identity/v3/projects/14f7c7ed4b314451b97bb6121bdace75/users/29bab436248f42fcab44454cd6c78d70/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:18:56.641921 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e40c68-37d6-4718-997f-73650a59e64e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.641921 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e40c68-37d6-4718-997f-73650a59e64e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.641921 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e40c68-37d6-4718-997f-73650a59e64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.672713 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a9e40c68-37d6-4718-997f-73650a59e64e None None] MFA Rules not processed for user `ffc41d95c81a4288806ed5e614d8c81f`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:56.673910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a9e40c68-37d6-4718-997f-73650a59e64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:56.706050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39911d61-1da6-4b5e-af57-d80e0a9c7fbc admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.741993 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 805/1604] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:56.742809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e40c68-37d6-4718-997f-73650a59e64e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.764420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26656a-e49c-4b81-b7ac-1e1a18ec5504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.765015 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26656a-e49c-4b81-b7ac-1e1a18ec5504 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.765300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26656a-e49c-4b81-b7ac-1e1a18ec5504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.765575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26656a-e49c-4b81-b7ac-1e1a18ec5504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.766320 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26656a-e49c-4b81-b7ac-1e1a18ec5504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.767942 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26656a-e49c-4b81-b7ac-1e1a18ec5504 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.770451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:56.778043 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 800/1605] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:56.778825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26656a-e49c-4b81-b7ac-1e1a18ec5504 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.788422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26656a-e49c-4b81-b7ac-1e1a18ec5504 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.793090 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0e204-0740-45d7-8429-3999edaf8620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.793732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0e204-0740-45d7-8429-3999edaf8620 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.794016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0e204-0740-45d7-8429-3999edaf8620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.794294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0e204-0740-45d7-8429-3999edaf8620 admin admin] PATH_INFO: `/v3/projects/a94e9c8d555a4657ab9699b9274862c8/users/2821b1a941c543a0aac6f56385c3c8be/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.810658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0e204-0740-45d7-8429-3999edaf8620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94e9c8d555a4657ab9699b9274862c8, user_id=2821b1a941c543a0aac6f56385c3c8be, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.812050 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e40c68-37d6-4718-997f-73650a59e64e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:56.813320 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0e204-0740-45d7-8429-3999edaf8620 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.816534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797b4ff-3cee-419a-89f3-43b43bd4e170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:56.817186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797b4ff-3cee-419a-89f3-43b43bd4e170 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.817461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797b4ff-3cee-419a-89f3-43b43bd4e170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.817754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797b4ff-3cee-419a-89f3-43b43bd4e170 admin admin] PATH_INFO: `/v3/projects/dd3afbb360cd434d9afbde71b1680a27/users/00dbc8a1ee7645668360de8a7cc4ea92/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.827577 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 801/1606] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:18:56 2022] PUT /identity/v3/projects/a94e9c8d555a4657ab9699b9274862c8/users/2821b1a941c543a0aac6f56385c3c8be/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:18:56.832821 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e107f-afe9-494d-a482-c46e357d9c43 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.833366 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e107f-afe9-494d-a482-c46e357d9c43 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.833637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e107f-afe9-494d-a482-c46e357d9c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.835516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797b4ff-3cee-419a-89f3-43b43bd4e170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3afbb360cd434d9afbde71b1680a27, user_id=00dbc8a1ee7645668360de8a7cc4ea92, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:56.838205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797b4ff-3cee-419a-89f3-43b43bd4e170 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:56.857412 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 806/1607] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:18:56 2022] PUT /identity/v3/projects/dd3afbb360cd434d9afbde71b1680a27/users/00dbc8a1ee7645668360de8a7cc4ea92/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:18:56.860539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f417dc2-e632-4bc9-b67d-61abe417a334 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.860956 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f417dc2-e632-4bc9-b67d-61abe417a334 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.861242 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f417dc2-e632-4bc9-b67d-61abe417a334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.869057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c82e107f-afe9-494d-a482-c46e357d9c43 None None] MFA Rules not processed for user `c9aaa44d0a8d4cfd97c3f1314fac2b85`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:56.870266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c82e107f-afe9-494d-a482-c46e357d9c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:56.888406 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:56.888637 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3f417dc2-e632-4bc9-b67d-61abe417a334 None None] MFA Rules not processed for user `0045078bffae45078b815d78e67599ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:56.889940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3f417dc2-e632-4bc9-b67d-61abe417a334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:56.935804 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 802/1608] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:56.937047 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c5f14-48de-4d21-8de4-665091f4bac7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.937327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c5f14-48de-4d21-8de4-665091f4bac7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.937596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c5f14-48de-4d21-8de4-665091f4bac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.963511 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 807/1609] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:56.964781 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9050808-c318-4e15-9c61-69a50321515a None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:56.965072 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9050808-c318-4e15-9c61-69a50321515a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:56.965353 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9050808-c318-4e15-9c61-69a50321515a None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:56.966783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 808/1610] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 13 01:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:18:56.967440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-be5c5f14-48de-4d21-8de4-665091f4bac7 None None] MFA Rules not processed for user `29bab436248f42fcab44454cd6c78d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:56.967567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9050808-c318-4e15-9c61-69a50321515a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:56.968896 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-be5c5f14-48de-4d21-8de4-665091f4bac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:57.035164 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9050808-c318-4e15-9c61-69a50321515a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.036342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 803/1611] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:57.037353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c5f14-48de-4d21-8de4-665091f4bac7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.043109 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b34df-dc5e-47bc-9f6e-8ea0dcd43ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.044280 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b34df-dc5e-47bc-9f6e-8ea0dcd43ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.044604 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b34df-dc5e-47bc-9f6e-8ea0dcd43ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.044884 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b34df-dc5e-47bc-9f6e-8ea0dcd43ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.045520 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b34df-dc5e-47bc-9f6e-8ea0dcd43ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.047459 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b34df-dc5e-47bc-9f6e-8ea0dcd43ea2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.047654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c5f14-48de-4d21-8de4-665091f4bac7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.052226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f588a-f283-4f44-8aac-aa2ddf64721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.053159 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f588a-f283-4f44-8aac-aa2ddf64721e admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.053627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f588a-f283-4f44-8aac-aa2ddf64721e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.053909 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f588a-f283-4f44-8aac-aa2ddf64721e admin admin] PATH_INFO: `/v3/projects/06dfbafff70b46c696c9655707c23ddb/users/9a0a16f3770a433f8ef98af2fbd4b1c7/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.068934 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f588a-f283-4f44-8aac-aa2ddf64721e admin admin] RBAC: Authorizing `identity:create_grant(project_id=06dfbafff70b46c696c9655707c23ddb, user_id=9a0a16f3770a433f8ef98af2fbd4b1c7, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.071809 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f588a-f283-4f44-8aac-aa2ddf64721e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.075689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 809/1612] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:18:56 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:57.076925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fa93f-43c9-4380-a9dd-66afd3df0693 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.077207 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fa93f-43c9-4380-a9dd-66afd3df0693 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.077477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fa93f-43c9-4380-a9dd-66afd3df0693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.087727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 804/1613] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:18:57 2022] PUT /identity/v3/projects/06dfbafff70b46c696c9655707c23ddb/users/9a0a16f3770a433f8ef98af2fbd4b1c7/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:18:57.089115 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7137b78-0a2e-446f-b589-4a8bfd9124e1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.089387 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7137b78-0a2e-446f-b589-4a8bfd9124e1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.089656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7137b78-0a2e-446f-b589-4a8bfd9124e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.096576 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-732fa93f-43c9-4380-a9dd-66afd3df0693 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:57.098857 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-732fa93f-43c9-4380-a9dd-66afd3df0693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:57.110705 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b7137b78-0a2e-446f-b589-4a8bfd9124e1 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:57.112102 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b7137b78-0a2e-446f-b589-4a8bfd9124e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:57.116671 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:57.160170 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 810/1614] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:57.161064 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732fa93f-43c9-4380-a9dd-66afd3df0693 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.170764 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732fa93f-43c9-4380-a9dd-66afd3df0693 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.175459 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775f09e-8f39-4165-a109-79d07a461be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.176060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775f09e-8f39-4165-a109-79d07a461be1 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.176337 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775f09e-8f39-4165-a109-79d07a461be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.176606 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775f09e-8f39-4165-a109-79d07a461be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.177023 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 805/1615] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:57.177237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775f09e-8f39-4165-a109-79d07a461be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.178371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334aff6-72a9-4172-b890-69da05343b20 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.178668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334aff6-72a9-4172-b890-69da05343b20 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.178949 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334aff6-72a9-4172-b890-69da05343b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.179689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775f09e-8f39-4165-a109-79d07a461be1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.202203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0334aff6-72a9-4172-b890-69da05343b20 None None] MFA Rules not processed for user `fadc83bec6be41979e1aa4d71f8fc2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:57.203494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0334aff6-72a9-4172-b890-69da05343b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:57.209561 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 811/1616] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:18:57 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:57.210815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ea263-5376-4537-970b-40942090fdce None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.211131 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ea263-5376-4537-970b-40942090fdce None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.211413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ea263-5376-4537-970b-40942090fdce None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.213129 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 812/1617] 10.222.0.20 () {54 vars in 962 bytes} [Tue Sep 13 01:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:18:57.213821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ea263-5376-4537-970b-40942090fdce None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.225747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:57.273697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 806/1618] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 13 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:57.274936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03472753-5e4a-4de7-84c5-4e59f740fa0a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.275253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03472753-5e4a-4de7-84c5-4e59f740fa0a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.275530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03472753-5e4a-4de7-84c5-4e59f740fa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.281619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ea263-5376-4537-970b-40942090fdce None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.286201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b698e74-cdf9-47ca-bf3d-f2c3eabfcb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.286747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b698e74-cdf9-47ca-bf3d-f2c3eabfcb00 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.287247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b698e74-cdf9-47ca-bf3d-f2c3eabfcb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.287590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b698e74-cdf9-47ca-bf3d-f2c3eabfcb00 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.288193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b698e74-cdf9-47ca-bf3d-f2c3eabfcb00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.290133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b698e74-cdf9-47ca-bf3d-f2c3eabfcb00 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.294468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-03472753-5e4a-4de7-84c5-4e59f740fa0a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:57.295777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-03472753-5e4a-4de7-84c5-4e59f740fa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:57.304541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 807/1619] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:57.305602 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03472753-5e4a-4de7-84c5-4e59f740fa0a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.315292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 813/1620] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:18:57 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:57.316776 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b698e74-cdf9-47ca-bf3d-f2c3eabfcb00 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.361565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03472753-5e4a-4de7-84c5-4e59f740fa0a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.365379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c5a80-7c88-4980-8f4f-96493e8ccb28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.366268 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c5a80-7c88-4980-8f4f-96493e8ccb28 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.366546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c5a80-7c88-4980-8f4f-96493e8ccb28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.366866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c5a80-7c88-4980-8f4f-96493e8ccb28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.373045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b698e74-cdf9-47ca-bf3d-f2c3eabfcb00 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.376258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c5a80-7c88-4980-8f4f-96493e8ccb28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.376728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f4fa8-5ee4-4cc9-ac1a-b2f3a17ffef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.377331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f4fa8-5ee4-4cc9-ac1a-b2f3a17ffef5 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.377605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f4fa8-5ee4-4cc9-ac1a-b2f3a17ffef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.377713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c5a80-7c88-4980-8f4f-96493e8ccb28 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.377875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f4fa8-5ee4-4cc9-ac1a-b2f3a17ffef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.387450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 808/1621] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:18:57.387616 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f4fa8-5ee4-4cc9-ac1a-b2f3a17ffef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.388046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c5a80-7c88-4980-8f4f-96493e8ccb28 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.389032 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f4fa8-5ee4-4cc9-ac1a-b2f3a17ffef5 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.397575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c5a80-7c88-4980-8f4f-96493e8ccb28 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.400224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 814/1622] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:18:57.401816 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeac8b0-2354-46b0-91f3-db5b2bdecf5b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.402539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeac8b0-2354-46b0-91f3-db5b2bdecf5b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.402539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeac8b0-2354-46b0-91f3-db5b2bdecf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.403152 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84585d0-a88f-4ea5-b078-8b1c832fb92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.403760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84585d0-a88f-4ea5-b078-8b1c832fb92a admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.404048 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84585d0-a88f-4ea5-b078-8b1c832fb92a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.404322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84585d0-a88f-4ea5-b078-8b1c832fb92a admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.404957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84585d0-a88f-4ea5-b078-8b1c832fb92a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.406865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84585d0-a88f-4ea5-b078-8b1c832fb92a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.426970 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7aeac8b0-2354-46b0-91f3-db5b2bdecf5b None None] MFA Rules not processed for user `fadc83bec6be41979e1aa4d71f8fc2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:57.429294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7aeac8b0-2354-46b0-91f3-db5b2bdecf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:57.440267 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 809/1623] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:18:57 2022] POST /identity/v3/users => generated 294 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:57.440267 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84585d0-a88f-4ea5-b078-8b1c832fb92a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.467214 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:57.509608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84585d0-a88f-4ea5-b078-8b1c832fb92a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.513855 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e8e26-bb9d-4d93-a88a-c787d57cf37d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.514464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 815/1624] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Sep 13 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:57.514579 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e8e26-bb9d-4d93-a88a-c787d57cf37d service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.515029 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e8e26-bb9d-4d93-a88a-c787d57cf37d service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.515535 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeac8b0-2354-46b0-91f3-db5b2bdecf5b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.519358 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e8e26-bb9d-4d93-a88a-c787d57cf37d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.526326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeac8b0-2354-46b0-91f3-db5b2bdecf5b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.530488 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144339-82f5-4375-b532-e1450ba7fa46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.531427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144339-82f5-4375-b532-e1450ba7fa46 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.531576 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144339-82f5-4375-b532-e1450ba7fa46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.531941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144339-82f5-4375-b532-e1450ba7fa46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.533248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e8e26-bb9d-4d93-a88a-c787d57cf37d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.534701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e8e26-bb9d-4d93-a88a-c787d57cf37d service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.542939 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144339-82f5-4375-b532-e1450ba7fa46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.544464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144339-82f5-4375-b532-e1450ba7fa46 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.554708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 810/1625] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:18:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:18:57.556079 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e8e26-bb9d-4d93-a88a-c787d57cf37d service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.565724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 816/1626] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:18:57.566941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144339-82f5-4375-b532-e1450ba7fa46 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.570952 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e8e26-bb9d-4d93-a88a-c787d57cf37d service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.578535 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0283ba7-f88f-497a-b83c-4bd2c296bfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.579188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0283ba7-f88f-497a-b83c-4bd2c296bfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.579472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0283ba7-f88f-497a-b83c-4bd2c296bfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.579750 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0283ba7-f88f-497a-b83c-4bd2c296bfd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.580403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0283ba7-f88f-497a-b83c-4bd2c296bfd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.582004 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0283ba7-f88f-497a-b83c-4bd2c296bfd7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.584682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144339-82f5-4375-b532-e1450ba7fa46 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.591383 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3782b-8160-4a74-b44f-d8e41defe8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.592335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3782b-8160-4a74-b44f-d8e41defe8cf admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.592707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3782b-8160-4a74-b44f-d8e41defe8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.593104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3782b-8160-4a74-b44f-d8e41defe8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.593903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3782b-8160-4a74-b44f-d8e41defe8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.596287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3782b-8160-4a74-b44f-d8e41defe8cf admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.599141 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 811/1627] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:57.603810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0283ba7-f88f-497a-b83c-4bd2c296bfd7 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.609913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 817/1628] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:57.611056 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3782b-8160-4a74-b44f-d8e41defe8cf admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.620034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0283ba7-f88f-497a-b83c-4bd2c296bfd7 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.622827 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3782b-8160-4a74-b44f-d8e41defe8cf admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.628337 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf47389-4482-492f-9449-c4c6b8cc61dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.629008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf47389-4482-492f-9449-c4c6b8cc61dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.629290 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf47389-4482-492f-9449-c4c6b8cc61dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.629614 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf47389-4482-492f-9449-c4c6b8cc61dd admin admin] PATH_INFO: `/v3/projects/f02f0c33edaa474fadd7a723c44603ec/users/82546b59d97c41ae8f708793b863b000/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.630357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c025e1-87fa-472a-87a2-b950a4319dac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.631507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c025e1-87fa-472a-87a2-b950a4319dac service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.631893 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c025e1-87fa-472a-87a2-b950a4319dac service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.632173 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c025e1-87fa-472a-87a2-b950a4319dac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.650394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf47389-4482-492f-9449-c4c6b8cc61dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02f0c33edaa474fadd7a723c44603ec, user_id=82546b59d97c41ae8f708793b863b000, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.654138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf47389-4482-492f-9449-c4c6b8cc61dd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.678391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 818/1629] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:18:57 2022] PUT /identity/v3/projects/f02f0c33edaa474fadd7a723c44603ec/users/82546b59d97c41ae8f708793b863b000/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:18:57.679995 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf47389-4482-492f-9449-c4c6b8cc61dd admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.682665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:57.737560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c025e1-87fa-472a-87a2-b950a4319dac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.739658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c025e1-87fa-472a-87a2-b950a4319dac service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.752234 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 812/1630] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:18:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:18:57.753469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c025e1-87fa-472a-87a2-b950a4319dac service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.768199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c025e1-87fa-472a-87a2-b950a4319dac service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.824278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf47389-4482-492f-9449-c4c6b8cc61dd admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.837152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda98b2a-ec43-43b5-828a-5291b4c4c7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.837816 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda98b2a-ec43-43b5-828a-5291b4c4c7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.839552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda98b2a-ec43-43b5-828a-5291b4c4c7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.839907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda98b2a-ec43-43b5-828a-5291b4c4c7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.840773 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda98b2a-ec43-43b5-828a-5291b4c4c7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.847122 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda98b2a-ec43-43b5-828a-5291b4c4c7c2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.857705 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ea675-e16e-4631-8054-712e0de3f1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.858419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ea675-e16e-4631-8054-712e0de3f1bb admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.858731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ea675-e16e-4631-8054-712e0de3f1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.859096 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ea675-e16e-4631-8054-712e0de3f1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.860598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ea675-e16e-4631-8054-712e0de3f1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.863477 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ea675-e16e-4631-8054-712e0de3f1bb admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.879463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 819/1631] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:57.879575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 813/1632] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:57.883365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda98b2a-ec43-43b5-828a-5291b4c4c7c2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.884361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ea675-e16e-4631-8054-712e0de3f1bb admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:57.898213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ea675-e16e-4631-8054-712e0de3f1bb admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.903243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda98b2a-ec43-43b5-828a-5291b4c4c7c2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:57.903477 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d9bed-6589-43f7-8af8-1c6c40fe1932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.904213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d9bed-6589-43f7-8af8-1c6c40fe1932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.904551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d9bed-6589-43f7-8af8-1c6c40fe1932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.904825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d9bed-6589-43f7-8af8-1c6c40fe1932 admin admin] PATH_INFO: `/v3/projects/f02f0c33edaa474fadd7a723c44603ec/users/82546b59d97c41ae8f708793b863b000/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.907186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d9bed-6589-43f7-8af8-1c6c40fe1932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02f0c33edaa474fadd7a723c44603ec, user_id=82546b59d97c41ae8f708793b863b000, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.908996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff09d5-0bb0-4e91-ab74-579b3b83ec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:57.909848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff09d5-0bb0-4e91-ab74-579b3b83ec8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.910136 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff09d5-0bb0-4e91-ab74-579b3b83ec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.910411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff09d5-0bb0-4e91-ab74-579b3b83ec8e admin admin] PATH_INFO: `/v3/projects/3a7267ca06fc4d9cb7517fb33782b022/users/d7c82a4c0627497b8f1c0af4a8ea164f/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.911265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d9bed-6589-43f7-8af8-1c6c40fe1932 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:57.930856 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 814/1633] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:18:57 2022] PUT /identity/v3/projects/f02f0c33edaa474fadd7a723c44603ec/users/82546b59d97c41ae8f708793b863b000/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:18:57.942563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5837f7-b9a8-4110-a42b-70ee246e1b42 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:57.943751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5837f7-b9a8-4110-a42b-70ee246e1b42 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:57.944580 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5837f7-b9a8-4110-a42b-70ee246e1b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:57.963767 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff09d5-0bb0-4e91-ab74-579b3b83ec8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7267ca06fc4d9cb7517fb33782b022, user_id=d7c82a4c0627497b8f1c0af4a8ea164f, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:57.966463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff09d5-0bb0-4e91-ab74-579b3b83ec8e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:58.019964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 820/1634] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:18:57 2022] PUT /identity/v3/projects/3a7267ca06fc4d9cb7517fb33782b022/users/d7c82a4c0627497b8f1c0af4a8ea164f/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:18:58.034083 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359b2b7-51ef-4582-97bb-a84a7e767566 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:58.034379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359b2b7-51ef-4582-97bb-a84a7e767566 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:58.036418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359b2b7-51ef-4582-97bb-a84a7e767566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:58.059089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ac5837f7-b9a8-4110-a42b-70ee246e1b42 None None] MFA Rules not processed for user `82546b59d97c41ae8f708793b863b000`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:58.060076 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ac5837f7-b9a8-4110-a42b-70ee246e1b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:58.111422 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1359b2b7-51ef-4582-97bb-a84a7e767566 None None] MFA Rules not processed for user `d7c82a4c0627497b8f1c0af4a8ea164f`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:58.113984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1359b2b7-51ef-4582-97bb-a84a7e767566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:58.201413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:58.233815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 815/1635] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:18:58.238783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5837f7-b9a8-4110-a42b-70ee246e1b42 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:58.293052 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 821/1636] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:18:58.294626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359b2b7-51ef-4582-97bb-a84a7e767566 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:58.309636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:58.351405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5837f7-b9a8-4110-a42b-70ee246e1b42 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:58.357537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37db69-4f8e-45db-8c3d-de8b432a35cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:58.358483 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37db69-4f8e-45db-8c3d-de8b432a35cb service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:58.358897 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37db69-4f8e-45db-8c3d-de8b432a35cb service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:58.359993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37db69-4f8e-45db-8c3d-de8b432a35cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:58.440744 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359b2b7-51ef-4582-97bb-a84a7e767566 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:58.451371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227514fc-5afe-4d6b-8311-bb182c125aee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:58.453209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227514fc-5afe-4d6b-8311-bb182c125aee service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:58.453582 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227514fc-5afe-4d6b-8311-bb182c125aee service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:58.454784 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227514fc-5afe-4d6b-8311-bb182c125aee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:58.478004 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227514fc-5afe-4d6b-8311-bb182c125aee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:58.481745 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227514fc-5afe-4d6b-8311-bb182c125aee service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:58.497943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37db69-4f8e-45db-8c3d-de8b432a35cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:58.499644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37db69-4f8e-45db-8c3d-de8b432a35cb service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:58.515779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 822/1637] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:18:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:18:58.518412 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227514fc-5afe-4d6b-8311-bb182c125aee service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:58.533608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 816/1638] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:18:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:18:58.623448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd8c5e-8b5e-4c21-b034-0e5455b75a58 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:58.623739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd8c5e-8b5e-4c21-b034-0e5455b75a58 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:58.624063 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd8c5e-8b5e-4c21-b034-0e5455b75a58 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:58.626053 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 817/1639] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 13 01:18:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 01:18:58.649965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d968cb-543b-4252-8365-dfe3258846bb None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:58.650192 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d968cb-543b-4252-8365-dfe3258846bb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:58.650480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d968cb-543b-4252-8365-dfe3258846bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:58.692852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a5d968cb-543b-4252-8365-dfe3258846bb None None] MFA Rules not processed for user `fadc83bec6be41979e1aa4d71f8fc2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:58.694501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a5d968cb-543b-4252-8365-dfe3258846bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:58.696881 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227514fc-5afe-4d6b-8311-bb182c125aee service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:58.713545 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77b855-d44a-4e99-9ac0-2bdb6904a06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:58.717849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77b855-d44a-4e99-9ac0-2bdb6904a06c admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:58.718910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77b855-d44a-4e99-9ac0-2bdb6904a06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:58.719428 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 818/1640] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 13 01:18:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 13 01:18:58.720279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77b855-d44a-4e99-9ac0-2bdb6904a06c admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:58.721167 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77b855-d44a-4e99-9ac0-2bdb6904a06c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:58.726565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77b855-d44a-4e99-9ac0-2bdb6904a06c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:58.827930 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 823/1641] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:18:58 2022] POST /identity/v3/projects => generated 385 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:58.832076 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d968cb-543b-4252-8365-dfe3258846bb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:58.840869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77b855-d44a-4e99-9ac0-2bdb6904a06c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:58.851439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d968cb-543b-4252-8365-dfe3258846bb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:58.981205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba03b1-966a-4820-8656-1481815dfcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:58.981837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba03b1-966a-4820-8656-1481815dfcd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:58.982126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba03b1-966a-4820-8656-1481815dfcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:58.982735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba03b1-966a-4820-8656-1481815dfcd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:58.983429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba03b1-966a-4820-8656-1481815dfcd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:58.987690 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba03b1-966a-4820-8656-1481815dfcd8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:59.000138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77b855-d44a-4e99-9ac0-2bdb6904a06c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:59.005196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b066-1c86-4cc9-b75a-830fb18ef425 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:59.006636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b066-1c86-4cc9-b75a-830fb18ef425 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:59.007132 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b066-1c86-4cc9-b75a-830fb18ef425 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:59.007720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b066-1c86-4cc9-b75a-830fb18ef425 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:59.036243 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 819/1642] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:18:58 2022] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:18:59.037164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba03b1-966a-4820-8656-1481815dfcd8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:59.041542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:59.059470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba03b1-966a-4820-8656-1481815dfcd8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:59.069639 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6216f-3134-4066-a66e-4d30b550162f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:59.070385 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6216f-3134-4066-a66e-4d30b550162f service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:59.070670 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6216f-3134-4066-a66e-4d30b550162f service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:59.071774 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6216f-3134-4066-a66e-4d30b550162f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:59.150518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456b066-1c86-4cc9-b75a-830fb18ef425 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:59.156236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:59.161602 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6216f-3134-4066-a66e-4d30b550162f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:59.164429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456b066-1c86-4cc9-b75a-830fb18ef425 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:59.165118 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6216f-3134-4066-a66e-4d30b550162f service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:59.181149 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 820/1643] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:18:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:18:59.182178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6216f-3134-4066-a66e-4d30b550162f service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:59.196034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6216f-3134-4066-a66e-4d30b550162f service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:59.201602 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eeb70a-8691-40dc-bd0e-aaf1f956d824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:59.202277 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eeb70a-8691-40dc-bd0e-aaf1f956d824 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:59.202566 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eeb70a-8691-40dc-bd0e-aaf1f956d824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:59.202850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eeb70a-8691-40dc-bd0e-aaf1f956d824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:59.203658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eeb70a-8691-40dc-bd0e-aaf1f956d824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:59.203948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 824/1644] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:18:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:18:59.205333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eeb70a-8691-40dc-bd0e-aaf1f956d824 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:59.218202 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 821/1645] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:59.222536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b066-1c86-4cc9-b75a-830fb18ef425 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:59.238047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b066-1c86-4cc9-b75a-830fb18ef425 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:59.250595 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b8bc7-4901-4c9b-b872-fc43e2cd827a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:59.251479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b8bc7-4901-4c9b-b872-fc43e2cd827a admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:59.252005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b8bc7-4901-4c9b-b872-fc43e2cd827a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:59.252950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b8bc7-4901-4c9b-b872-fc43e2cd827a admin admin] PATH_INFO: `/v3/projects/0241710067784787ae58a3efb4cfe815/users/34c4bdd8824c4734a7237315ac7571b9/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:59.301580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b8bc7-4901-4c9b-b872-fc43e2cd827a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0241710067784787ae58a3efb4cfe815, user_id=34c4bdd8824c4734a7237315ac7571b9, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:59.305352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b8bc7-4901-4c9b-b872-fc43e2cd827a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:59.332992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 825/1646] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:18:59 2022] PUT /identity/v3/projects/0241710067784787ae58a3efb4cfe815/users/34c4bdd8824c4734a7237315ac7571b9/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:18:59.337847 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eeb70a-8691-40dc-bd0e-aaf1f956d824 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:59.352239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eeb70a-8691-40dc-bd0e-aaf1f956d824 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:59.527755 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13488cd5-073a-4084-a303-5a3d924ab08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:59.530665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13488cd5-073a-4084-a303-5a3d924ab08d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:59.531224 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13488cd5-073a-4084-a303-5a3d924ab08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:59.531673 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13488cd5-073a-4084-a303-5a3d924ab08d admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:59.532546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13488cd5-073a-4084-a303-5a3d924ab08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:59.536309 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13488cd5-073a-4084-a303-5a3d924ab08d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:59.572167 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b8bc7-4901-4c9b-b872-fc43e2cd827a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:59.574255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 822/1647] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:18:59.589225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b8bc7-4901-4c9b-b872-fc43e2cd827a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:18:59.601315 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2347840-b877-43fc-b6ef-5fdf46ad19f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:18:59.602103 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2347840-b877-43fc-b6ef-5fdf46ad19f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:59.602525 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2347840-b877-43fc-b6ef-5fdf46ad19f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:59.602913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2347840-b877-43fc-b6ef-5fdf46ad19f0 admin admin] PATH_INFO: `/v3/projects/0241710067784787ae58a3efb4cfe815/users/34c4bdd8824c4734a7237315ac7571b9/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:59.616394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2347840-b877-43fc-b6ef-5fdf46ad19f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0241710067784787ae58a3efb4cfe815, user_id=34c4bdd8824c4734a7237315ac7571b9, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:18:59.619254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2347840-b877-43fc-b6ef-5fdf46ad19f0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:18:59.684671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74de93b-22ff-450b-8346-4a22df2a2817 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:18:59.685009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74de93b-22ff-450b-8346-4a22df2a2817 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:18:59.685296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74de93b-22ff-450b-8346-4a22df2a2817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:18:59.690362 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 826/1648] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:18:59 2022] PUT /identity/v3/projects/0241710067784787ae58a3efb4cfe815/users/34c4bdd8824c4734a7237315ac7571b9/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:18:59.778227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f74de93b-22ff-450b-8346-4a22df2a2817 None None] MFA Rules not processed for user `34c4bdd8824c4734a7237315ac7571b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:18:59.778432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f74de93b-22ff-450b-8346-4a22df2a2817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:18:59.984608 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2347840-b877-43fc-b6ef-5fdf46ad19f0 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:18:59.990216 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 823/1649] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:18:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:00.001931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74de93b-22ff-450b-8346-4a22df2a2817 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:00.121872 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74de93b-22ff-450b-8346-4a22df2a2817 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:00.125660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fa56c-821f-4125-931e-610f490b52e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:00.126286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fa56c-821f-4125-931e-610f490b52e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:00.126568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fa56c-821f-4125-931e-610f490b52e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:00.126849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fa56c-821f-4125-931e-610f490b52e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:00.159130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fa56c-821f-4125-931e-610f490b52e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:00.160863 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fa56c-821f-4125-931e-610f490b52e5 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:00.167791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2347840-b877-43fc-b6ef-5fdf46ad19f0 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:00.177549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 824/1650] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:19:00.189225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882c9ec-6a0c-45fc-aca3-5d9f16fbcc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:00.191177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882c9ec-6a0c-45fc-aca3-5d9f16fbcc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:00.192597 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882c9ec-6a0c-45fc-aca3-5d9f16fbcc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:00.193144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882c9ec-6a0c-45fc-aca3-5d9f16fbcc86 admin admin] PATH_INFO: `/v3/users/0045078bffae45078b815d78e67599ec` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:00.196948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882c9ec-6a0c-45fc-aca3-5d9f16fbcc86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0045078bffae45078b815d78e67599ec)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:00.199155 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882c9ec-6a0c-45fc-aca3-5d9f16fbcc86 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:00.296360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c882c9ec-6a0c-45fc-aca3-5d9f16fbcc86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0045078bffae45078b815d78e67599ec'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:00.298875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c882c9ec-6a0c-45fc-aca3-5d9f16fbcc86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0045078bffae45078b815d78e67599ec'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:00.317931 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c882c9ec-6a0c-45fc-aca3-5d9f16fbcc86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0045078bffae45078b815d78e67599ec'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:00.394318 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:00.394318 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c882c9ec-6a0c-45fc-aca3-5d9f16fbcc86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0045078bffae45078b815d78e67599ec'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:00.394318 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c882c9ec-6a0c-45fc-aca3-5d9f16fbcc86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0045078bffae45078b815d78e67599ec'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:00.408208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 827/1651] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:18:59 2022] DELETE /identity/v3/users/0045078bffae45078b815d78e67599ec => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:00.414190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e803d3-1bda-4b0f-81bc-18667edd44c9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:00.414305 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e803d3-1bda-4b0f-81bc-18667edd44c9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:00.415363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e803d3-1bda-4b0f-81bc-18667edd44c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:00.453239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:00.464621 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-43e803d3-1bda-4b0f-81bc-18667edd44c9 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:00.466593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-43e803d3-1bda-4b0f-81bc-18667edd44c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:00.634939 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 825/1652] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:00.659848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882c9ec-6a0c-45fc-aca3-5d9f16fbcc86 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:00.663800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c882c9ec-6a0c-45fc-aca3-5d9f16fbcc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:00.847899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882c9ec-6a0c-45fc-aca3-5d9f16fbcc86 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:00.856529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a4e9e-c216-4f25-bc17-a656367e5ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:00.857261 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a4e9e-c216-4f25-bc17-a656367e5ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:00.858036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a4e9e-c216-4f25-bc17-a656367e5ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:00.858332 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a4e9e-c216-4f25-bc17-a656367e5ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:00.902636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a4e9e-c216-4f25-bc17-a656367e5ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:00.905794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a4e9e-c216-4f25-bc17-a656367e5ac1 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:00.925646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 828/1653] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:01.929179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e803d3-1bda-4b0f-81bc-18667edd44c9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:01.930537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-43e803d3-1bda-4b0f-81bc-18667edd44c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:01.964010 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e803d3-1bda-4b0f-81bc-18667edd44c9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:01.982315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0d958-3c32-4eba-9369-b46ad89d084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:01.984504 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0d958-3c32-4eba-9369-b46ad89d084c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:01.984795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0d958-3c32-4eba-9369-b46ad89d084c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:01.985126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0d958-3c32-4eba-9369-b46ad89d084c admin admin] PATH_INFO: `/v3/users/70bd3281a28d4bc9929f1ddf7415b11b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:01.986455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0d958-3c32-4eba-9369-b46ad89d084c admin admin] RBAC: Authorizing `identity:delete_user(user_id=70bd3281a28d4bc9929f1ddf7415b11b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:01.987843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-b1c0d958-3c32-4eba-9369-b46ad89d084c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 01:19:01.987843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Sep 13 01:19:01.987843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: Sep 13 01:19:01.989069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0d958-3c32-4eba-9369-b46ad89d084c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:02.070902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a4e9e-c216-4f25-bc17-a656367e5ac1 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:02.072432 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fc7a4e9e-c216-4f25-bc17-a656367e5ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:02.190029 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a4e9e-c216-4f25-bc17-a656367e5ac1 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:02.206057 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ac74d-d94e-4d04-8b50-619cbc984597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:02.206250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ac74d-d94e-4d04-8b50-619cbc984597 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:02.208091 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ac74d-d94e-4d04-8b50-619cbc984597 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:02.208891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ac74d-d94e-4d04-8b50-619cbc984597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:02.211630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-520ac74d-d94e-4d04-8b50-619cbc984597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:02.258548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b1c0d958-3c32-4eba-9369-b46ad89d084c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70bd3281a28d4bc9929f1ddf7415b11b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:02.259827 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b1c0d958-3c32-4eba-9369-b46ad89d084c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70bd3281a28d4bc9929f1ddf7415b11b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:02.279167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b1c0d958-3c32-4eba-9369-b46ad89d084c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70bd3281a28d4bc9929f1ddf7415b11b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:02.335674 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b1c0d958-3c32-4eba-9369-b46ad89d084c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70bd3281a28d4bc9929f1ddf7415b11b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:02.339303 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b1c0d958-3c32-4eba-9369-b46ad89d084c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70bd3281a28d4bc9929f1ddf7415b11b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:02.374464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 826/1654] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:01 2022] DELETE /identity/v3/users/70bd3281a28d4bc9929f1ddf7415b11b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:02.376459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ff5b4-5b42-4284-864a-d95a35d9e773 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:02.376827 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ff5b4-5b42-4284-864a-d95a35d9e773 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:02.377172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ff5b4-5b42-4284-864a-d95a35d9e773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:02.400157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-678ff5b4-5b42-4284-864a-d95a35d9e773 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:02.402029 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-678ff5b4-5b42-4284-864a-d95a35d9e773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:02.408894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ac74d-d94e-4d04-8b50-619cbc984597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:02.410460 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ac74d-d94e-4d04-8b50-619cbc984597 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:02.457286 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 829/1655] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:19:02.595446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 827/1656] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:02.621044 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ac74d-d94e-4d04-8b50-619cbc984597 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:02.622441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-520ac74d-d94e-4d04-8b50-619cbc984597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:02.650354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ac74d-d94e-4d04-8b50-619cbc984597 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:02.810777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:02.842155 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e90f0-f2e1-4245-b87a-2ecd35322489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:02.843403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e90f0-f2e1-4245-b87a-2ecd35322489 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:02.845286 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e90f0-f2e1-4245-b87a-2ecd35322489 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:02.851093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e90f0-f2e1-4245-b87a-2ecd35322489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:02.878256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e90f0-f2e1-4245-b87a-2ecd35322489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:02.879787 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e90f0-f2e1-4245-b87a-2ecd35322489 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:02.904315 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 830/1657] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:03.871015 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ff5b4-5b42-4284-864a-d95a35d9e773 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:03.873136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-678ff5b4-5b42-4284-864a-d95a35d9e773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:03.890945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ff5b4-5b42-4284-864a-d95a35d9e773 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:03.898722 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:03.899679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:03.900129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:03.900566 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6 admin admin] PATH_INFO: `/v3/projects/66797ec16d1a43dea20097378ed1f11d` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:03.901954 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66797ec16d1a43dea20097378ed1f11d)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:03.904293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:03.929535 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:03.991315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66797ec16d1a43dea20097378ed1f11d', 'request_id': 'req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:04.005565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66797ec16d1a43dea20097378ed1f11d', 'request_id': 'req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:04.029227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66797ec16d1a43dea20097378ed1f11d', 'request_id': 'req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:04.048105 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6 admin admin] The token cache is being invalidate because project 66797ec16d1a43dea20097378ed1f11d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:04.052074 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:04.054458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:04.060734 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 828/1658] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:03 2022] DELETE /identity/v3/projects/66797ec16d1a43dea20097378ed1f11d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:04.062431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454ce10-b4a4-4db6-a178-90eff56a34db None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:04.063486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454ce10-b4a4-4db6-a178-90eff56a34db None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:04.063983 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454ce10-b4a4-4db6-a178-90eff56a34db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:04.107098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7454ce10-b4a4-4db6-a178-90eff56a34db None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:04.110950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7454ce10-b4a4-4db6-a178-90eff56a34db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:04.117604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:04.119668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:04.298903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d90bc2-2c0f-4102-b25c-7ca90846fdd6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:04.307960 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea7eda-151e-4815-b81a-6bb782fab2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:04.309009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea7eda-151e-4815-b81a-6bb782fab2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:04.309439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea7eda-151e-4815-b81a-6bb782fab2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:04.309846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea7eda-151e-4815-b81a-6bb782fab2b4 admin admin] PATH_INFO: `/v3/projects/4a563b327667409da32f6c952e94ccdb` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:04.311991 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea7eda-151e-4815-b81a-6bb782fab2b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a563b327667409da32f6c952e94ccdb)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:04.315550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea7eda-151e-4815-b81a-6bb782fab2b4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:04.374790 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 831/1659] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:19:04.381485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66a449-88e3-4fd2-8df8-2d7de9b15a0b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:04.381930 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66a449-88e3-4fd2-8df8-2d7de9b15a0b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:04.383418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66a449-88e3-4fd2-8df8-2d7de9b15a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:04.401818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-baea7eda-151e-4815-b81a-6bb782fab2b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a563b327667409da32f6c952e94ccdb', 'request_id': 'req-baea7eda-151e-4815-b81a-6bb782fab2b4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:04.418248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-baea7eda-151e-4815-b81a-6bb782fab2b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a563b327667409da32f6c952e94ccdb', 'request_id': 'req-baea7eda-151e-4815-b81a-6bb782fab2b4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:04.452784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-baea7eda-151e-4815-b81a-6bb782fab2b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a563b327667409da32f6c952e94ccdb', 'request_id': 'req-baea7eda-151e-4815-b81a-6bb782fab2b4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:04.473535 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1e66a449-88e3-4fd2-8df8-2d7de9b15a0b None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:04.478718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1e66a449-88e3-4fd2-8df8-2d7de9b15a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:04.480857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-baea7eda-151e-4815-b81a-6bb782fab2b4 admin admin] The token cache is being invalidate because project 4a563b327667409da32f6c952e94ccdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:04.483210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-baea7eda-151e-4815-b81a-6bb782fab2b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:04.485855 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-baea7eda-151e-4815-b81a-6bb782fab2b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:04.491173 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 829/1660] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:04 2022] DELETE /identity/v3/projects/4a563b327667409da32f6c952e94ccdb => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:04.494525 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e435919-5624-4b4d-945e-a340b974b4ef None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:04.495741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e435919-5624-4b4d-945e-a340b974b4ef None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:04.496344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e435919-5624-4b4d-945e-a340b974b4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:04.555647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4e435919-5624-4b4d-945e-a340b974b4ef None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:04.560218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4e435919-5624-4b4d-945e-a340b974b4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:04.684562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:04.699127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 832/1661] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:04.699127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66a449-88e3-4fd2-8df8-2d7de9b15a0b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:04.715529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66a449-88e3-4fd2-8df8-2d7de9b15a0b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:04.727735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3264fa0-f261-464d-b384-dd6539ffac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:04.728434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3264fa0-f261-464d-b384-dd6539ffac72 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:04.728820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3264fa0-f261-464d-b384-dd6539ffac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:04.729937 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3264fa0-f261-464d-b384-dd6539ffac72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:04.730718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3264fa0-f261-464d-b384-dd6539ffac72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:04.732592 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3264fa0-f261-464d-b384-dd6539ffac72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:04.734408 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3264fa0-f261-464d-b384-dd6539ffac72 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:04.757418 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 830/1662] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:04.760994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 833/1663] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:04.762936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa662a7-f079-4ee1-81ba-55faf72c77d0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:04.763369 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa662a7-f079-4ee1-81ba-55faf72c77d0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:04.763988 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa662a7-f079-4ee1-81ba-55faf72c77d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:04.767915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3264fa0-f261-464d-b384-dd6539ffac72 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:04.789217 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3264fa0-f261-464d-b384-dd6539ffac72 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:04.798099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1fa662a7-f079-4ee1-81ba-55faf72c77d0 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:04.802024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1fa662a7-f079-4ee1-81ba-55faf72c77d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:04.803687 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4383e8d-bbf8-43a4-939f-25cf035a6d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:04.804195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4383e8d-bbf8-43a4-939f-25cf035a6d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:04.804570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4383e8d-bbf8-43a4-939f-25cf035a6d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:04.804945 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4383e8d-bbf8-43a4-939f-25cf035a6d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:04.805709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4383e8d-bbf8-43a4-939f-25cf035a6d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:04.808759 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4383e8d-bbf8-43a4-939f-25cf035a6d0d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:04.838225 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 831/1664] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:04.840110 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa662a7-f079-4ee1-81ba-55faf72c77d0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:04.885497 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa662a7-f079-4ee1-81ba-55faf72c77d0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:04.910884 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea882da7-418c-4934-991a-fb1c82445a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:04.913639 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882da7-418c-4934-991a-fb1c82445a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:04.916320 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882da7-418c-4934-991a-fb1c82445a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:04.917074 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882da7-418c-4934-991a-fb1c82445a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:04.918472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea882da7-418c-4934-991a-fb1c82445a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:04.920861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea882da7-418c-4934-991a-fb1c82445a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:04.926530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea882da7-418c-4934-991a-fb1c82445a28 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:04.927002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 834/1665] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:04 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:04.929549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4383e8d-bbf8-43a4-939f-25cf035a6d0d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:04.985817 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 832/1666] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:04.992552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea882da7-418c-4934-991a-fb1c82445a28 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:05.026968 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea882da7-418c-4934-991a-fb1c82445a28 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:05.166287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:05.184077 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4383e8d-bbf8-43a4-939f-25cf035a6d0d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:05.193559 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f465727-c50d-423c-852c-6098c8ca9d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:05.194201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f465727-c50d-423c-852c-6098c8ca9d59 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:05.194480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f465727-c50d-423c-852c-6098c8ca9d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:05.194760 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f465727-c50d-423c-852c-6098c8ca9d59 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:05.195444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f465727-c50d-423c-852c-6098c8ca9d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:05.199785 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f465727-c50d-423c-852c-6098c8ca9d59 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:05.213579 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfc15f-9635-4ad1-bb0a-07e3dacbcc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:05.214797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfc15f-9635-4ad1-bb0a-07e3dacbcc8f admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:05.215227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfc15f-9635-4ad1-bb0a-07e3dacbcc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:05.215511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfc15f-9635-4ad1-bb0a-07e3dacbcc8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:05.216964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfc15f-9635-4ad1-bb0a-07e3dacbcc8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:05.230695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfc15f-9635-4ad1-bb0a-07e3dacbcc8f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:05.295939 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 835/1667] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:04 2022] POST /identity/v3/users => generated 287 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:05.297770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f465727-c50d-423c-852c-6098c8ca9d59 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:05.330330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f465727-c50d-423c-852c-6098c8ca9d59 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:05.342731 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e623ae-49ac-4aa0-b382-1aa1719d5e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:05.343776 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e623ae-49ac-4aa0-b382-1aa1719d5e8c admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:05.344126 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e623ae-49ac-4aa0-b382-1aa1719d5e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:05.344388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e623ae-49ac-4aa0-b382-1aa1719d5e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:05.345056 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e623ae-49ac-4aa0-b382-1aa1719d5e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:05.349752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e623ae-49ac-4aa0-b382-1aa1719d5e8c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:05.353121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 833/1668] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:04 2022] POST /identity/v3/projects => generated 371 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:19:05.358450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfc15f-9635-4ad1-bb0a-07e3dacbcc8f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:05.381825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 836/1669] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:05.386017 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e623ae-49ac-4aa0-b382-1aa1719d5e8c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:05.428823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e623ae-49ac-4aa0-b382-1aa1719d5e8c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:05.560184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22779f33-3b0f-4fc9-a10f-ce648a914b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:05.561448 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22779f33-3b0f-4fc9-a10f-ce648a914b89 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:05.561636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22779f33-3b0f-4fc9-a10f-ce648a914b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:05.564693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22779f33-3b0f-4fc9-a10f-ce648a914b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:05.569613 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22779f33-3b0f-4fc9-a10f-ce648a914b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:05.571452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22779f33-3b0f-4fc9-a10f-ce648a914b89 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:05.596913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 837/1670] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:05.601368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22779f33-3b0f-4fc9-a10f-ce648a914b89 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:05.613752 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfc15f-9635-4ad1-bb0a-07e3dacbcc8f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:05.624743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22779f33-3b0f-4fc9-a10f-ce648a914b89 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:05.629078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709acb2d-6a95-401e-9da8-acdb706f4f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:05.629716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709acb2d-6a95-401e-9da8-acdb706f4f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:05.629983 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709acb2d-6a95-401e-9da8-acdb706f4f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:05.630254 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709acb2d-6a95-401e-9da8-acdb706f4f1c admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:05.632018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709acb2d-6a95-401e-9da8-acdb706f4f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:05.636457 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7778d5f-dbda-4fb2-a0e1-056c88cafa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:05.637148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7778d5f-dbda-4fb2-a0e1-056c88cafa83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:05.637434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7778d5f-dbda-4fb2-a0e1-056c88cafa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:05.637712 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7778d5f-dbda-4fb2-a0e1-056c88cafa83 admin admin] PATH_INFO: `/v3/projects/85916123cd2842e1bfdf45c73decf22b/users/991af6c712e24a53adbe6acd6e298c5c/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:05.639430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709acb2d-6a95-401e-9da8-acdb706f4f1c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:05.670690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7778d5f-dbda-4fb2-a0e1-056c88cafa83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85916123cd2842e1bfdf45c73decf22b, user_id=991af6c712e24a53adbe6acd6e298c5c, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:05.679596 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7778d5f-dbda-4fb2-a0e1-056c88cafa83 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:05.691800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 834/1671] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:05 2022] POST /identity/v3/users => generated 286 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:05.696148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709acb2d-6a95-401e-9da8-acdb706f4f1c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:05.715791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 838/1672] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:05 2022] PUT /identity/v3/projects/85916123cd2842e1bfdf45c73decf22b/users/991af6c712e24a53adbe6acd6e298c5c/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:05.728414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed2563-88e9-4364-a595-63dee09b1578 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:05.728704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed2563-88e9-4364-a595-63dee09b1578 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:05.728987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed2563-88e9-4364-a595-63dee09b1578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:05.735830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709acb2d-6a95-401e-9da8-acdb706f4f1c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:05.790721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-11ed2563-88e9-4364-a595-63dee09b1578 None None] MFA Rules not processed for user `991af6c712e24a53adbe6acd6e298c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:05.792425 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-11ed2563-88e9-4364-a595-63dee09b1578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:05.813102 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:05.918500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851485f-69aa-4ef7-9829-a2930bddc7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:05.919931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851485f-69aa-4ef7-9829-a2930bddc7bf admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:05.920737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851485f-69aa-4ef7-9829-a2930bddc7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:05.923634 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851485f-69aa-4ef7-9829-a2930bddc7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:05.926467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851485f-69aa-4ef7-9829-a2930bddc7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:05.934059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851485f-69aa-4ef7-9829-a2930bddc7bf admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:05.954033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 839/1673] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:19:05.955182 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed2563-88e9-4364-a595-63dee09b1578 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:05.969999 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 835/1674] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:05.973329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed2563-88e9-4364-a595-63dee09b1578 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:05.974928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851485f-69aa-4ef7-9829-a2930bddc7bf admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:05.984268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705f2f8-47cc-4b28-89e9-c8a1dd08ff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:05.984907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705f2f8-47cc-4b28-89e9-c8a1dd08ff6b admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:05.985188 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705f2f8-47cc-4b28-89e9-c8a1dd08ff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:05.985467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705f2f8-47cc-4b28-89e9-c8a1dd08ff6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:05.986110 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705f2f8-47cc-4b28-89e9-c8a1dd08ff6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:05.989636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705f2f8-47cc-4b28-89e9-c8a1dd08ff6b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:06.001228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851485f-69aa-4ef7-9829-a2930bddc7bf admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:06.013364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f5899-a895-4e86-9e9a-2fff785a18a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:06.014947 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5899-a895-4e86-9e9a-2fff785a18a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:06.015658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5899-a895-4e86-9e9a-2fff785a18a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:06.017256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5899-a895-4e86-9e9a-2fff785a18a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:06.019152 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f5899-a895-4e86-9e9a-2fff785a18a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:06.021085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f5899-a895-4e86-9e9a-2fff785a18a6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:06.051251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 840/1675] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:05 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:19:06.052454 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705f2f8-47cc-4b28-89e9-c8a1dd08ff6b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:06.060379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 836/1676] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:06.064531 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f5899-a895-4e86-9e9a-2fff785a18a6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:06.086475 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:06.091205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f5899-a895-4e86-9e9a-2fff785a18a6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:06.212638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705f2f8-47cc-4b28-89e9-c8a1dd08ff6b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:06.219718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6572b0-9309-4179-9d9a-56ec8f6679c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:06.220367 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6572b0-9309-4179-9d9a-56ec8f6679c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:06.220645 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6572b0-9309-4179-9d9a-56ec8f6679c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:06.220917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6572b0-9309-4179-9d9a-56ec8f6679c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:06.225837 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6572b0-9309-4179-9d9a-56ec8f6679c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:06.232820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6572b0-9309-4179-9d9a-56ec8f6679c5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:06.250293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3f002-16c5-4a69-9a66-5e12dde0db2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:06.251427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3f002-16c5-4a69-9a66-5e12dde0db2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:06.251860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3f002-16c5-4a69-9a66-5e12dde0db2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:06.252298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3f002-16c5-4a69-9a66-5e12dde0db2b admin admin] PATH_INFO: `/v3/projects/03f3a05cfe5f47c8af6ef5e92faa6a04/users/6e9b1c26da694694b47c9e3f9c37d788/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:06.278239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3f002-16c5-4a69-9a66-5e12dde0db2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f3a05cfe5f47c8af6ef5e92faa6a04, user_id=6e9b1c26da694694b47c9e3f9c37d788, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:06.281129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3f002-16c5-4a69-9a66-5e12dde0db2b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:06.282808 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 841/1677] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:06 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:06.287553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6572b0-9309-4179-9d9a-56ec8f6679c5 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:06.314438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6572b0-9309-4179-9d9a-56ec8f6679c5 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:06.326317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 837/1678] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:06 2022] PUT /identity/v3/projects/03f3a05cfe5f47c8af6ef5e92faa6a04/users/6e9b1c26da694694b47c9e3f9c37d788/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:06.345882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da46ca-1e5e-46d0-addc-c3e658a79cf9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:06.346767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da46ca-1e5e-46d0-addc-c3e658a79cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:06.347582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da46ca-1e5e-46d0-addc-c3e658a79cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:06.481217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-46da46ca-1e5e-46d0-addc-c3e658a79cf9 None None] MFA Rules not processed for user `6e9b1c26da694694b47c9e3f9c37d788`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:06.484758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7a54e-bd9a-485d-911f-c3d9c4862026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:06.485401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7a54e-bd9a-485d-911f-c3d9c4862026 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:06.485687 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7a54e-bd9a-485d-911f-c3d9c4862026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:06.485965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7a54e-bd9a-485d-911f-c3d9c4862026 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:06.488724 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-46da46ca-1e5e-46d0-addc-c3e658a79cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:06.489209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7a54e-bd9a-485d-911f-c3d9c4862026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:06.491957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7a54e-bd9a-485d-911f-c3d9c4862026 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:06.531203 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 842/1679] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:06.533954 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7a54e-bd9a-485d-911f-c3d9c4862026 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:06.565290 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7a54e-bd9a-485d-911f-c3d9c4862026 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:06.578121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c5fc1-3cf4-4d6d-a263-23adc7f3044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:06.578879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c5fc1-3cf4-4d6d-a263-23adc7f3044b admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:06.579284 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c5fc1-3cf4-4d6d-a263-23adc7f3044b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:06.579500 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c5fc1-3cf4-4d6d-a263-23adc7f3044b admin admin] PATH_INFO: `/v3/projects/5bf6a67cf9c0422e82056021610578fe/users/434bd386c732462f8c3b8212fe8d74ee/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:06.628750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c5fc1-3cf4-4d6d-a263-23adc7f3044b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf6a67cf9c0422e82056021610578fe, user_id=434bd386c732462f8c3b8212fe8d74ee, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:06.631641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c5fc1-3cf4-4d6d-a263-23adc7f3044b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:06.657188 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 843/1680] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:06 2022] PUT /identity/v3/projects/5bf6a67cf9c0422e82056021610578fe/users/434bd386c732462f8c3b8212fe8d74ee/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:06.657188 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c5fc1-3cf4-4d6d-a263-23adc7f3044b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:06.766596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 838/1681] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:06.771172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da46ca-1e5e-46d0-addc-c3e658a79cf9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:06.772869 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-46da46ca-1e5e-46d0-addc-c3e658a79cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:06.809156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da46ca-1e5e-46d0-addc-c3e658a79cf9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:06.811924 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c5fc1-3cf4-4d6d-a263-23adc7f3044b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:06.819335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3bc64-6bf8-4d9c-9f8e-55ec2470ca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:06.821914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3bc64-6bf8-4d9c-9f8e-55ec2470ca06 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:06.822294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3bc64-6bf8-4d9c-9f8e-55ec2470ca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:06.823092 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3bc64-6bf8-4d9c-9f8e-55ec2470ca06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:06.823833 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3bc64-6bf8-4d9c-9f8e-55ec2470ca06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:06.825979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3bc64-6bf8-4d9c-9f8e-55ec2470ca06 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:06.830871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bd265-52be-4968-8ce7-f7afd67732ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:06.831574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bd265-52be-4968-8ce7-f7afd67732ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:06.831864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bd265-52be-4968-8ce7-f7afd67732ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:06.841101 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bd265-52be-4968-8ce7-f7afd67732ed admin admin] PATH_INFO: `/v3/users/29bab436248f42fcab44454cd6c78d70` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:06.843757 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bd265-52be-4968-8ce7-f7afd67732ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=29bab436248f42fcab44454cd6c78d70)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:06.844840 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 844/1682] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:06.846600 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3bc64-6bf8-4d9c-9f8e-55ec2470ca06 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:06.852855 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bd265-52be-4968-8ce7-f7afd67732ed admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:06.866512 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3bc64-6bf8-4d9c-9f8e-55ec2470ca06 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:06.878292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daedcc-885b-4848-a5ec-2e3c8e84863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:06.878932 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daedcc-885b-4848-a5ec-2e3c8e84863c admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:06.879243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daedcc-885b-4848-a5ec-2e3c8e84863c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:06.879659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daedcc-885b-4848-a5ec-2e3c8e84863c admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:06.880312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daedcc-885b-4848-a5ec-2e3c8e84863c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:06.884496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daedcc-885b-4848-a5ec-2e3c8e84863c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:06.899318 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:06.914917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:06.947271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 845/1683] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:06 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:06.948236 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daedcc-885b-4848-a5ec-2e3c8e84863c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:06.961678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5a6bd265-52be-4968-8ce7-f7afd67732ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29bab436248f42fcab44454cd6c78d70'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:06.962391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5a6bd265-52be-4968-8ce7-f7afd67732ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29bab436248f42fcab44454cd6c78d70'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:06.977763 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5a6bd265-52be-4968-8ce7-f7afd67732ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29bab436248f42fcab44454cd6c78d70'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:07.003360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5a6bd265-52be-4968-8ce7-f7afd67732ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29bab436248f42fcab44454cd6c78d70'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:07.005161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5a6bd265-52be-4968-8ce7-f7afd67732ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29bab436248f42fcab44454cd6c78d70'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:07.029892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 839/1684] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:06 2022] DELETE /identity/v3/users/29bab436248f42fcab44454cd6c78d70 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:07.030635 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bd265-52be-4968-8ce7-f7afd67732ed admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:07.034529 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5a6bd265-52be-4968-8ce7-f7afd67732ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:07.071947 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daedcc-885b-4848-a5ec-2e3c8e84863c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:07.186041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bd265-52be-4968-8ce7-f7afd67732ed admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:07.199362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b71f36-e6dc-46ab-bf14-83fb0e84e4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:07.199999 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b71f36-e6dc-46ab-bf14-83fb0e84e4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:07.200280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b71f36-e6dc-46ab-bf14-83fb0e84e4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:07.200555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b71f36-e6dc-46ab-bf14-83fb0e84e4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:07.201208 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b71f36-e6dc-46ab-bf14-83fb0e84e4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:07.205721 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b71f36-e6dc-46ab-bf14-83fb0e84e4b5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:07.206835 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3becb7f-cc0d-444e-a924-4df32f716a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:07.207615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3becb7f-cc0d-444e-a924-4df32f716a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:07.207897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3becb7f-cc0d-444e-a924-4df32f716a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:07.208484 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3becb7f-cc0d-444e-a924-4df32f716a37 admin admin] PATH_INFO: `/v3/projects/5bf6a67cf9c0422e82056021610578fe/users/434bd386c732462f8c3b8212fe8d74ee/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:07.214388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3becb7f-cc0d-444e-a924-4df32f716a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf6a67cf9c0422e82056021610578fe, user_id=434bd386c732462f8c3b8212fe8d74ee, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:07.219696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3becb7f-cc0d-444e-a924-4df32f716a37 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:07.245735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 846/1685] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:06 2022] PUT /identity/v3/projects/5bf6a67cf9c0422e82056021610578fe/users/434bd386c732462f8c3b8212fe8d74ee/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:07.247410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599f32b-74f8-4194-969e-61e126f6adfd None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:07.248041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599f32b-74f8-4194-969e-61e126f6adfd None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:07.248041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599f32b-74f8-4194-969e-61e126f6adfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:07.269442 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 840/1686] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:07 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:07.280796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a83553-f2e6-4a35-b585-90dadec25241 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:07.281164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a83553-f2e6-4a35-b585-90dadec25241 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:07.281583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a83553-f2e6-4a35-b585-90dadec25241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:07.326638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1599f32b-74f8-4194-969e-61e126f6adfd None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:07.331928 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1599f32b-74f8-4194-969e-61e126f6adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:07.341913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-95a83553-f2e6-4a35-b585-90dadec25241 None None] MFA Rules not processed for user `434bd386c732462f8c3b8212fe8d74ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:07.343386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-95a83553-f2e6-4a35-b585-90dadec25241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:07.581369 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 841/1687] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:07.582055 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a83553-f2e6-4a35-b585-90dadec25241 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:07.594077 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 847/1688] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:07.595484 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599f32b-74f8-4194-969e-61e126f6adfd None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:07.600438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1599f32b-74f8-4194-969e-61e126f6adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:07.616031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a83553-f2e6-4a35-b585-90dadec25241 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:07.638030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f030ec-0068-4107-87f2-bab8d142297a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:07.638209 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f030ec-0068-4107-87f2-bab8d142297a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:07.638481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f030ec-0068-4107-87f2-bab8d142297a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:07.638754 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f030ec-0068-4107-87f2-bab8d142297a admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:07.639571 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f030ec-0068-4107-87f2-bab8d142297a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:07.642559 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f030ec-0068-4107-87f2-bab8d142297a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:07.690546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 842/1689] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:07.691454 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f030ec-0068-4107-87f2-bab8d142297a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:07.696944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-12f030ec-0068-4107-87f2-bab8d142297a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:07.707036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:07.714650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:07.781107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599f32b-74f8-4194-969e-61e126f6adfd None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:07.794044 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055461e-b4ea-43fb-a1ce-80f089bb780d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:07.794801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055461e-b4ea-43fb-a1ce-80f089bb780d service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:07.795283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055461e-b4ea-43fb-a1ce-80f089bb780d service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:07.795688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055461e-b4ea-43fb-a1ce-80f089bb780d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:07.816445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055461e-b4ea-43fb-a1ce-80f089bb780d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:07.827020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055461e-b4ea-43fb-a1ce-80f089bb780d service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:07.858714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 848/1690] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:07.865385 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055461e-b4ea-43fb-a1ce-80f089bb780d service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:07.892315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f030ec-0068-4107-87f2-bab8d142297a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:07.895694 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055461e-b4ea-43fb-a1ce-80f089bb780d service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:07.899798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bc8b7-cb6d-4f90-b79f-150d6ed507ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:07.900629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bc8b7-cb6d-4f90-b79f-150d6ed507ee service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:07.901079 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bc8b7-cb6d-4f90-b79f-150d6ed507ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:07.901494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bc8b7-cb6d-4f90-b79f-150d6ed507ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:07.920077 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece64c9-82b6-4697-815b-feba356d1704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:07.921643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece64c9-82b6-4697-815b-feba356d1704 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:07.922044 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece64c9-82b6-4697-815b-feba356d1704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:07.922438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece64c9-82b6-4697-815b-feba356d1704 admin admin] PATH_INFO: `/v3/projects/697412c23ecb4b93a02cbbcc72e37fc8/users/12ea50a6bc9640108c95e7215462c9d8/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:07.930652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2bc8b7-cb6d-4f90-b79f-150d6ed507ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:07.932315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2bc8b7-cb6d-4f90-b79f-150d6ed507ee service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:07.966467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece64c9-82b6-4697-815b-feba356d1704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697412c23ecb4b93a02cbbcc72e37fc8, user_id=12ea50a6bc9640108c95e7215462c9d8, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:07.969700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece64c9-82b6-4697-815b-feba356d1704 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:07.986275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 843/1691] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:08.006704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 849/1692] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:07 2022] PUT /identity/v3/projects/697412c23ecb4b93a02cbbcc72e37fc8/users/12ea50a6bc9640108c95e7215462c9d8/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:08.010714 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bc8b7-cb6d-4f90-b79f-150d6ed507ee service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:08.029982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bc8b7-cb6d-4f90-b79f-150d6ed507ee service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:08.183152 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba6b81-7e5e-4812-8101-2d6a53a893fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:08.184050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba6b81-7e5e-4812-8101-2d6a53a893fd admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:08.184537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba6b81-7e5e-4812-8101-2d6a53a893fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:08.185018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba6b81-7e5e-4812-8101-2d6a53a893fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:08.185993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba6b81-7e5e-4812-8101-2d6a53a893fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:08.189250 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba6b81-7e5e-4812-8101-2d6a53a893fd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:08.223450 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece64c9-82b6-4697-815b-feba356d1704 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:08.225158 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 844/1693] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:08.248811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece64c9-82b6-4697-815b-feba356d1704 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:08.259249 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d0f1d-4527-47b5-a9ca-613b696201a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:08.260164 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d0f1d-4527-47b5-a9ca-613b696201a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:08.260567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d0f1d-4527-47b5-a9ca-613b696201a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:08.260953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d0f1d-4527-47b5-a9ca-613b696201a3 admin admin] PATH_INFO: `/v3/projects/697412c23ecb4b93a02cbbcc72e37fc8/users/12ea50a6bc9640108c95e7215462c9d8/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:08.266297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d0f1d-4527-47b5-a9ca-613b696201a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697412c23ecb4b93a02cbbcc72e37fc8, user_id=12ea50a6bc9640108c95e7215462c9d8, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:08.275272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d0f1d-4527-47b5-a9ca-613b696201a3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:08.312787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a31a6-d190-4a99-a31a-ee334613bd9f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:08.313279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a31a6-d190-4a99-a31a-ee334613bd9f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:08.313667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a31a6-d190-4a99-a31a-ee334613bd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:08.328813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 850/1694] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:08 2022] PUT /identity/v3/projects/697412c23ecb4b93a02cbbcc72e37fc8/users/12ea50a6bc9640108c95e7215462c9d8/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:08.348167 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d0f1d-4527-47b5-a9ca-613b696201a3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:08.450530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a56a31a6-d190-4a99-a31a-ee334613bd9f None None] MFA Rules not processed for user `12ea50a6bc9640108c95e7215462c9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:08.459594 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a56a31a6-d190-4a99-a31a-ee334613bd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:08.605261 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d0f1d-4527-47b5-a9ca-613b696201a3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:08.611016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9ff67-c799-44a1-a151-dfccbab6e61b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:08.611821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9ff67-c799-44a1-a151-dfccbab6e61b service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:08.612206 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9ff67-c799-44a1-a151-dfccbab6e61b service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:08.612612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9ff67-c799-44a1-a151-dfccbab6e61b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:08.619318 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-44c9ff67-c799-44a1-a151-dfccbab6e61b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:08.679180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 845/1695] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:08.680563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a31a6-d190-4a99-a31a-ee334613bd9f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:08.691861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a56a31a6-d190-4a99-a31a-ee334613bd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:08.718177 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a31a6-d190-4a99-a31a-ee334613bd9f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:08.727909 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ed8b7-52a4-41e7-b740-98bc7e9a1ec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:08.728649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ed8b7-52a4-41e7-b740-98bc7e9a1ec9 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:08.728998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ed8b7-52a4-41e7-b740-98bc7e9a1ec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:08.729329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ed8b7-52a4-41e7-b740-98bc7e9a1ec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:08.749534 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2d1ed8b7-52a4-41e7-b740-98bc7e9a1ec9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:08.789433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9ff67-c799-44a1-a151-dfccbab6e61b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:08.796331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9ff67-c799-44a1-a151-dfccbab6e61b service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:08.830354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 851/1696] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:08.845442 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:08.948719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ed8b7-52a4-41e7-b740-98bc7e9a1ec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:08.950925 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ed8b7-52a4-41e7-b740-98bc7e9a1ec9 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:08.977378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 846/1697] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:09.018825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9ff67-c799-44a1-a151-dfccbab6e61b service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:09.044241 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9ff67-c799-44a1-a151-dfccbab6e61b service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:09.065227 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ba281-c23a-410d-ad99-2bc845064c12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:09.072584 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ba281-c23a-410d-ad99-2bc845064c12 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:09.073191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ba281-c23a-410d-ad99-2bc845064c12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:09.073736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ba281-c23a-410d-ad99-2bc845064c12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:09.117466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ba281-c23a-410d-ad99-2bc845064c12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:09.127223 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ba281-c23a-410d-ad99-2bc845064c12 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:09.160839 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 852/1698] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:10.005600 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580818ed-1a80-4d14-a035-bb04ad8552ce None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:10.006756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580818ed-1a80-4d14-a035-bb04ad8552ce None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:10.007353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580818ed-1a80-4d14-a035-bb04ad8552ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:10.117677 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-580818ed-1a80-4d14-a035-bb04ad8552ce None None] MFA Rules not processed for user `9a0a16f3770a433f8ef98af2fbd4b1c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:10.119606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-580818ed-1a80-4d14-a035-bb04ad8552ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:10.255026 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ba281-c23a-410d-ad99-2bc845064c12 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:10.257546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a73ba281-c23a-410d-ad99-2bc845064c12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:10.358799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 847/1699] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:10.361041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15900d-fe52-4e3b-8790-ea9baa0d0326 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:10.361666 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15900d-fe52-4e3b-8790-ea9baa0d0326 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:10.362142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15900d-fe52-4e3b-8790-ea9baa0d0326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:10.384838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:10.452010 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cb15900d-fe52-4e3b-8790-ea9baa0d0326 None None] MFA Rules not processed for user `9a0a16f3770a433f8ef98af2fbd4b1c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:10.454060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cb15900d-fe52-4e3b-8790-ea9baa0d0326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:10.469198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ba281-c23a-410d-ad99-2bc845064c12 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:10.479590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 848/1700] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:10.484287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5991540-fd6b-4a6e-8414-a7d9e0837f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:10.484287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5991540-fd6b-4a6e-8414-a7d9e0837f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:10.484287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5991540-fd6b-4a6e-8414-a7d9e0837f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:10.484287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5991540-fd6b-4a6e-8414-a7d9e0837f75 admin admin] PATH_INFO: `/v3/projects/14f7c7ed4b314451b97bb6121bdace75` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:10.485788 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5991540-fd6b-4a6e-8414-a7d9e0837f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f7c7ed4b314451b97bb6121bdace75)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:10.486840 dv-cinder-856941-3-smb devstack@keystone.service[81467]: WARNING py.warnings [None req-c5991540-fd6b-4a6e-8414-a7d9e0837f75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 01:19:10.486840 dv-cinder-856941-3-smb devstack@keystone.service[81467]: warnings.warn(msg) Sep 13 01:19:10.486840 dv-cinder-856941-3-smb devstack@keystone.service[81467]: Sep 13 01:19:10.491095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5991540-fd6b-4a6e-8414-a7d9e0837f75 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:10.493357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15900d-fe52-4e3b-8790-ea9baa0d0326 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:10.495726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cb15900d-fe52-4e3b-8790-ea9baa0d0326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:10.710899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c5991540-fd6b-4a6e-8414-a7d9e0837f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f7c7ed4b314451b97bb6121bdace75', 'request_id': 'req-c5991540-fd6b-4a6e-8414-a7d9e0837f75'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:10.772393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c5991540-fd6b-4a6e-8414-a7d9e0837f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f7c7ed4b314451b97bb6121bdace75', 'request_id': 'req-c5991540-fd6b-4a6e-8414-a7d9e0837f75'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:10.800842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c5991540-fd6b-4a6e-8414-a7d9e0837f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f7c7ed4b314451b97bb6121bdace75', 'request_id': 'req-c5991540-fd6b-4a6e-8414-a7d9e0837f75'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:10.806908 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15900d-fe52-4e3b-8790-ea9baa0d0326 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:10.840649 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c5991540-fd6b-4a6e-8414-a7d9e0837f75 admin admin] The token cache is being invalidate because project 14f7c7ed4b314451b97bb6121bdace75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:10.850313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c5991540-fd6b-4a6e-8414-a7d9e0837f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:10.856231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c5991540-fd6b-4a6e-8414-a7d9e0837f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:10.864009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 853/1701] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:10 2022] DELETE /identity/v3/projects/14f7c7ed4b314451b97bb6121bdace75 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:10.878209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb46a5-d960-40b9-83a9-30a667ea4d5f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:10.878585 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb46a5-d960-40b9-83a9-30a667ea4d5f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:10.878991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb46a5-d960-40b9-83a9-30a667ea4d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:10.930795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:10.965897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-69cb46a5-d960-40b9-83a9-30a667ea4d5f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:10.972234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-69cb46a5-d960-40b9-83a9-30a667ea4d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:11.007827 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b8a3a-bf34-4bb0-bb37-f409dbd98e76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:11.009097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b8a3a-bf34-4bb0-bb37-f409dbd98e76 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:11.010507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b8a3a-bf34-4bb0-bb37-f409dbd98e76 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:11.010788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b8a3a-bf34-4bb0-bb37-f409dbd98e76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:11.015273 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-081b8a3a-bf34-4bb0-bb37-f409dbd98e76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:11.173165 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b8a3a-bf34-4bb0-bb37-f409dbd98e76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:11.174884 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b8a3a-bf34-4bb0-bb37-f409dbd98e76 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:11.180846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 854/1702] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:11.181826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb46a5-d960-40b9-83a9-30a667ea4d5f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:11.184811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-69cb46a5-d960-40b9-83a9-30a667ea4d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:11.213499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb46a5-d960-40b9-83a9-30a667ea4d5f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:11.224876 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 849/1703] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:19:11.226961 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ca5cd-b6f1-42ed-bdc1-249e040a8b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:11.227824 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ca5cd-b6f1-42ed-bdc1-249e040a8b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:11.228080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28912646-1438-4731-aa05-fe899bdc61fd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:11.228546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28912646-1438-4731-aa05-fe899bdc61fd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:11.228911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ca5cd-b6f1-42ed-bdc1-249e040a8b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:11.229737 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ca5cd-b6f1-42ed-bdc1-249e040a8b17 admin admin] PATH_INFO: `/v3/users/ffc41d95c81a4288806ed5e614d8c81f` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:11.231211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28912646-1438-4731-aa05-fe899bdc61fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:11.233150 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ca5cd-b6f1-42ed-bdc1-249e040a8b17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc41d95c81a4288806ed5e614d8c81f)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:11.238521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ca5cd-b6f1-42ed-bdc1-249e040a8b17 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:11.290210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-28912646-1438-4731-aa05-fe899bdc61fd None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:11.297004 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-28912646-1438-4731-aa05-fe899bdc61fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:11.329078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 850/1704] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:11.337679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28912646-1438-4731-aa05-fe899bdc61fd None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:11.378178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28912646-1438-4731-aa05-fe899bdc61fd None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:11.393221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da14fb-0e18-4d24-805c-2869f1faacd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:11.393951 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da14fb-0e18-4d24-805c-2869f1faacd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:11.394202 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da14fb-0e18-4d24-805c-2869f1faacd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:11.394815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da14fb-0e18-4d24-805c-2869f1faacd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:11.396153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da14fb-0e18-4d24-805c-2869f1faacd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:11.396283 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da14fb-0e18-4d24-805c-2869f1faacd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:11.398315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da14fb-0e18-4d24-805c-2869f1faacd4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:11.448798 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c68ca5cd-b6f1-42ed-bdc1-249e040a8b17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc41d95c81a4288806ed5e614d8c81f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:11.452932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 851/1705] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:11.453921 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c68ca5cd-b6f1-42ed-bdc1-249e040a8b17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc41d95c81a4288806ed5e614d8c81f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:11.457520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216744c-638f-4893-91a6-63c9c62c3e6b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:11.457805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216744c-638f-4893-91a6-63c9c62c3e6b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:11.458083 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216744c-638f-4893-91a6-63c9c62c3e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:11.478266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c68ca5cd-b6f1-42ed-bdc1-249e040a8b17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc41d95c81a4288806ed5e614d8c81f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:11.509317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:11.526664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c68ca5cd-b6f1-42ed-bdc1-249e040a8b17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc41d95c81a4288806ed5e614d8c81f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:11.528697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c68ca5cd-b6f1-42ed-bdc1-249e040a8b17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc41d95c81a4288806ed5e614d8c81f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:11.554612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6216744c-638f-4893-91a6-63c9c62c3e6b None None] MFA Rules not processed for user `00dbc8a1ee7645668360de8a7cc4ea92`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:11.555956 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6216744c-638f-4893-91a6-63c9c62c3e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:11.561096 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 855/1706] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:11 2022] DELETE /identity/v3/users/ffc41d95c81a4288806ed5e614d8c81f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:11.561965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ca5cd-b6f1-42ed-bdc1-249e040a8b17 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:11.569686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c68ca5cd-b6f1-42ed-bdc1-249e040a8b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:11.689795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 852/1707] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:11.701959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216744c-638f-4893-91a6-63c9c62c3e6b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:11.705247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6216744c-638f-4893-91a6-63c9c62c3e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:11.727330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216744c-638f-4893-91a6-63c9c62c3e6b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:11.754779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ca5cd-b6f1-42ed-bdc1-249e040a8b17 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:11.789435 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5b62e-89af-44fe-b5e2-d0f7caddb2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:11.789813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b62e-89af-44fe-b5e2-d0f7caddb2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:11.790362 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b62e-89af-44fe-b5e2-d0f7caddb2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:11.790362 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b62e-89af-44fe-b5e2-d0f7caddb2bd admin admin] PATH_INFO: `/v3/users/6e9b1c26da694694b47c9e3f9c37d788` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:11.798282 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5b62e-89af-44fe-b5e2-d0f7caddb2bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e9b1c26da694694b47c9e3f9c37d788)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:11.800300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5b62e-89af-44fe-b5e2-d0f7caddb2bd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:11.862373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:11.888388 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ccd46-b4b9-425e-83e7-753a6c682875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:11.891362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ccd46-b4b9-425e-83e7-753a6c682875 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:11.892459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ccd46-b4b9-425e-83e7-753a6c682875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:11.892776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ccd46-b4b9-425e-83e7-753a6c682875 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:11.894502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ccd46-b4b9-425e-83e7-753a6c682875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:11.902889 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ccd46-b4b9-425e-83e7-753a6c682875 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:11.907615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9af5b62e-89af-44fe-b5e2-d0f7caddb2bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e9b1c26da694694b47c9e3f9c37d788'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:11.908377 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9af5b62e-89af-44fe-b5e2-d0f7caddb2bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e9b1c26da694694b47c9e3f9c37d788'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:11.921490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9af5b62e-89af-44fe-b5e2-d0f7caddb2bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e9b1c26da694694b47c9e3f9c37d788'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:11.970380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 853/1708] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:11 2022] POST /identity/v3/projects => generated 365 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:11.973608 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9af5b62e-89af-44fe-b5e2-d0f7caddb2bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e9b1c26da694694b47c9e3f9c37d788'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:11.974370 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca05f28-4cdb-44de-884f-9a84eaad2178 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:11.974850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9af5b62e-89af-44fe-b5e2-d0f7caddb2bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e9b1c26da694694b47c9e3f9c37d788'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:11.976779 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca05f28-4cdb-44de-884f-9a84eaad2178 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:11.977222 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca05f28-4cdb-44de-884f-9a84eaad2178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:12.014538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 856/1709] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:11 2022] DELETE /identity/v3/users/6e9b1c26da694694b47c9e3f9c37d788 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:12.015693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4dc04-0a05-48d2-a3bc-8b8044bfb33a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:12.015990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4dc04-0a05-48d2-a3bc-8b8044bfb33a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:12.016272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4dc04-0a05-48d2-a3bc-8b8044bfb33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:12.029761 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2ca05f28-4cdb-44de-884f-9a84eaad2178 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:12.034215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2ca05f28-4cdb-44de-884f-9a84eaad2178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:12.061996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-eef4dc04-0a05-48d2-a3bc-8b8044bfb33a None None] MFA Rules not processed for user `00dbc8a1ee7645668360de8a7cc4ea92`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:12.063313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-eef4dc04-0a05-48d2-a3bc-8b8044bfb33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:12.205772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 854/1710] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:12.206708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca05f28-4cdb-44de-884f-9a84eaad2178 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:12.208768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2ca05f28-4cdb-44de-884f-9a84eaad2178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:12.259169 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca05f28-4cdb-44de-884f-9a84eaad2178 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:12.267295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 857/1711] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:12.267295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193e640-4eac-42a6-834d-4cc9f2bc1b47 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:12.267295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193e640-4eac-42a6-834d-4cc9f2bc1b47 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:12.267295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193e640-4eac-42a6-834d-4cc9f2bc1b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:12.267818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c528299-8f7a-43fd-b124-6f47b7fefa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:12.267818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c528299-8f7a-43fd-b124-6f47b7fefa1c admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:12.267818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c528299-8f7a-43fd-b124-6f47b7fefa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:12.267818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c528299-8f7a-43fd-b124-6f47b7fefa1c admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:12.268574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c528299-8f7a-43fd-b124-6f47b7fefa1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:12.270747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c528299-8f7a-43fd-b124-6f47b7fefa1c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:12.308707 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 855/1712] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:12 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:12.309971 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c528299-8f7a-43fd-b124-6f47b7fefa1c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:12.312359 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6c528299-8f7a-43fd-b124-6f47b7fefa1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:12.319625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:12.362441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3193e640-4eac-42a6-834d-4cc9f2bc1b47 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:12.363843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3193e640-4eac-42a6-834d-4cc9f2bc1b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:12.387801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 858/1713] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:12.388522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193e640-4eac-42a6-834d-4cc9f2bc1b47 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:12.392542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3193e640-4eac-42a6-834d-4cc9f2bc1b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:12.467585 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c528299-8f7a-43fd-b124-6f47b7fefa1c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:12.474572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a553f1-7dcd-46bc-920b-f58e2ceb59f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:12.475261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a553f1-7dcd-46bc-920b-f58e2ceb59f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:12.475547 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a553f1-7dcd-46bc-920b-f58e2ceb59f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:12.475833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a553f1-7dcd-46bc-920b-f58e2ceb59f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:12.506156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a553f1-7dcd-46bc-920b-f58e2ceb59f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:12.507665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a553f1-7dcd-46bc-920b-f58e2ceb59f9 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:12.524004 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 856/1714] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:12.524930 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a553f1-7dcd-46bc-920b-f58e2ceb59f9 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:12.539756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a553f1-7dcd-46bc-920b-f58e2ceb59f9 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:12.547863 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74b035-4aef-42ee-be96-16a2f4ba6845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:12.550804 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74b035-4aef-42ee-be96-16a2f4ba6845 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:12.551107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74b035-4aef-42ee-be96-16a2f4ba6845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:12.551471 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74b035-4aef-42ee-be96-16a2f4ba6845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:12.553730 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74b035-4aef-42ee-be96-16a2f4ba6845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:12.555415 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74b035-4aef-42ee-be96-16a2f4ba6845 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:12.579489 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 857/1715] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:12.584558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74b035-4aef-42ee-be96-16a2f4ba6845 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:12.591573 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cd74b035-4aef-42ee-be96-16a2f4ba6845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:12.596243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193e640-4eac-42a6-834d-4cc9f2bc1b47 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:12.611325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74b035-4aef-42ee-be96-16a2f4ba6845 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:12.615894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e7dda-400a-4201-881c-ec89ede11143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:12.616381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e7dda-400a-4201-881c-ec89ede11143 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:12.616671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e7dda-400a-4201-881c-ec89ede11143 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:12.616929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e7dda-400a-4201-881c-ec89ede11143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:12.638571 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4682c-b86d-43de-aafb-3faee140b729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:12.640123 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4682c-b86d-43de-aafb-3faee140b729 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:12.640536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4682c-b86d-43de-aafb-3faee140b729 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:12.640913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4682c-b86d-43de-aafb-3faee140b729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:12.647132 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e7dda-400a-4201-881c-ec89ede11143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:12.648393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-37a4682c-b86d-43de-aafb-3faee140b729 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:12.655011 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e7dda-400a-4201-881c-ec89ede11143 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:12.682395 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4682c-b86d-43de-aafb-3faee140b729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:12.686960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4682c-b86d-43de-aafb-3faee140b729 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:12.689108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 858/1716] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:12.697009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e7dda-400a-4201-881c-ec89ede11143 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:12.722589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 859/1717] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:12.725712 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fbd47-5de8-4bc7-b771-fc69eea01765 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:12.725712 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fbd47-5de8-4bc7-b771-fc69eea01765 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:12.725712 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fbd47-5de8-4bc7-b771-fc69eea01765 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:12.734646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 860/1718] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 13 01:19:12 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:19:12.748372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bbad4-605e-4906-a835-dbb95d3688c7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:12.748792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bbad4-605e-4906-a835-dbb95d3688c7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:12.749636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bbad4-605e-4906-a835-dbb95d3688c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:12.769228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e7dda-400a-4201-881c-ec89ede11143 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:12.790707 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d09ba5-6e14-43c7-99f1-5ef6b3e765b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:12.792121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d09ba5-6e14-43c7-99f1-5ef6b3e765b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:12.792121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d09ba5-6e14-43c7-99f1-5ef6b3e765b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:12.792121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d09ba5-6e14-43c7-99f1-5ef6b3e765b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:12.792606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d09ba5-6e14-43c7-99f1-5ef6b3e765b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:12.798609 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d09ba5-6e14-43c7-99f1-5ef6b3e765b1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:12.824305 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 859/1719] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:12.841590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d09ba5-6e14-43c7-99f1-5ef6b3e765b1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:12.872472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d09ba5-6e14-43c7-99f1-5ef6b3e765b1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:12.896084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c0499-ab13-49f1-a0d5-46b7f22c92fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:12.900471 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c0499-ab13-49f1-a0d5-46b7f22c92fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:12.900768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c0499-ab13-49f1-a0d5-46b7f22c92fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:12.901045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c0499-ab13-49f1-a0d5-46b7f22c92fe admin admin] PATH_INFO: `/v3/projects/c656e044e29b4acc8d2f62a2dc8e2d55/users/2ea0b8346f9e487baaf43fa778b52d98/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:12.907778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-458bbad4-605e-4906-a835-dbb95d3688c7 None None] MFA Rules not processed for user `a672e63fa5e345679bac3d67301fe875`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:12.909141 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-458bbad4-605e-4906-a835-dbb95d3688c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:12.927831 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 861/1720] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 13 01:19:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:12.939597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c0499-ab13-49f1-a0d5-46b7f22c92fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c656e044e29b4acc8d2f62a2dc8e2d55, user_id=2ea0b8346f9e487baaf43fa778b52d98, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:12.945081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c0499-ab13-49f1-a0d5-46b7f22c92fe admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:12.979358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bbad4-605e-4906-a835-dbb95d3688c7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:12.991673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bbad4-605e-4906-a835-dbb95d3688c7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:12.994821 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 860/1721] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:12 2022] PUT /identity/v3/projects/c656e044e29b4acc8d2f62a2dc8e2d55/users/2ea0b8346f9e487baaf43fa778b52d98/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:13.010530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8f34f-23ed-4db6-bc23-c08727f54589 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:13.015988 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8f34f-23ed-4db6-bc23-c08727f54589 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:13.018911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8f34f-23ed-4db6-bc23-c08727f54589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:13.063928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:13.152628 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-64f8f34f-23ed-4db6-bc23-c08727f54589 None None] MFA Rules not processed for user `2ea0b8346f9e487baaf43fa778b52d98`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:13.154146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-64f8f34f-23ed-4db6-bc23-c08727f54589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:13.264641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956bf9b-3c55-4e6e-8930-c871262ed867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:13.265285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956bf9b-3c55-4e6e-8930-c871262ed867 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:13.265564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956bf9b-3c55-4e6e-8930-c871262ed867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:13.265836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956bf9b-3c55-4e6e-8930-c871262ed867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:13.288816 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956bf9b-3c55-4e6e-8930-c871262ed867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:13.290307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956bf9b-3c55-4e6e-8930-c871262ed867 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:13.308058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 861/1722] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:13.310395 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8f34f-23ed-4db6-bc23-c08727f54589 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:13.311873 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-64f8f34f-23ed-4db6-bc23-c08727f54589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:13.319682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 862/1723] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:13.320583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956bf9b-3c55-4e6e-8930-c871262ed867 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:13.464723 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8f34f-23ed-4db6-bc23-c08727f54589 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:13.482754 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92130ceb-141b-45fe-948c-2978c85c43f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:13.484487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92130ceb-141b-45fe-948c-2978c85c43f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:13.484599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92130ceb-141b-45fe-948c-2978c85c43f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:13.487667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92130ceb-141b-45fe-948c-2978c85c43f8 admin admin] PATH_INFO: `/v3/users/c9aaa44d0a8d4cfd97c3f1314fac2b85` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:13.492483 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92130ceb-141b-45fe-948c-2978c85c43f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9aaa44d0a8d4cfd97c3f1314fac2b85)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:13.496723 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92130ceb-141b-45fe-948c-2978c85c43f8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:13.540670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956bf9b-3c55-4e6e-8930-c871262ed867 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:13.553969 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfbb20-b196-4fe8-a1c7-e39ec13033cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:13.554616 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfbb20-b196-4fe8-a1c7-e39ec13033cf admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:13.554899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfbb20-b196-4fe8-a1c7-e39ec13033cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:13.555637 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfbb20-b196-4fe8-a1c7-e39ec13033cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:13.556408 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfbb20-b196-4fe8-a1c7-e39ec13033cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:13.558297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfbb20-b196-4fe8-a1c7-e39ec13033cf admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:13.584634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:13.635990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 863/1724] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:13 2022] POST /identity/v3/projects => generated 365 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:13.637727 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9c2bc-369f-4df4-b8c4-a7e6b465a756 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:13.638175 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9c2bc-369f-4df4-b8c4-a7e6b465a756 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:13.638445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9c2bc-369f-4df4-b8c4-a7e6b465a756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:13.652168 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-92130ceb-141b-45fe-948c-2978c85c43f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9aaa44d0a8d4cfd97c3f1314fac2b85'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:13.654556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-92130ceb-141b-45fe-948c-2978c85c43f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9aaa44d0a8d4cfd97c3f1314fac2b85'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:13.672060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-92130ceb-141b-45fe-948c-2978c85c43f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9aaa44d0a8d4cfd97c3f1314fac2b85'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:13.717370 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-92130ceb-141b-45fe-948c-2978c85c43f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9aaa44d0a8d4cfd97c3f1314fac2b85'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:13.720869 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-92130ceb-141b-45fe-948c-2978c85c43f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9aaa44d0a8d4cfd97c3f1314fac2b85'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:13.725006 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-96d9c2bc-369f-4df4-b8c4-a7e6b465a756 None None] MFA Rules not processed for user `2821b1a941c543a0aac6f56385c3c8be`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:13.730488 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-96d9c2bc-369f-4df4-b8c4-a7e6b465a756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:13.759038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 862/1725] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:13 2022] DELETE /identity/v3/users/c9aaa44d0a8d4cfd97c3f1314fac2b85 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:13.760090 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92130ceb-141b-45fe-948c-2978c85c43f8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:13.762565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-92130ceb-141b-45fe-948c-2978c85c43f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:13.832652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:13.918919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 864/1726] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:13.920319 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d16b9-4165-445d-a38f-7559bf4c022c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:13.920628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d16b9-4165-445d-a38f-7559bf4c022c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:13.920897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d16b9-4165-445d-a38f-7559bf4c022c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:13.977722 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92130ceb-141b-45fe-948c-2978c85c43f8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:13.983033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e67d16b9-4165-445d-a38f-7559bf4c022c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:13.984314 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e67d16b9-4165-445d-a38f-7559bf4c022c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:13.988333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f3cf5-293a-47bd-9691-64220a2c587d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:13.991110 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f3cf5-293a-47bd-9691-64220a2c587d admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:13.991110 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f3cf5-293a-47bd-9691-64220a2c587d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:13.991347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f3cf5-293a-47bd-9691-64220a2c587d admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:13.993984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f3cf5-293a-47bd-9691-64220a2c587d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:13.998464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f3cf5-293a-47bd-9691-64220a2c587d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:14.017448 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 865/1727] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:14.046721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d16b9-4165-445d-a38f-7559bf4c022c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:14.049844 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e67d16b9-4165-445d-a38f-7559bf4c022c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:14.074317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 863/1728] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:13 2022] POST /identity/v3/users => generated 289 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:14.078696 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f3cf5-293a-47bd-9691-64220a2c587d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:14.132619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f3cf5-293a-47bd-9691-64220a2c587d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:14.147793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fd99f-284f-43b2-84c3-a3129876eaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:14.149126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fd99f-284f-43b2-84c3-a3129876eaac admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:14.149668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fd99f-284f-43b2-84c3-a3129876eaac admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:14.150184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fd99f-284f-43b2-84c3-a3129876eaac admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:14.151349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fd99f-284f-43b2-84c3-a3129876eaac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:14.153261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fd99f-284f-43b2-84c3-a3129876eaac admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:14.182240 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 864/1729] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:14.190248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fd99f-284f-43b2-84c3-a3129876eaac admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:14.196099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9f6fd99f-284f-43b2-84c3-a3129876eaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:14.199241 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d16b9-4165-445d-a38f-7559bf4c022c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:14.206940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1dc4-9cfd-4c22-99c1-8bc8cb85ee75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:14.207601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1dc4-9cfd-4c22-99c1-8bc8cb85ee75 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:14.207878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1dc4-9cfd-4c22-99c1-8bc8cb85ee75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:14.208150 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1dc4-9cfd-4c22-99c1-8bc8cb85ee75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:14.227362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fd99f-284f-43b2-84c3-a3129876eaac admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:14.232917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa1dc4-9cfd-4c22-99c1-8bc8cb85ee75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:14.235329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa1dc4-9cfd-4c22-99c1-8bc8cb85ee75 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:14.238160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:14.239427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:14.240306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:14.241312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0 admin admin] PATH_INFO: `/v3/projects/0ec99e4c4ac548b387aab76d66b4b1a9` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:14.244514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec99e4c4ac548b387aab76d66b4b1a9)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:14.249011 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:14.289175 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 866/1730] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:14.293282 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1dc4-9cfd-4c22-99c1-8bc8cb85ee75 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:14.337207 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1dc4-9cfd-4c22-99c1-8bc8cb85ee75 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:14.351589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608aa4d-5fe5-4735-be0b-bdaa0a32ac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:14.352742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608aa4d-5fe5-4735-be0b-bdaa0a32ac82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:14.353477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608aa4d-5fe5-4735-be0b-bdaa0a32ac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:14.353884 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608aa4d-5fe5-4735-be0b-bdaa0a32ac82 admin admin] PATH_INFO: `/v3/projects/0458407970f54849bee0ae89ab1c33e2/users/04bd58e422694302b34c6a2f377e6f2f/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:14.405424 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608aa4d-5fe5-4735-be0b-bdaa0a32ac82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0458407970f54849bee0ae89ab1c33e2, user_id=04bd58e422694302b34c6a2f377e6f2f, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:14.413844 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608aa4d-5fe5-4735-be0b-bdaa0a32ac82 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:14.431004 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec99e4c4ac548b387aab76d66b4b1a9', 'request_id': 'req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:14.466732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec99e4c4ac548b387aab76d66b4b1a9', 'request_id': 'req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:14.488109 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 867/1731] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:14 2022] PUT /identity/v3/projects/0458407970f54849bee0ae89ab1c33e2/users/04bd58e422694302b34c6a2f377e6f2f/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:14.491306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec99e4c4ac548b387aab76d66b4b1a9', 'request_id': 'req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:14.492977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f759c-104d-4518-b65b-f1a2b1e00015 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:14.493716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f759c-104d-4518-b65b-f1a2b1e00015 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:14.494312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f759c-104d-4518-b65b-f1a2b1e00015 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:14.497140 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 868/1732] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 13 01:19:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:19:14.503628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f759c-104d-4518-b65b-f1a2b1e00015 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:14.507496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b41f759c-104d-4518-b65b-f1a2b1e00015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:14.544539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0 admin admin] The token cache is being invalidate because project 0ec99e4c4ac548b387aab76d66b4b1a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:14.544798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:14.549730 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:14.557315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 865/1733] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:14 2022] DELETE /identity/v3/projects/0ec99e4c4ac548b387aab76d66b4b1a9 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:14.558409 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:14.569653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:14.665702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:14.723574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f759c-104d-4518-b65b-f1a2b1e00015 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:14.734274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2d264-039e-4bed-876b-ecb8af6eb081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:14.737499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2d264-039e-4bed-876b-ecb8af6eb081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:14.740423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2d264-039e-4bed-876b-ecb8af6eb081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:14.740962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2d264-039e-4bed-876b-ecb8af6eb081 admin admin] PATH_INFO: `/v3/projects/03f3a05cfe5f47c8af6ef5e92faa6a04` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:14.748196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2d264-039e-4bed-876b-ecb8af6eb081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f3a05cfe5f47c8af6ef5e92faa6a04)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:14.758720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2d264-039e-4bed-876b-ecb8af6eb081 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:14.786091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe3a89-3241-47a8-a9f8-c3b4c39699f0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:14.796949 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c82a9-b115-4812-b015-95290e322a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:14.798110 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c82a9-b115-4812-b015-95290e322a3b admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:14.798441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c82a9-b115-4812-b015-95290e322a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:14.798803 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c82a9-b115-4812-b015-95290e322a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:14.799594 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c82a9-b115-4812-b015-95290e322a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:14.809073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c82a9-b115-4812-b015-95290e322a3b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:14.839198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 866/1734] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:14.839198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b624fa4-4c66-4bb7-8422-2eea83b21ccf None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:14.839198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b624fa4-4c66-4bb7-8422-2eea83b21ccf None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:14.839493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b624fa4-4c66-4bb7-8422-2eea83b21ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:14.913376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4b624fa4-4c66-4bb7-8422-2eea83b21ccf None None] MFA Rules not processed for user `a672e63fa5e345679bac3d67301fe875`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:14.917134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4b624fa4-4c66-4bb7-8422-2eea83b21ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:14.930591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:15.014665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e7b2d264-039e-4bed-876b-ecb8af6eb081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f3a05cfe5f47c8af6ef5e92faa6a04', 'request_id': 'req-e7b2d264-039e-4bed-876b-ecb8af6eb081'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:15.033657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 867/1735] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 13 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:15.035272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b624fa4-4c66-4bb7-8422-2eea83b21ccf None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:15.038932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4b624fa4-4c66-4bb7-8422-2eea83b21ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:15.039815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e7b2d264-039e-4bed-876b-ecb8af6eb081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f3a05cfe5f47c8af6ef5e92faa6a04', 'request_id': 'req-e7b2d264-039e-4bed-876b-ecb8af6eb081'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:15.056620 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e7b2d264-039e-4bed-876b-ecb8af6eb081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f3a05cfe5f47c8af6ef5e92faa6a04', 'request_id': 'req-e7b2d264-039e-4bed-876b-ecb8af6eb081'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:15.085294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e7b2d264-039e-4bed-876b-ecb8af6eb081 admin admin] The token cache is being invalidate because project 03f3a05cfe5f47c8af6ef5e92faa6a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:15.085994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e7b2d264-039e-4bed-876b-ecb8af6eb081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:15.088633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e7b2d264-039e-4bed-876b-ecb8af6eb081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:15.092277 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 869/1736] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:14 2022] DELETE /identity/v3/projects/03f3a05cfe5f47c8af6ef5e92faa6a04 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:15.093340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2d264-039e-4bed-876b-ecb8af6eb081 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:15.098203 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e7b2d264-039e-4bed-876b-ecb8af6eb081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:15.153092 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b624fa4-4c66-4bb7-8422-2eea83b21ccf None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:15.168858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002abd10-4d47-4d47-bc9f-17f742ff701e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:15.169677 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002abd10-4d47-4d47-bc9f-17f742ff701e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:15.170022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002abd10-4d47-4d47-bc9f-17f742ff701e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:15.170378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002abd10-4d47-4d47-bc9f-17f742ff701e admin admin] PATH_INFO: `/v3/users/82546b59d97c41ae8f708793b863b000` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:15.172111 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002abd10-4d47-4d47-bc9f-17f742ff701e admin admin] RBAC: Authorizing `identity:delete_user(user_id=82546b59d97c41ae8f708793b863b000)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:15.174471 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002abd10-4d47-4d47-bc9f-17f742ff701e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:15.223689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2d264-039e-4bed-876b-ecb8af6eb081 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:15.231938 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c7412-b687-428f-b368-63dd54d4acf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:15.232771 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c7412-b687-428f-b368-63dd54d4acf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:15.233038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c7412-b687-428f-b368-63dd54d4acf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:15.234745 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c7412-b687-428f-b368-63dd54d4acf4 admin admin] PATH_INFO: `/v3/projects/0458407970f54849bee0ae89ab1c33e2/users/04bd58e422694302b34c6a2f377e6f2f/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:15.238458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c7412-b687-428f-b368-63dd54d4acf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0458407970f54849bee0ae89ab1c33e2, user_id=04bd58e422694302b34c6a2f377e6f2f, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:15.244088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c7412-b687-428f-b368-63dd54d4acf4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:15.271143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 870/1737] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:15 2022] PUT /identity/v3/projects/0458407970f54849bee0ae89ab1c33e2/users/04bd58e422694302b34c6a2f377e6f2f/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:15.271143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c7412-b687-428f-b368-63dd54d4acf4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:15.271143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-004c7412-b687-428f-b368-63dd54d4acf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:15.316515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-002abd10-4d47-4d47-bc9f-17f742ff701e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82546b59d97c41ae8f708793b863b000'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:15.317237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-002abd10-4d47-4d47-bc9f-17f742ff701e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82546b59d97c41ae8f708793b863b000'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:15.334138 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-002abd10-4d47-4d47-bc9f-17f742ff701e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82546b59d97c41ae8f708793b863b000'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:15.352962 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-002abd10-4d47-4d47-bc9f-17f742ff701e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82546b59d97c41ae8f708793b863b000'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:15.353883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-002abd10-4d47-4d47-bc9f-17f742ff701e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82546b59d97c41ae8f708793b863b000'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:15.369056 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c7412-b687-428f-b368-63dd54d4acf4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:15.377507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9a44f-b65c-4356-a228-09797d04a842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:15.378531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9a44f-b65c-4356-a228-09797d04a842 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:15.378984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9a44f-b65c-4356-a228-09797d04a842 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:15.379509 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 868/1738] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:15 2022] DELETE /identity/v3/users/82546b59d97c41ae8f708793b863b000 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:15.381064 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002abd10-4d47-4d47-bc9f-17f742ff701e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:15.383779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9a44f-b65c-4356-a228-09797d04a842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:15.385550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-002abd10-4d47-4d47-bc9f-17f742ff701e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:15.385970 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-89a9a44f-b65c-4356-a228-09797d04a842 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:15.414462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:15.476057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:15.520357 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9a44f-b65c-4356-a228-09797d04a842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:15.522896 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9a44f-b65c-4356-a228-09797d04a842 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:15.534985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002abd10-4d47-4d47-bc9f-17f742ff701e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:15.542855 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c24246-65e1-4c36-8ccb-5dad369cb282 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c5e6dae854a44a0ad6628e7dd69dfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:15.544182 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c24246-65e1-4c36-8ccb-5dad369cb282 service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:15.544738 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c24246-65e1-4c36-8ccb-5dad369cb282 service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:15.545892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c24246-65e1-4c36-8ccb-5dad369cb282 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:15.546087 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 871/1739] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:15.547100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9a44f-b65c-4356-a228-09797d04a842 service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:15.548904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b1c24246-65e1-4c36-8ccb-5dad369cb282 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:15.553379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-89a9a44f-b65c-4356-a228-09797d04a842 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:15.572522 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c24246-65e1-4c36-8ccb-5dad369cb282 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:15.574799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c24246-65e1-4c36-8ccb-5dad369cb282 service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:15.590832 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 869/1740] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:15.596104 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c24246-65e1-4c36-8ccb-5dad369cb282 service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:15.599740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b1c24246-65e1-4c36-8ccb-5dad369cb282 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:15.721099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9a44f-b65c-4356-a228-09797d04a842 service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:15.812386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c24246-65e1-4c36-8ccb-5dad369cb282 service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:15.824207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17cf0a-b1f7-40c0-9d47-5aa9e8c6a7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:15.824539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17cf0a-b1f7-40c0-9d47-5aa9e8c6a7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:15.826546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17cf0a-b1f7-40c0-9d47-5aa9e8c6a7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:15.826546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17cf0a-b1f7-40c0-9d47-5aa9e8c6a7fd admin admin] PATH_INFO: `/v3/users/12ea50a6bc9640108c95e7215462c9d8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:15.830852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17cf0a-b1f7-40c0-9d47-5aa9e8c6a7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ea50a6bc9640108c95e7215462c9d8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:15.836736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17cf0a-b1f7-40c0-9d47-5aa9e8c6a7fd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:15.868140 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38faf6-08f9-4e94-a7ae-bbedc04c78e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:15.868809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38faf6-08f9-4e94-a7ae-bbedc04c78e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:15.869087 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38faf6-08f9-4e94-a7ae-bbedc04c78e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:15.869358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38faf6-08f9-4e94-a7ae-bbedc04c78e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:15.874323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9e38faf6-08f9-4e94-a7ae-bbedc04c78e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:15.905314 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38faf6-08f9-4e94-a7ae-bbedc04c78e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:15.907212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38faf6-08f9-4e94-a7ae-bbedc04c78e9 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:15.938602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 872/1741] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:15.939731 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38faf6-08f9-4e94-a7ae-bbedc04c78e9 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:15.944667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9e38faf6-08f9-4e94-a7ae-bbedc04c78e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:15.952427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bf17cf0a-b1f7-40c0-9d47-5aa9e8c6a7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ea50a6bc9640108c95e7215462c9d8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:15.955411 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bf17cf0a-b1f7-40c0-9d47-5aa9e8c6a7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ea50a6bc9640108c95e7215462c9d8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:15.973771 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bf17cf0a-b1f7-40c0-9d47-5aa9e8c6a7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ea50a6bc9640108c95e7215462c9d8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:15.978008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38faf6-08f9-4e94-a7ae-bbedc04c78e9 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:16.000261 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5533391-db93-43a1-a697-abc7cc424859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:16.003506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5533391-db93-43a1-a697-abc7cc424859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:16.003818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5533391-db93-43a1-a697-abc7cc424859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:16.005680 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5533391-db93-43a1-a697-abc7cc424859 admin admin] PATH_INFO: `/v3/projects/dce77c7fd554406c868912521fc8f2d9` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:16.008605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5533391-db93-43a1-a697-abc7cc424859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dce77c7fd554406c868912521fc8f2d9)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:16.012694 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5533391-db93-43a1-a697-abc7cc424859 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:16.013461 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bf17cf0a-b1f7-40c0-9d47-5aa9e8c6a7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ea50a6bc9640108c95e7215462c9d8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:16.015760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bf17cf0a-b1f7-40c0-9d47-5aa9e8c6a7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ea50a6bc9640108c95e7215462c9d8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:16.042049 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 870/1742] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:15 2022] DELETE /identity/v3/users/12ea50a6bc9640108c95e7215462c9d8 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:16.044598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c23a8-30d5-42bc-9b5b-2b65aac602fb None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:16.045005 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c23a8-30d5-42bc-9b5b-2b65aac602fb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:16.046787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c23a8-30d5-42bc-9b5b-2b65aac602fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:16.150516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f56c23a8-30d5-42bc-9b5b-2b65aac602fb None None] MFA Rules not processed for user `04bd58e422694302b34c6a2f377e6f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:16.153729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f56c23a8-30d5-42bc-9b5b-2b65aac602fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:16.163979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f5533391-db93-43a1-a697-abc7cc424859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dce77c7fd554406c868912521fc8f2d9', 'request_id': 'req-f5533391-db93-43a1-a697-abc7cc424859'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:16.178679 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f5533391-db93-43a1-a697-abc7cc424859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dce77c7fd554406c868912521fc8f2d9', 'request_id': 'req-f5533391-db93-43a1-a697-abc7cc424859'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:16.213855 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f5533391-db93-43a1-a697-abc7cc424859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dce77c7fd554406c868912521fc8f2d9', 'request_id': 'req-f5533391-db93-43a1-a697-abc7cc424859'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:16.232402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:16.261983 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f5533391-db93-43a1-a697-abc7cc424859 admin admin] The token cache is being invalidate because project dce77c7fd554406c868912521fc8f2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:16.262219 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f5533391-db93-43a1-a697-abc7cc424859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:16.264193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f5533391-db93-43a1-a697-abc7cc424859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:16.269925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 873/1743] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:15 2022] DELETE /identity/v3/projects/dce77c7fd554406c868912521fc8f2d9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:16.274425 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5533391-db93-43a1-a697-abc7cc424859 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:16.276402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f5533391-db93-43a1-a697-abc7cc424859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:16.293882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:16.377684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 871/1744] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:16.395672 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c23a8-30d5-42bc-9b5b-2b65aac602fb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:16.398323 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f56c23a8-30d5-42bc-9b5b-2b65aac602fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:16.477330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5533391-db93-43a1-a697-abc7cc424859 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:16.496021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddc4d3-c226-4e5d-b897-1c4d7468accc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:16.496687 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddc4d3-c226-4e5d-b897-1c4d7468accc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:16.496965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddc4d3-c226-4e5d-b897-1c4d7468accc admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:16.497237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddc4d3-c226-4e5d-b897-1c4d7468accc admin admin] PATH_INFO: `/v3/users/d7c82a4c0627497b8f1c0af4a8ea164f` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:16.501884 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddc4d3-c226-4e5d-b897-1c4d7468accc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c82a4c0627497b8f1c0af4a8ea164f)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:16.503743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddc4d3-c226-4e5d-b897-1c4d7468accc admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:16.555903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c23a8-30d5-42bc-9b5b-2b65aac602fb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:16.567384 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4778e77-440a-4b16-a8f5-1381d17de7cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:16.572338 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4778e77-440a-4b16-a8f5-1381d17de7cc service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:16.572638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4778e77-440a-4b16-a8f5-1381d17de7cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:16.572925 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4778e77-440a-4b16-a8f5-1381d17de7cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:16.664470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4778e77-440a-4b16-a8f5-1381d17de7cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:16.669624 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4778e77-440a-4b16-a8f5-1381d17de7cc service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:16.723503 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 872/1745] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:19:16.740704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f1ddc4d3-c226-4e5d-b897-1c4d7468accc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c82a4c0627497b8f1c0af4a8ea164f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:16.741232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f1ddc4d3-c226-4e5d-b897-1c4d7468accc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c82a4c0627497b8f1c0af4a8ea164f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:16.763483 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f1ddc4d3-c226-4e5d-b897-1c4d7468accc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c82a4c0627497b8f1c0af4a8ea164f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:16.779921 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4778e77-440a-4b16-a8f5-1381d17de7cc service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:16.784212 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d4778e77-440a-4b16-a8f5-1381d17de7cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:16.811600 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f1ddc4d3-c226-4e5d-b897-1c4d7468accc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c82a4c0627497b8f1c0af4a8ea164f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:16.813460 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4778e77-440a-4b16-a8f5-1381d17de7cc service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:16.815304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f1ddc4d3-c226-4e5d-b897-1c4d7468accc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c82a4c0627497b8f1c0af4a8ea164f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:16.831101 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf33c07-a825-4329-a89b-bd800a9d8d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:16.842553 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33c07-a825-4329-a89b-bd800a9d8d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:16.842995 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33c07-a825-4329-a89b-bd800a9d8d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:16.843443 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33c07-a825-4329-a89b-bd800a9d8d61 admin admin] PATH_INFO: `/v3/projects/697412c23ecb4b93a02cbbcc72e37fc8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:16.845295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf33c07-a825-4329-a89b-bd800a9d8d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=697412c23ecb4b93a02cbbcc72e37fc8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:16.847670 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf33c07-a825-4329-a89b-bd800a9d8d61 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:16.910373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 874/1746] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:16 2022] DELETE /identity/v3/users/d7c82a4c0627497b8f1c0af4a8ea164f => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:17.042632 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fbf33c07-a825-4329-a89b-bd800a9d8d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697412c23ecb4b93a02cbbcc72e37fc8', 'request_id': 'req-fbf33c07-a825-4329-a89b-bd800a9d8d61'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:17.070669 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fbf33c07-a825-4329-a89b-bd800a9d8d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697412c23ecb4b93a02cbbcc72e37fc8', 'request_id': 'req-fbf33c07-a825-4329-a89b-bd800a9d8d61'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:17.093286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fbf33c07-a825-4329-a89b-bd800a9d8d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697412c23ecb4b93a02cbbcc72e37fc8', 'request_id': 'req-fbf33c07-a825-4329-a89b-bd800a9d8d61'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:17.103420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddc4d3-c226-4e5d-b897-1c4d7468accc admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:17.105240 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f1ddc4d3-c226-4e5d-b897-1c4d7468accc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:17.137117 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fbf33c07-a825-4329-a89b-bd800a9d8d61 admin admin] The token cache is being invalidate because project 697412c23ecb4b93a02cbbcc72e37fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:17.138060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fbf33c07-a825-4329-a89b-bd800a9d8d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:17.139424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fbf33c07-a825-4329-a89b-bd800a9d8d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:17.147320 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 873/1747] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:16 2022] DELETE /identity/v3/projects/697412c23ecb4b93a02cbbcc72e37fc8 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:17.149270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b17976-eca7-4d59-9c5d-26841bff5bf9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:17.152770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b17976-eca7-4d59-9c5d-26841bff5bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:17.155333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b17976-eca7-4d59-9c5d-26841bff5bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:17.220170 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-48b17976-eca7-4d59-9c5d-26841bff5bf9 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:17.221842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-48b17976-eca7-4d59-9c5d-26841bff5bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:17.386286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:17.417022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 874/1748] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:17.418510 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9c69e-75c2-4098-9e1d-7905a6c9b15d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:17.418793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9c69e-75c2-4098-9e1d-7905a6c9b15d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:17.419128 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9c69e-75c2-4098-9e1d-7905a6c9b15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:17.457838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cef9c69e-75c2-4098-9e1d-7905a6c9b15d None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:17.464500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cef9c69e-75c2-4098-9e1d-7905a6c9b15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:17.479372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddc4d3-c226-4e5d-b897-1c4d7468accc admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:17.493941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 875/1749] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:17.498762 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9c69e-75c2-4098-9e1d-7905a6c9b15d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:17.500463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bafa7c-ac0f-4308-b454-c042a097feab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:17.501203 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bafa7c-ac0f-4308-b454-c042a097feab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:17.501492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bafa7c-ac0f-4308-b454-c042a097feab admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:17.502757 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bafa7c-ac0f-4308-b454-c042a097feab admin admin] PATH_INFO: `/v3/projects/f02f0c33edaa474fadd7a723c44603ec` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:17.507818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bafa7c-ac0f-4308-b454-c042a097feab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f02f0c33edaa474fadd7a723c44603ec)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:17.510388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bafa7c-ac0f-4308-b454-c042a097feab admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:17.554483 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9c69e-75c2-4098-9e1d-7905a6c9b15d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:17.577454 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479fda0-4d75-4261-9326-aac293bf1906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:17.578034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479fda0-4d75-4261-9326-aac293bf1906 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:17.578475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479fda0-4d75-4261-9326-aac293bf1906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:17.580263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:17.594355 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479fda0-4d75-4261-9326-aac293bf1906 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:17.597177 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479fda0-4d75-4261-9326-aac293bf1906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:17.600041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479fda0-4d75-4261-9326-aac293bf1906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:17.615828 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479fda0-4d75-4261-9326-aac293bf1906 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:17.670919 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 876/1750] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:17.672870 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479fda0-4d75-4261-9326-aac293bf1906 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:17.678578 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-08bafa7c-ac0f-4308-b454-c042a097feab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f02f0c33edaa474fadd7a723c44603ec', 'request_id': 'req-08bafa7c-ac0f-4308-b454-c042a097feab'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:17.702298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-08bafa7c-ac0f-4308-b454-c042a097feab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f02f0c33edaa474fadd7a723c44603ec', 'request_id': 'req-08bafa7c-ac0f-4308-b454-c042a097feab'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:17.719160 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-08bafa7c-ac0f-4308-b454-c042a097feab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f02f0c33edaa474fadd7a723c44603ec', 'request_id': 'req-08bafa7c-ac0f-4308-b454-c042a097feab'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:17.733103 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479fda0-4d75-4261-9326-aac293bf1906 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:17.766570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-08bafa7c-ac0f-4308-b454-c042a097feab admin admin] The token cache is being invalidate because project f02f0c33edaa474fadd7a723c44603ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:17.767057 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-08bafa7c-ac0f-4308-b454-c042a097feab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:17.777985 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-08bafa7c-ac0f-4308-b454-c042a097feab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:17.785524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 875/1751] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:17 2022] DELETE /identity/v3/projects/f02f0c33edaa474fadd7a723c44603ec => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:17.790465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e1e93-912a-444d-959f-38d09c900f40 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:17.790835 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e1e93-912a-444d-959f-38d09c900f40 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:17.791665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e1e93-912a-444d-959f-38d09c900f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:17.826721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a07e1e93-912a-444d-959f-38d09c900f40 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:17.829696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a07e1e93-912a-444d-959f-38d09c900f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:17.960640 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 876/1752] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:17.961921 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e1e93-912a-444d-959f-38d09c900f40 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:17.964193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a07e1e93-912a-444d-959f-38d09c900f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:17.983916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355626e-1e2a-4e20-82b4-662c391866ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:17.985075 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355626e-1e2a-4e20-82b4-662c391866ee admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:17.985913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355626e-1e2a-4e20-82b4-662c391866ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:17.986265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355626e-1e2a-4e20-82b4-662c391866ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:17.987056 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355626e-1e2a-4e20-82b4-662c391866ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:17.997468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355626e-1e2a-4e20-82b4-662c391866ee admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:18.029196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e1e93-912a-444d-959f-38d09c900f40 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:18.052357 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785c0d1-fed1-4975-be29-e00451948acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:18.054412 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785c0d1-fed1-4975-be29-e00451948acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:18.055051 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785c0d1-fed1-4975-be29-e00451948acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:18.057564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785c0d1-fed1-4975-be29-e00451948acb admin admin] PATH_INFO: `/v3/projects/3a7267ca06fc4d9cb7517fb33782b022` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:18.058943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785c0d1-fed1-4975-be29-e00451948acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a7267ca06fc4d9cb7517fb33782b022)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:18.064340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785c0d1-fed1-4975-be29-e00451948acb admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:18.125730 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 877/1753] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:17 2022] POST /identity/v3/projects => generated 357 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:18.131482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fbad5-5bb7-4077-b26a-0c92c417e514 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:18.133509 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fbad5-5bb7-4077-b26a-0c92c417e514 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:18.133509 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fbad5-5bb7-4077-b26a-0c92c417e514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:18.160283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1785c0d1-fed1-4975-be29-e00451948acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7267ca06fc4d9cb7517fb33782b022', 'request_id': 'req-1785c0d1-fed1-4975-be29-e00451948acb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:18.168439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4f8fbad5-5bb7-4077-b26a-0c92c417e514 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:18.170418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1785c0d1-fed1-4975-be29-e00451948acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7267ca06fc4d9cb7517fb33782b022', 'request_id': 'req-1785c0d1-fed1-4975-be29-e00451948acb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:18.170705 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4f8fbad5-5bb7-4077-b26a-0c92c417e514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:18.189412 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1785c0d1-fed1-4975-be29-e00451948acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7267ca06fc4d9cb7517fb33782b022', 'request_id': 'req-1785c0d1-fed1-4975-be29-e00451948acb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:18.242052 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1785c0d1-fed1-4975-be29-e00451948acb admin admin] The token cache is being invalidate because project 3a7267ca06fc4d9cb7517fb33782b022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:18.242357 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1785c0d1-fed1-4975-be29-e00451948acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:18.243145 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1785c0d1-fed1-4975-be29-e00451948acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:18.245571 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 877/1754] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:17 2022] DELETE /identity/v3/projects/3a7267ca06fc4d9cb7517fb33782b022 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:18.246434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785c0d1-fed1-4975-be29-e00451948acb admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:18.250335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1785c0d1-fed1-4975-be29-e00451948acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:18.324588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 878/1755] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:18.324588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fbad5-5bb7-4077-b26a-0c92c417e514 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:18.324588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4f8fbad5-5bb7-4077-b26a-0c92c417e514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:18.338023 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:18.360809 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fbad5-5bb7-4077-b26a-0c92c417e514 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:18.372331 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93688f3-a9c8-497f-83ac-ffd5b2359258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:18.373367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93688f3-a9c8-497f-83ac-ffd5b2359258 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:18.373746 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93688f3-a9c8-497f-83ac-ffd5b2359258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:18.374157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93688f3-a9c8-497f-83ac-ffd5b2359258 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:18.374958 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93688f3-a9c8-497f-83ac-ffd5b2359258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:18.377481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93688f3-a9c8-497f-83ac-ffd5b2359258 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:18.409632 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785c0d1-fed1-4975-be29-e00451948acb admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:18.412726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 879/1756] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:18 2022] POST /identity/v3/users => generated 279 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:18.424683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469f3c3-681a-499c-accb-1a9f060eff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:18.426326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469f3c3-681a-499c-accb-1a9f060eff99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:18.426635 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469f3c3-681a-499c-accb-1a9f060eff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:18.426889 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469f3c3-681a-499c-accb-1a9f060eff99 admin admin] PATH_INFO: `/v3/users/2ea0b8346f9e487baaf43fa778b52d98` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:18.430337 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469f3c3-681a-499c-accb-1a9f060eff99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea0b8346f9e487baaf43fa778b52d98)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:18.434401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30758804-9b25-4c42-86aa-a895c9675467 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:18.434784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30758804-9b25-4c42-86aa-a895c9675467 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:18.435195 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30758804-9b25-4c42-86aa-a895c9675467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:18.440855 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469f3c3-681a-499c-accb-1a9f060eff99 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:18.472510 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-30758804-9b25-4c42-86aa-a895c9675467 None None] MFA Rules not processed for user `00dbc8a1ee7645668360de8a7cc4ea92`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:18.473813 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-30758804-9b25-4c42-86aa-a895c9675467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:18.591569 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d469f3c3-681a-499c-accb-1a9f060eff99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea0b8346f9e487baaf43fa778b52d98'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:18.595237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d469f3c3-681a-499c-accb-1a9f060eff99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea0b8346f9e487baaf43fa778b52d98'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:18.602242 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:18.624023 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d469f3c3-681a-499c-accb-1a9f060eff99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea0b8346f9e487baaf43fa778b52d98'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:18.655308 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 880/1757] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:18.658733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30758804-9b25-4c42-86aa-a895c9675467 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:18.678129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-30758804-9b25-4c42-86aa-a895c9675467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:18.691421 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d469f3c3-681a-499c-accb-1a9f060eff99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea0b8346f9e487baaf43fa778b52d98'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:18.695895 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d469f3c3-681a-499c-accb-1a9f060eff99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea0b8346f9e487baaf43fa778b52d98'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:18.718180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30758804-9b25-4c42-86aa-a895c9675467 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:18.725357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248464c9-d905-4504-8fe4-6421f5035d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:18.726462 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248464c9-d905-4504-8fe4-6421f5035d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:18.727413 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248464c9-d905-4504-8fe4-6421f5035d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:18.727604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248464c9-d905-4504-8fe4-6421f5035d6c admin admin] PATH_INFO: `/v3/users/34c4bdd8824c4734a7237315ac7571b9` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:18.729687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248464c9-d905-4504-8fe4-6421f5035d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c4bdd8824c4734a7237315ac7571b9)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:18.734472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248464c9-d905-4504-8fe4-6421f5035d6c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:18.740614 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 878/1758] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:18 2022] DELETE /identity/v3/users/2ea0b8346f9e487baaf43fa778b52d98 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:18.741800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469f3c3-681a-499c-accb-1a9f060eff99 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:18.749467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d469f3c3-681a-499c-accb-1a9f060eff99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:18.924046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-248464c9-d905-4504-8fe4-6421f5035d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c4bdd8824c4734a7237315ac7571b9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:18.927815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-248464c9-d905-4504-8fe4-6421f5035d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c4bdd8824c4734a7237315ac7571b9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:18.959531 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-248464c9-d905-4504-8fe4-6421f5035d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c4bdd8824c4734a7237315ac7571b9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:18.997096 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469f3c3-681a-499c-accb-1a9f060eff99 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:19.012185 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-248464c9-d905-4504-8fe4-6421f5035d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c4bdd8824c4734a7237315ac7571b9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:19.012601 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-248464c9-d905-4504-8fe4-6421f5035d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c4bdd8824c4734a7237315ac7571b9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:19.026010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6009f-88b6-4b38-9e0b-1bdee3765258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:19.030432 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6009f-88b6-4b38-9e0b-1bdee3765258 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:19.030772 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6009f-88b6-4b38-9e0b-1bdee3765258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:19.031055 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6009f-88b6-4b38-9e0b-1bdee3765258 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:19.035991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6009f-88b6-4b38-9e0b-1bdee3765258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:19.037202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6009f-88b6-4b38-9e0b-1bdee3765258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:19.039477 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 881/1759] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:18 2022] DELETE /identity/v3/users/34c4bdd8824c4734a7237315ac7571b9 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:19.039647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6009f-88b6-4b38-9e0b-1bdee3765258 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:19.040202 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248464c9-d905-4504-8fe4-6421f5035d6c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:19.048621 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-248464c9-d905-4504-8fe4-6421f5035d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:19.103244 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 879/1760] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:19.107079 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea9184-8a0a-4abc-8f4f-0ef92800dd46 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:19.109308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea9184-8a0a-4abc-8f4f-0ef92800dd46 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:19.115582 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea9184-8a0a-4abc-8f4f-0ef92800dd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:19.186234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f9ea9184-8a0a-4abc-8f4f-0ef92800dd46 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:19.189721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f9ea9184-8a0a-4abc-8f4f-0ef92800dd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:19.288529 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248464c9-d905-4504-8fe4-6421f5035d6c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:19.300432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ba4ae-2749-49b7-b32a-e5d93776ccd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:19.301302 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ba4ae-2749-49b7-b32a-e5d93776ccd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:19.303459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ba4ae-2749-49b7-b32a-e5d93776ccd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:19.304882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ba4ae-2749-49b7-b32a-e5d93776ccd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:19.305831 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ba4ae-2749-49b7-b32a-e5d93776ccd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:19.308320 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:19.322031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ba4ae-2749-49b7-b32a-e5d93776ccd3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:19.348295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 882/1761] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:19.353029 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ba4ae-2749-49b7-b32a-e5d93776ccd3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:19.356075 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-071ba4ae-2749-49b7-b32a-e5d93776ccd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:19.373237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 880/1762] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:19.375118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea9184-8a0a-4abc-8f4f-0ef92800dd46 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:19.381593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ba4ae-2749-49b7-b32a-e5d93776ccd3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:19.392227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d31c4-a75a-44fa-a038-23c6f5a6f2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:19.393288 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d31c4-a75a-44fa-a038-23c6f5a6f2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:19.393862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d31c4-a75a-44fa-a038-23c6f5a6f2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:19.394358 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d31c4-a75a-44fa-a038-23c6f5a6f2c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:19.395251 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d31c4-a75a-44fa-a038-23c6f5a6f2c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:19.397349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea9184-8a0a-4abc-8f4f-0ef92800dd46 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:19.398483 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d31c4-a75a-44fa-a038-23c6f5a6f2c0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:19.410542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd47da-48e6-4f94-9a34-d0eb982ee8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:19.410542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd47da-48e6-4f94-9a34-d0eb982ee8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:19.412148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd47da-48e6-4f94-9a34-d0eb982ee8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:19.413322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd47da-48e6-4f94-9a34-d0eb982ee8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:19.414371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd47da-48e6-4f94-9a34-d0eb982ee8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:19.427724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd47da-48e6-4f94-9a34-d0eb982ee8e1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:19.452023 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 881/1763] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:19.452023 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd47da-48e6-4f94-9a34-d0eb982ee8e1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:19.455105 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-82fd47da-48e6-4f94-9a34-d0eb982ee8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:19.502382 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 883/1764] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:19 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:19.509660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d31c4-a75a-44fa-a038-23c6f5a6f2c0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:19.606736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd47da-48e6-4f94-9a34-d0eb982ee8e1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:19.675879 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:19.710665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c85f7-fd3b-4aad-9a69-3d71afb333c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:19.711376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c85f7-fd3b-4aad-9a69-3d71afb333c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:19.711696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c85f7-fd3b-4aad-9a69-3d71afb333c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:19.711973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c85f7-fd3b-4aad-9a69-3d71afb333c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:19.715382 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d31c4-a75a-44fa-a038-23c6f5a6f2c0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:19.732067 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f39e21-2c33-410b-b042-594f17d08211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:19.732768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f39e21-2c33-410b-b042-594f17d08211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:19.733052 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f39e21-2c33-410b-b042-594f17d08211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:19.733334 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f39e21-2c33-410b-b042-594f17d08211 admin admin] PATH_INFO: `/v3/projects/ddc3a4b0f7314eabb41dff7c49b2ed90/users/2a208c8da9c64d5aa43e967dadca6759/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:19.744479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c85f7-fd3b-4aad-9a69-3d71afb333c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:19.748564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c85f7-fd3b-4aad-9a69-3d71afb333c1 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:19.779676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f39e21-2c33-410b-b042-594f17d08211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc3a4b0f7314eabb41dff7c49b2ed90, user_id=2a208c8da9c64d5aa43e967dadca6759, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:19.782239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 882/1765] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:19.782365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f39e21-2c33-410b-b042-594f17d08211 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:19.785622 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c85f7-fd3b-4aad-9a69-3d71afb333c1 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:19.807909 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 884/1766] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:19 2022] PUT /identity/v3/projects/ddc3a4b0f7314eabb41dff7c49b2ed90/users/2a208c8da9c64d5aa43e967dadca6759/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:19.817306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c85f7-fd3b-4aad-9a69-3d71afb333c1 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:19.819537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6070df4-0f9e-4571-a9b3-3c66a9fee1b0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:19.819830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6070df4-0f9e-4571-a9b3-3c66a9fee1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:19.820109 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6070df4-0f9e-4571-a9b3-3c66a9fee1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:19.876075 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b6070df4-0f9e-4571-a9b3-3c66a9fee1b0 None None] MFA Rules not processed for user `2a208c8da9c64d5aa43e967dadca6759`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:19.877326 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b6070df4-0f9e-4571-a9b3-3c66a9fee1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:19.944179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d317be5-c9b6-4162-9321-4789698b0961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:19.944819 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d317be5-c9b6-4162-9321-4789698b0961 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:19.945177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d317be5-c9b6-4162-9321-4789698b0961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:19.946878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d317be5-c9b6-4162-9321-4789698b0961 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:19.948219 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d317be5-c9b6-4162-9321-4789698b0961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:19.952035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d317be5-c9b6-4162-9321-4789698b0961 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:20.035139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 883/1767] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:19 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:20.037813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9c46e-7bdd-4fe8-b0af-35041c7660c4 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:20.038328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9c46e-7bdd-4fe8-b0af-35041c7660c4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:20.039264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9c46e-7bdd-4fe8-b0af-35041c7660c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:20.081487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 885/1768] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:19:20.082442 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6070df4-0f9e-4571-a9b3-3c66a9fee1b0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:20.115944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6070df4-0f9e-4571-a9b3-3c66a9fee1b0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:20.131326 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67343a99-fcf7-4110-bd7f-a456e1690c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:20.132112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67343a99-fcf7-4110-bd7f-a456e1690c68 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:20.132390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67343a99-fcf7-4110-bd7f-a456e1690c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:20.132658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67343a99-fcf7-4110-bd7f-a456e1690c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:20.133310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67343a99-fcf7-4110-bd7f-a456e1690c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:20.134944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67343a99-fcf7-4110-bd7f-a456e1690c68 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:20.156316 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:20.164353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 886/1769] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:20.167379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67343a99-fcf7-4110-bd7f-a456e1690c68 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:20.189308 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67343a99-fcf7-4110-bd7f-a456e1690c68 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:20.203541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f6bb7-183b-4d6f-8488-a4617188c157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:20.205634 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f6bb7-183b-4d6f-8488-a4617188c157 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:20.206429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f6bb7-183b-4d6f-8488-a4617188c157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:20.206719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f6bb7-183b-4d6f-8488-a4617188c157 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:20.211513 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f6bb7-183b-4d6f-8488-a4617188c157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:20.216339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f6bb7-183b-4d6f-8488-a4617188c157 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:20.284091 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-41c9c46e-7bdd-4fe8-b0af-35041c7660c4 None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:20.285843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 887/1770] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:20 2022] POST /identity/v3/projects => generated 349 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:20.287493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f6bb7-183b-4d6f-8488-a4617188c157 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:20.294935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-41c9c46e-7bdd-4fe8-b0af-35041c7660c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:20.494214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f6bb7-183b-4d6f-8488-a4617188c157 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:20.511217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a40d4-cdc3-49c2-982a-358a4c15e6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:20.519430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a40d4-cdc3-49c2-982a-358a4c15e6fa admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:20.519720 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a40d4-cdc3-49c2-982a-358a4c15e6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:20.521464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a40d4-cdc3-49c2-982a-358a4c15e6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:20.522129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a40d4-cdc3-49c2-982a-358a4c15e6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:20.528633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a40d4-cdc3-49c2-982a-358a4c15e6fa admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:20.574896 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 888/1771] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:20.574896 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a40d4-cdc3-49c2-982a-358a4c15e6fa admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:20.580132 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 884/1772] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 13 01:19:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:20.582041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9c46e-7bdd-4fe8-b0af-35041c7660c4 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:20.624038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a40d4-cdc3-49c2-982a-358a4c15e6fa admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:20.635684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9c46e-7bdd-4fe8-b0af-35041c7660c4 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:20.644088 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde39796-5c6b-425b-82b1-c1946c06fc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:20.648064 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde39796-5c6b-425b-82b1-c1946c06fc64 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:20.650258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde39796-5c6b-425b-82b1-c1946c06fc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:20.652392 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde39796-5c6b-425b-82b1-c1946c06fc64 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:20.655003 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde39796-5c6b-425b-82b1-c1946c06fc64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:20.659829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b631ee-e48b-4b02-ab15-8c1f6db50e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:20.663168 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b631ee-e48b-4b02-ab15-8c1f6db50e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:20.664230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde39796-5c6b-425b-82b1-c1946c06fc64 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:20.666740 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b631ee-e48b-4b02-ab15-8c1f6db50e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:20.667150 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b631ee-e48b-4b02-ab15-8c1f6db50e4a admin admin] PATH_INFO: `/v3/projects/480859af39c64adbbff20647d51b1cb7/users/90f9b3b9e5fc4d7783bfdf3214ad0453/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:20.724515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:20.732405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b631ee-e48b-4b02-ab15-8c1f6db50e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=480859af39c64adbbff20647d51b1cb7, user_id=90f9b3b9e5fc4d7783bfdf3214ad0453, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:20.735782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b631ee-e48b-4b02-ab15-8c1f6db50e4a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:20.747709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 889/1773] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:20 2022] POST /identity/v3/users => generated 281 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:20.748613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde39796-5c6b-425b-82b1-c1946c06fc64 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:20.783274 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde39796-5c6b-425b-82b1-c1946c06fc64 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:20.794648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 885/1774] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:20 2022] PUT /identity/v3/projects/480859af39c64adbbff20647d51b1cb7/users/90f9b3b9e5fc4d7783bfdf3214ad0453/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:20.800287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b631ee-e48b-4b02-ab15-8c1f6db50e4a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:20.804834 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-77b631ee-e48b-4b02-ab15-8c1f6db50e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:20.969521 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ca61b-374f-4ea9-abef-78dca8a93d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:20.970100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ca61b-374f-4ea9-abef-78dca8a93d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:20.971249 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ca61b-374f-4ea9-abef-78dca8a93d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:20.972727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ca61b-374f-4ea9-abef-78dca8a93d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:20.973410 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ca61b-374f-4ea9-abef-78dca8a93d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:20.976680 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ca61b-374f-4ea9-abef-78dca8a93d66 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:20.996739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 890/1775] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:21.001147 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a92c75-96c0-4714-90d9-73de04a2df50 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:21.002025 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a92c75-96c0-4714-90d9-73de04a2df50 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:21.006390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a92c75-96c0-4714-90d9-73de04a2df50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:21.053238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b2a92c75-96c0-4714-90d9-73de04a2df50 None None] MFA Rules not processed for user `90f9b3b9e5fc4d7783bfdf3214ad0453`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:21.056112 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b631ee-e48b-4b02-ab15-8c1f6db50e4a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:21.056697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b2a92c75-96c0-4714-90d9-73de04a2df50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:21.065296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65217c5f-1abc-4e92-a330-22316e440e13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:21.066913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65217c5f-1abc-4e92-a330-22316e440e13 service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:21.067525 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65217c5f-1abc-4e92-a330-22316e440e13 service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:21.069241 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65217c5f-1abc-4e92-a330-22316e440e13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:21.180353 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:21.206316 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65217c5f-1abc-4e92-a330-22316e440e13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:21.213166 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65217c5f-1abc-4e92-a330-22316e440e13 service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:21.215663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 891/1776] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:21.216651 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a92c75-96c0-4714-90d9-73de04a2df50 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:21.236904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 886/1777] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:19:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 01:19:21.237810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65217c5f-1abc-4e92-a330-22316e440e13 service swift] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:21.246760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a92c75-96c0-4714-90d9-73de04a2df50 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:21.252521 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06b203-9d38-47c9-8185-e97465f52aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:21.253447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06b203-9d38-47c9-8185-e97465f52aed admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:21.253829 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06b203-9d38-47c9-8185-e97465f52aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:21.254367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06b203-9d38-47c9-8185-e97465f52aed admin admin] PATH_INFO: `/v3/projects/25c5be074231498f987ee7d01efa71e3/users/a4cb3d3c295c4319b9682254e10f7fa0/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:21.263982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65217c5f-1abc-4e92-a330-22316e440e13 service swift] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:21.289760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06b203-9d38-47c9-8185-e97465f52aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c5be074231498f987ee7d01efa71e3, user_id=a4cb3d3c295c4319b9682254e10f7fa0, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:21.291957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32896b86-5538-43f1-acc8-c1b096099cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:21.292591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32896b86-5538-43f1-acc8-c1b096099cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:21.292862 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32896b86-5538-43f1-acc8-c1b096099cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:21.293136 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32896b86-5538-43f1-acc8-c1b096099cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:21.294147 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06b203-9d38-47c9-8185-e97465f52aed admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:21.296390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32896b86-5538-43f1-acc8-c1b096099cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:21.301769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32896b86-5538-43f1-acc8-c1b096099cb6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:21.359536 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 892/1778] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:21 2022] PUT /identity/v3/projects/25c5be074231498f987ee7d01efa71e3/users/a4cb3d3c295c4319b9682254e10f7fa0/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:21.363207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06b203-9d38-47c9-8185-e97465f52aed admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:21.400888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 887/1779] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:21 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:21.402105 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32896b86-5538-43f1-acc8-c1b096099cb6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:21.553826 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06b203-9d38-47c9-8185-e97465f52aed admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:21.563812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:21.640372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32896b86-5538-43f1-acc8-c1b096099cb6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:21.653456 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649fd4c-85b7-4b24-916e-1a13272ca61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:21.655202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649fd4c-85b7-4b24-916e-1a13272ca61e admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:21.655531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649fd4c-85b7-4b24-916e-1a13272ca61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:21.655782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649fd4c-85b7-4b24-916e-1a13272ca61e admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:21.660354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649fd4c-85b7-4b24-916e-1a13272ca61e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:21.663268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649fd4c-85b7-4b24-916e-1a13272ca61e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:21.706743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 888/1780] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:21 2022] POST /identity/v3/users => generated 296 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:21.710937 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649fd4c-85b7-4b24-916e-1a13272ca61e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:21.735807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649fd4c-85b7-4b24-916e-1a13272ca61e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:21.747611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcd392-a8f2-4130-89bd-5d96c2aa092e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:21.749064 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcd392-a8f2-4130-89bd-5d96c2aa092e admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:21.749494 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcd392-a8f2-4130-89bd-5d96c2aa092e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:21.750191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcd392-a8f2-4130-89bd-5d96c2aa092e admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:21.751033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcd392-a8f2-4130-89bd-5d96c2aa092e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:21.757681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcd392-a8f2-4130-89bd-5d96c2aa092e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:21.794347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 889/1781] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:21.795531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcd392-a8f2-4130-89bd-5d96c2aa092e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:21.822852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcd392-a8f2-4130-89bd-5d96c2aa092e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:21.836110 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08900dc9-f8b3-4d2a-84bc-b0a1354ca207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:21.837248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08900dc9-f8b3-4d2a-84bc-b0a1354ca207 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:21.842473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08900dc9-f8b3-4d2a-84bc-b0a1354ca207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:21.842762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08900dc9-f8b3-4d2a-84bc-b0a1354ca207 admin admin] PATH_INFO: `/v3/projects/865f94525e27442ebe1ac89cbd75e909/users/765ddad0e47941b58762e53d8229767c/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:21.871250 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051dd93-bf2a-4f81-b4db-cf13594635da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:21.872763 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051dd93-bf2a-4f81-b4db-cf13594635da admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:21.873050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051dd93-bf2a-4f81-b4db-cf13594635da admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:21.873469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051dd93-bf2a-4f81-b4db-cf13594635da admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:21.874012 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051dd93-bf2a-4f81-b4db-cf13594635da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:21.885087 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051dd93-bf2a-4f81-b4db-cf13594635da admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:21.894999 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08900dc9-f8b3-4d2a-84bc-b0a1354ca207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=865f94525e27442ebe1ac89cbd75e909, user_id=765ddad0e47941b58762e53d8229767c, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:21.901867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08900dc9-f8b3-4d2a-84bc-b0a1354ca207 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:21.922322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 893/1782] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 559 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:21.926134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051dd93-bf2a-4f81-b4db-cf13594635da admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:21.930829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 890/1783] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:21 2022] PUT /identity/v3/projects/865f94525e27442ebe1ac89cbd75e909/users/765ddad0e47941b58762e53d8229767c/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:21.932668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08900dc9-f8b3-4d2a-84bc-b0a1354ca207 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:21.957918 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051dd93-bf2a-4f81-b4db-cf13594635da admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:22.174246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08900dc9-f8b3-4d2a-84bc-b0a1354ca207 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:22.194759 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99ae6d-07c4-43d4-8158-e6d4e1c6fb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:22.195598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99ae6d-07c4-43d4-8158-e6d4e1c6fb7f admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:22.195882 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99ae6d-07c4-43d4-8158-e6d4e1c6fb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:22.196159 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99ae6d-07c4-43d4-8158-e6d4e1c6fb7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:22.196823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99ae6d-07c4-43d4-8158-e6d4e1c6fb7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:22.201049 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99ae6d-07c4-43d4-8158-e6d4e1c6fb7f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:22.224625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5995f-c67a-4fa3-95cc-a74ce0355f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:22.228362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5995f-c67a-4fa3-95cc-a74ce0355f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:22.228716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5995f-c67a-4fa3-95cc-a74ce0355f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:22.228976 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5995f-c67a-4fa3-95cc-a74ce0355f55 admin admin] PATH_INFO: `/v3/projects/25c5be074231498f987ee7d01efa71e3/users/a4cb3d3c295c4319b9682254e10f7fa0/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:22.237796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5995f-c67a-4fa3-95cc-a74ce0355f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c5be074231498f987ee7d01efa71e3, user_id=a4cb3d3c295c4319b9682254e10f7fa0, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:22.252254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 891/1784] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:22.253524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99ae6d-07c4-43d4-8158-e6d4e1c6fb7f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:22.256681 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5995f-c67a-4fa3-95cc-a74ce0355f55 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:22.284464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99ae6d-07c4-43d4-8158-e6d4e1c6fb7f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:22.302583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 894/1785] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:21 2022] PUT /identity/v3/projects/25c5be074231498f987ee7d01efa71e3/users/a4cb3d3c295c4319b9682254e10f7fa0/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:22.314125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a268d-17ea-482c-b989-28f802fa28ec None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:22.314934 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a268d-17ea-482c-b989-28f802fa28ec None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:22.315820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a268d-17ea-482c-b989-28f802fa28ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:22.331208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:22.410587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8d3a268d-17ea-482c-b989-28f802fa28ec None None] MFA Rules not processed for user `a4cb3d3c295c4319b9682254e10f7fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:22.417371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8d3a268d-17ea-482c-b989-28f802fa28ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:22.670658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b7985-bb3e-4b5e-9e0a-04682a3ce0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:22.671754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b7985-bb3e-4b5e-9e0a-04682a3ce0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:22.672303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b7985-bb3e-4b5e-9e0a-04682a3ce0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:22.672802 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b7985-bb3e-4b5e-9e0a-04682a3ce0b9 admin admin] PATH_INFO: `/v3/projects/865f94525e27442ebe1ac89cbd75e909/users/765ddad0e47941b58762e53d8229767c/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:22.678794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b7985-bb3e-4b5e-9e0a-04682a3ce0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=865f94525e27442ebe1ac89cbd75e909, user_id=765ddad0e47941b58762e53d8229767c, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:22.689052 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b7985-bb3e-4b5e-9e0a-04682a3ce0b9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:22.722008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 892/1786] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:22 2022] PUT /identity/v3/projects/865f94525e27442ebe1ac89cbd75e909/users/765ddad0e47941b58762e53d8229767c/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:22.722008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b7985-bb3e-4b5e-9e0a-04682a3ce0b9 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:22.724217 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-de3b7985-bb3e-4b5e-9e0a-04682a3ce0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:22.851153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 895/1787] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:22 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 539 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:22.855201 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77bb61-7fdb-463a-b0a6-9df9e36f54a6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:22.855496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77bb61-7fdb-463a-b0a6-9df9e36f54a6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:22.856926 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77bb61-7fdb-463a-b0a6-9df9e36f54a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:22.938904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8a77bb61-7fdb-463a-b0a6-9df9e36f54a6 None None] MFA Rules not processed for user `765ddad0e47941b58762e53d8229767c`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:22.940695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8a77bb61-7fdb-463a-b0a6-9df9e36f54a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:22.942947 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b7985-bb3e-4b5e-9e0a-04682a3ce0b9 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:22.962323 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:22.986908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffce1e-4d14-4f06-992c-c9d98d9190ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:22.993336 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffce1e-4d14-4f06-992c-c9d98d9190ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:22.993735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffce1e-4d14-4f06-992c-c9d98d9190ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:22.994125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffce1e-4d14-4f06-992c-c9d98d9190ed admin admin] PATH_INFO: `/v3/projects/c656e044e29b4acc8d2f62a2dc8e2d55` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:23.000720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffce1e-4d14-4f06-992c-c9d98d9190ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c656e044e29b4acc8d2f62a2dc8e2d55)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:23.003750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffce1e-4d14-4f06-992c-c9d98d9190ed admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:23.225024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-12ffce1e-4d14-4f06-992c-c9d98d9190ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c656e044e29b4acc8d2f62a2dc8e2d55', 'request_id': 'req-12ffce1e-4d14-4f06-992c-c9d98d9190ed'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:23.247461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-12ffce1e-4d14-4f06-992c-c9d98d9190ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c656e044e29b4acc8d2f62a2dc8e2d55', 'request_id': 'req-12ffce1e-4d14-4f06-992c-c9d98d9190ed'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:23.249077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 896/1788] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:23.249784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77bb61-7fdb-463a-b0a6-9df9e36f54a6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:23.274959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8a77bb61-7fdb-463a-b0a6-9df9e36f54a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:23.278605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-12ffce1e-4d14-4f06-992c-c9d98d9190ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c656e044e29b4acc8d2f62a2dc8e2d55', 'request_id': 'req-12ffce1e-4d14-4f06-992c-c9d98d9190ed'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:23.307901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77bb61-7fdb-463a-b0a6-9df9e36f54a6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:23.347832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-12ffce1e-4d14-4f06-992c-c9d98d9190ed admin admin] The token cache is being invalidate because project c656e044e29b4acc8d2f62a2dc8e2d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:23.348283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-12ffce1e-4d14-4f06-992c-c9d98d9190ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:23.350238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-12ffce1e-4d14-4f06-992c-c9d98d9190ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:23.360434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 893/1789] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:22 2022] DELETE /identity/v3/projects/c656e044e29b4acc8d2f62a2dc8e2d55 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:23.364142 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffce1e-4d14-4f06-992c-c9d98d9190ed admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:23.367156 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-12ffce1e-4d14-4f06-992c-c9d98d9190ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:23.409619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6505cca-1113-4c4d-bd42-0c893a16da1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:23.410728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6505cca-1113-4c4d-bd42-0c893a16da1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:23.411798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6505cca-1113-4c4d-bd42-0c893a16da1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:23.412862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6505cca-1113-4c4d-bd42-0c893a16da1c admin admin] PATH_INFO: `/v3/projects/0241710067784787ae58a3efb4cfe815` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:23.415393 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6505cca-1113-4c4d-bd42-0c893a16da1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0241710067784787ae58a3efb4cfe815)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:23.417588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6505cca-1113-4c4d-bd42-0c893a16da1c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:23.487039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:23.497229 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6505cca-1113-4c4d-bd42-0c893a16da1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0241710067784787ae58a3efb4cfe815', 'request_id': 'req-b6505cca-1113-4c4d-bd42-0c893a16da1c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:23.508981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6505cca-1113-4c4d-bd42-0c893a16da1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0241710067784787ae58a3efb4cfe815', 'request_id': 'req-b6505cca-1113-4c4d-bd42-0c893a16da1c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:23.520306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6505cca-1113-4c4d-bd42-0c893a16da1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0241710067784787ae58a3efb4cfe815', 'request_id': 'req-b6505cca-1113-4c4d-bd42-0c893a16da1c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:23.532713 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffce1e-4d14-4f06-992c-c9d98d9190ed admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:23.539376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6505cca-1113-4c4d-bd42-0c893a16da1c admin admin] The token cache is being invalidate because project 0241710067784787ae58a3efb4cfe815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:23.540132 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6505cca-1113-4c4d-bd42-0c893a16da1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:23.541513 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6505cca-1113-4c4d-bd42-0c893a16da1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:23.548262 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 897/1790] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:23 2022] DELETE /identity/v3/projects/0241710067784787ae58a3efb4cfe815 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:23.550509 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6505cca-1113-4c4d-bd42-0c893a16da1c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:23.553439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b6505cca-1113-4c4d-bd42-0c893a16da1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:23.630658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:23.660258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6505cca-1113-4c4d-bd42-0c893a16da1c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:23.666314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f75435-e119-458b-b058-7b0b41709f0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:23.667040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f75435-e119-458b-b058-7b0b41709f0f service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:23.667384 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f75435-e119-458b-b058-7b0b41709f0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:23.667692 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f75435-e119-458b-b058-7b0b41709f0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:23.669734 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-67f75435-e119-458b-b058-7b0b41709f0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:23.670892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd22eb-a8e3-42ab-8709-82ed3abf3e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:23.673831 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd22eb-a8e3-42ab-8709-82ed3abf3e95 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:23.673831 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd22eb-a8e3-42ab-8709-82ed3abf3e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:23.673831 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd22eb-a8e3-42ab-8709-82ed3abf3e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:23.674428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-63bd22eb-a8e3-42ab-8709-82ed3abf3e95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:23.876046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f75435-e119-458b-b058-7b0b41709f0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:23.877627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd22eb-a8e3-42ab-8709-82ed3abf3e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:23.879886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd22eb-a8e3-42ab-8709-82ed3abf3e95 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:23.881984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f75435-e119-458b-b058-7b0b41709f0f service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:23.909795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 894/1791] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:23 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:23.918944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 898/1792] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:23.920651 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beceaa4-116d-465c-9afd-dbfacd9de242 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:23.920954 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beceaa4-116d-465c-9afd-dbfacd9de242 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:23.921243 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beceaa4-116d-465c-9afd-dbfacd9de242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:23.947021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd22eb-a8e3-42ab-8709-82ed3abf3e95 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:23.954690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-63bd22eb-a8e3-42ab-8709-82ed3abf3e95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:23.982002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0beceaa4-116d-465c-9afd-dbfacd9de242 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:23.986523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0beceaa4-116d-465c-9afd-dbfacd9de242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:24.127981 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd22eb-a8e3-42ab-8709-82ed3abf3e95 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:24.136306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc651caf-4650-4844-8892-232cfbceb6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:24.136989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc651caf-4650-4844-8892-232cfbceb6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:24.143623 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc651caf-4650-4844-8892-232cfbceb6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:24.143972 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc651caf-4650-4844-8892-232cfbceb6f3 admin admin] PATH_INFO: `/v3/users/04bd58e422694302b34c6a2f377e6f2f` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:24.147892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc651caf-4650-4844-8892-232cfbceb6f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04bd58e422694302b34c6a2f377e6f2f)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:24.149728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc651caf-4650-4844-8892-232cfbceb6f3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:24.175126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 899/1793] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:24.183895 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da8a2-270f-4344-bda5-0c9c1accf5fb None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:24.184323 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da8a2-270f-4344-bda5-0c9c1accf5fb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:24.185112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da8a2-270f-4344-bda5-0c9c1accf5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:24.238405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3d8da8a2-270f-4344-bda5-0c9c1accf5fb None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:24.247734 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3d8da8a2-270f-4344-bda5-0c9c1accf5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:24.252195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bc651caf-4650-4844-8892-232cfbceb6f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04bd58e422694302b34c6a2f377e6f2f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:24.253808 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bc651caf-4650-4844-8892-232cfbceb6f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04bd58e422694302b34c6a2f377e6f2f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:24.260704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:24.276060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 900/1794] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:19:24.281103 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8da8a2-270f-4344-bda5-0c9c1accf5fb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:24.285566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bc651caf-4650-4844-8892-232cfbceb6f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04bd58e422694302b34c6a2f377e6f2f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:24.318470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bc651caf-4650-4844-8892-232cfbceb6f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04bd58e422694302b34c6a2f377e6f2f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:24.320293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8da8a2-270f-4344-bda5-0c9c1accf5fb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:24.328559 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad744a9-32f4-48cb-953c-6d26aa7a23c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:24.329477 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad744a9-32f4-48cb-953c-6d26aa7a23c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:24.329963 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad744a9-32f4-48cb-953c-6d26aa7a23c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:24.331296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad744a9-32f4-48cb-953c-6d26aa7a23c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:24.332374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad744a9-32f4-48cb-953c-6d26aa7a23c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:24.334435 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bc651caf-4650-4844-8892-232cfbceb6f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04bd58e422694302b34c6a2f377e6f2f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:24.334812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad744a9-32f4-48cb-953c-6d26aa7a23c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:24.337288 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad744a9-32f4-48cb-953c-6d26aa7a23c3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:24.358149 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 901/1795] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:24.361142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c6e8-7588-41a0-80e0-5fa46a4bde10 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:24.361463 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c6e8-7588-41a0-80e0-5fa46a4bde10 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:24.361788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c6e8-7588-41a0-80e0-5fa46a4bde10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:24.408399 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 895/1796] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:23 2022] DELETE /identity/v3/users/04bd58e422694302b34c6a2f377e6f2f => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:24.409571 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc651caf-4650-4844-8892-232cfbceb6f3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:24.420422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-93d2c6e8-7588-41a0-80e0-5fa46a4bde10 None None] MFA Rules not processed for user `a672e63fa5e345679bac3d67301fe875`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:24.421758 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-93d2c6e8-7588-41a0-80e0-5fa46a4bde10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:24.628497 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 902/1797] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Sep 13 01:19:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:24.671905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc651caf-4650-4844-8892-232cfbceb6f3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:24.693444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb44025-64a1-4b96-a5d2-89db822523da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:24.696805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb44025-64a1-4b96-a5d2-89db822523da admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:24.698891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb44025-64a1-4b96-a5d2-89db822523da admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:24.700075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb44025-64a1-4b96-a5d2-89db822523da admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:24.706845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb44025-64a1-4b96-a5d2-89db822523da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:24.712164 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb44025-64a1-4b96-a5d2-89db822523da admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:24.751892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2c6e8-7588-41a0-80e0-5fa46a4bde10 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:24.754652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-93d2c6e8-7588-41a0-80e0-5fa46a4bde10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:24.816392 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2c6e8-7588-41a0-80e0-5fa46a4bde10 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:24.829830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 896/1798] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:24 2022] POST /identity/v3/projects => generated 399 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:24.832708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f9c74-04db-406a-acf4-d5b3ab920cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:24.833656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f9c74-04db-406a-acf4-d5b3ab920cfe service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:24.833939 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f9c74-04db-406a-acf4-d5b3ab920cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:24.834214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f9c74-04db-406a-acf4-d5b3ab920cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:24.846675 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f9c74-04db-406a-acf4-d5b3ab920cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:24.848292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb44025-64a1-4b96-a5d2-89db822523da admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:24.849344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f9c74-04db-406a-acf4-d5b3ab920cfe service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:24.869507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 903/1799] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:24.871633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f9c74-04db-406a-acf4-d5b3ab920cfe service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:24.873788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a19f9c74-04db-406a-acf4-d5b3ab920cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:24.913689 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:25.096976 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f9c74-04db-406a-acf4-d5b3ab920cfe service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:25.130903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb44025-64a1-4b96-a5d2-89db822523da admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:25.150704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced05fbc-2112-4850-a320-0eead69124b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:25.151527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05fbc-2112-4850-a320-0eead69124b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:25.153497 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05fbc-2112-4850-a320-0eead69124b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:25.153846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05fbc-2112-4850-a320-0eead69124b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:25.154974 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced05fbc-2112-4850-a320-0eead69124b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:25.161040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced05fbc-2112-4850-a320-0eead69124b9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:25.220174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8a152-a8e6-49a5-b26e-715be1ee005e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:25.221085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8a152-a8e6-49a5-b26e-715be1ee005e service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:25.221568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8a152-a8e6-49a5-b26e-715be1ee005e service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:25.221674 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8a152-a8e6-49a5-b26e-715be1ee005e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:25.227176 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-09b8a152-a8e6-49a5-b26e-715be1ee005e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:25.326319 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 897/1800] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:24 2022] POST /identity/v3/users => generated 300 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:25.335707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b20c7d-6826-4577-b157-099955d725bf None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:25.336178 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b20c7d-6826-4577-b157-099955d725bf None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:25.336554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b20c7d-6826-4577-b157-099955d725bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:25.417133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-d5b20c7d-6826-4577-b157-099955d725bf None None] MFA Rules not processed for user `2821b1a941c543a0aac6f56385c3c8be`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:25.417133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d5b20c7d-6826-4577-b157-099955d725bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:25.430872 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8a152-a8e6-49a5-b26e-715be1ee005e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:25.434647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8a152-a8e6-49a5-b26e-715be1ee005e service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:25.461085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 904/1801] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:25.462213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8a152-a8e6-49a5-b26e-715be1ee005e service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:25.493349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8a152-a8e6-49a5-b26e-715be1ee005e service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:25.507931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ec8f0-6928-45b8-a7a5-5f63f950b645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:25.509388 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ec8f0-6928-45b8-a7a5-5f63f950b645 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:25.511293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ec8f0-6928-45b8-a7a5-5f63f950b645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:25.511692 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ec8f0-6928-45b8-a7a5-5f63f950b645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:25.512476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ec8f0-6928-45b8-a7a5-5f63f950b645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:25.514807 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ec8f0-6928-45b8-a7a5-5f63f950b645 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:25.547262 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 905/1802] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:25.551289 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ec8f0-6928-45b8-a7a5-5f63f950b645 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:25.572573 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ec8f0-6928-45b8-a7a5-5f63f950b645 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:25.585078 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:25.585325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2b4ad-14b2-4ba7-8e68-17e69490fe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:25.586150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2b4ad-14b2-4ba7-8e68-17e69490fe07 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:25.586546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2b4ad-14b2-4ba7-8e68-17e69490fe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:25.586945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2b4ad-14b2-4ba7-8e68-17e69490fe07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:25.587994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2b4ad-14b2-4ba7-8e68-17e69490fe07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:25.590498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2b4ad-14b2-4ba7-8e68-17e69490fe07 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:25.624198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 906/1803] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:19:25.625470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2b4ad-14b2-4ba7-8e68-17e69490fe07 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:25.646676 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 898/1804] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:25.646920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2b4ad-14b2-4ba7-8e68-17e69490fe07 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:25.666597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229e489-3845-408b-8340-67643b673fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:25.671009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229e489-3845-408b-8340-67643b673fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:25.671472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229e489-3845-408b-8340-67643b673fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:25.672328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229e489-3845-408b-8340-67643b673fc2 admin admin] PATH_INFO: `/v3/projects/0b5ca451b5b04449a8d4c6f31507117a/users/5432c812eb9744b3bfbb5605b67b48e4/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:25.744044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229e489-3845-408b-8340-67643b673fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5ca451b5b04449a8d4c6f31507117a, user_id=5432c812eb9744b3bfbb5605b67b48e4, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:25.746868 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229e489-3845-408b-8340-67643b673fc2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:25.796117 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 907/1805] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:25 2022] PUT /identity/v3/projects/0b5ca451b5b04449a8d4c6f31507117a/users/5432c812eb9744b3bfbb5605b67b48e4/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:25.812482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d8b20-4e5b-4942-88a7-4a2b5db13089 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:25.812631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d8b20-4e5b-4942-88a7-4a2b5db13089 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:25.812822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d8b20-4e5b-4942-88a7-4a2b5db13089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:25.895247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-fc7d8b20-4e5b-4942-88a7-4a2b5db13089 None None] MFA Rules not processed for user `5432c812eb9744b3bfbb5605b67b48e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:25.898125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fc7d8b20-4e5b-4942-88a7-4a2b5db13089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:26.041649 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 899/1806] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:26.046858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229e489-3845-408b-8340-67643b673fc2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:26.144228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:26.160448 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d8b20-4e5b-4942-88a7-4a2b5db13089 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:26.165602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fc7d8b20-4e5b-4942-88a7-4a2b5db13089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:26.244641 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229e489-3845-408b-8340-67643b673fc2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:26.269280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ec9ae-b7bc-4f67-851c-8634a994e24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:26.269909 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ec9ae-b7bc-4f67-851c-8634a994e24e admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:26.270187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ec9ae-b7bc-4f67-851c-8634a994e24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:26.270460 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ec9ae-b7bc-4f67-851c-8634a994e24e admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:26.272358 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ec9ae-b7bc-4f67-851c-8634a994e24e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:26.275604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ec9ae-b7bc-4f67-851c-8634a994e24e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:26.352427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d8b20-4e5b-4942-88a7-4a2b5db13089 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:26.357330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 908/1807] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:26 2022] POST /identity/v3/projects => generated 401 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:26.359375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ec9ae-b7bc-4f67-851c-8634a994e24e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:26.438247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5315e-b3c7-4b92-a735-158e5ab152b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:26.439242 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5315e-b3c7-4b92-a735-158e5ab152b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:26.439689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5315e-b3c7-4b92-a735-158e5ab152b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:26.440243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5315e-b3c7-4b92-a735-158e5ab152b7 admin admin] PATH_INFO: `/v3/projects/0458407970f54849bee0ae89ab1c33e2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:26.441595 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5315e-b3c7-4b92-a735-158e5ab152b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0458407970f54849bee0ae89ab1c33e2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:26.445414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5315e-b3c7-4b92-a735-158e5ab152b7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:26.492415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:26.503012 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ec9ae-b7bc-4f67-851c-8634a994e24e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:26.540626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a6e5315e-b3c7-4b92-a735-158e5ab152b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0458407970f54849bee0ae89ab1c33e2', 'request_id': 'req-a6e5315e-b3c7-4b92-a735-158e5ab152b7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:26.559344 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a6e5315e-b3c7-4b92-a735-158e5ab152b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0458407970f54849bee0ae89ab1c33e2', 'request_id': 'req-a6e5315e-b3c7-4b92-a735-158e5ab152b7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:26.579906 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a6e5315e-b3c7-4b92-a735-158e5ab152b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0458407970f54849bee0ae89ab1c33e2', 'request_id': 'req-a6e5315e-b3c7-4b92-a735-158e5ab152b7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:26.611038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a6e5315e-b3c7-4b92-a735-158e5ab152b7 admin admin] The token cache is being invalidate because project 0458407970f54849bee0ae89ab1c33e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:26.611631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a6e5315e-b3c7-4b92-a735-158e5ab152b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:26.613051 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a6e5315e-b3c7-4b92-a735-158e5ab152b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:26.621681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 900/1808] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:26 2022] DELETE /identity/v3/projects/0458407970f54849bee0ae89ab1c33e2 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:26.623231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2358a-b8c6-4326-b98f-dfa396355e8c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:26.623831 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2358a-b8c6-4326-b98f-dfa396355e8c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:26.624442 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2358a-b8c6-4326-b98f-dfa396355e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:26.641250 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd01e9-970f-4da5-992f-2e5f06ad9f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:26.642114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd01e9-970f-4da5-992f-2e5f06ad9f2e admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:26.642681 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd01e9-970f-4da5-992f-2e5f06ad9f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:26.643210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd01e9-970f-4da5-992f-2e5f06ad9f2e admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:26.644018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd01e9-970f-4da5-992f-2e5f06ad9f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:26.647370 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd01e9-970f-4da5-992f-2e5f06ad9f2e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:26.658766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e0f2358a-b8c6-4326-b98f-dfa396355e8c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:26.660903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e0f2358a-b8c6-4326-b98f-dfa396355e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:26.680516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 901/1809] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:26.681670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2358a-b8c6-4326-b98f-dfa396355e8c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:26.683488 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e0f2358a-b8c6-4326-b98f-dfa396355e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:26.704520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 909/1810] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:26 2022] POST /identity/v3/users => generated 307 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:26.706033 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec878f7a-73a4-4dac-8e4e-d1f0b1479552 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:26.706359 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec878f7a-73a4-4dac-8e4e-d1f0b1479552 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:26.706637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec878f7a-73a4-4dac-8e4e-d1f0b1479552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:26.761157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ec878f7a-73a4-4dac-8e4e-d1f0b1479552 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:26.762565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ec878f7a-73a4-4dac-8e4e-d1f0b1479552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:26.768257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2358a-b8c6-4326-b98f-dfa396355e8c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:26.775368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5a621-9b9f-4950-b5ea-f3bfebf52893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:26.777240 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5a621-9b9f-4950-b5ea-f3bfebf52893 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:26.777893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5a621-9b9f-4950-b5ea-f3bfebf52893 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:26.778469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5a621-9b9f-4950-b5ea-f3bfebf52893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:26.780905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-11f5a621-9b9f-4950-b5ea-f3bfebf52893 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:26.781481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 910/1811] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:26.785230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec878f7a-73a4-4dac-8e4e-d1f0b1479552 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:26.789631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ec878f7a-73a4-4dac-8e4e-d1f0b1479552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:26.820544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec878f7a-73a4-4dac-8e4e-d1f0b1479552 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:26.834669 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d051a1-456d-4252-848c-23142c09bed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:26.835495 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d051a1-456d-4252-848c-23142c09bed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:26.835799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d051a1-456d-4252-848c-23142c09bed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:26.836034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d051a1-456d-4252-848c-23142c09bed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:26.836687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d051a1-456d-4252-848c-23142c09bed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:26.838300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d051a1-456d-4252-848c-23142c09bed9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:26.877843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 911/1812] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:26.877843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d051a1-456d-4252-848c-23142c09bed9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:26.901238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d051a1-456d-4252-848c-23142c09bed9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:26.913931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f2b3d-c84a-4c4f-b731-ff15d6c15e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:26.914561 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f2b3d-c84a-4c4f-b731-ff15d6c15e69 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:26.914884 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f2b3d-c84a-4c4f-b731-ff15d6c15e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:26.915191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f2b3d-c84a-4c4f-b731-ff15d6c15e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:26.915985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f2b3d-c84a-4c4f-b731-ff15d6c15e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:26.916298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f2b3d-c84a-4c4f-b731-ff15d6c15e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:26.917901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f2b3d-c84a-4c4f-b731-ff15d6c15e69 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:26.933889 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 912/1813] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:26.934746 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f2b3d-c84a-4c4f-b731-ff15d6c15e69 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:26.948920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f2b3d-c84a-4c4f-b731-ff15d6c15e69 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:26.955795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011a04e-f0f7-49eb-b9e4-3b5b460d02e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:26.955795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011a04e-f0f7-49eb-b9e4-3b5b460d02e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:26.956077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011a04e-f0f7-49eb-b9e4-3b5b460d02e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:26.956304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011a04e-f0f7-49eb-b9e4-3b5b460d02e6 admin admin] PATH_INFO: `/v3/projects/e461b93cf281411da5658448241ecde7/users/acceecea2d794f83ad18107cd4ace59e/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:26.960270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5a621-9b9f-4950-b5ea-f3bfebf52893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:26.961755 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5a621-9b9f-4950-b5ea-f3bfebf52893 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:26.976644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011a04e-f0f7-49eb-b9e4-3b5b460d02e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e461b93cf281411da5658448241ecde7, user_id=acceecea2d794f83ad18107cd4ace59e, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:26.979917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011a04e-f0f7-49eb-b9e4-3b5b460d02e6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:26.981006 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 902/1814] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:26.981851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5a621-9b9f-4950-b5ea-f3bfebf52893 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:27.000926 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:27.010488 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5a621-9b9f-4950-b5ea-f3bfebf52893 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:27.011912 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 913/1815] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:26 2022] PUT /identity/v3/projects/e461b93cf281411da5658448241ecde7/users/acceecea2d794f83ad18107cd4ace59e/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:27.014120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011a04e-f0f7-49eb-b9e4-3b5b460d02e6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:27.152214 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:27.166709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a227b3f-fda3-4289-a5d7-1c403728ba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:27.168206 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a227b3f-fda3-4289-a5d7-1c403728ba8e admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:27.168496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a227b3f-fda3-4289-a5d7-1c403728ba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:27.168775 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a227b3f-fda3-4289-a5d7-1c403728ba8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:27.169448 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a227b3f-fda3-4289-a5d7-1c403728ba8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:27.171407 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a227b3f-fda3-4289-a5d7-1c403728ba8e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:27.190535 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011a04e-f0f7-49eb-b9e4-3b5b460d02e6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:27.212028 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cbcb9-49b5-4f74-be09-6d17ad68da46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:27.215341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cbcb9-49b5-4f74-be09-6d17ad68da46 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:27.219349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cbcb9-49b5-4f74-be09-6d17ad68da46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:27.221370 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cbcb9-49b5-4f74-be09-6d17ad68da46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:27.222172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cbcb9-49b5-4f74-be09-6d17ad68da46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:27.226876 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cbcb9-49b5-4f74-be09-6d17ad68da46 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:27.230325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 903/1816] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:26 2022] POST /identity/v3/projects => generated 363 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:27.234057 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a227b3f-fda3-4289-a5d7-1c403728ba8e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:27.274621 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 914/1817] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:27.282764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cbcb9-49b5-4f74-be09-6d17ad68da46 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:27.324191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cbcb9-49b5-4f74-be09-6d17ad68da46 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:27.476775 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a227b3f-fda3-4289-a5d7-1c403728ba8e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:27.521079 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fb947-79f9-4eeb-a46e-cd9134587d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:27.525194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fb947-79f9-4eeb-a46e-cd9134587d63 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:27.525513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fb947-79f9-4eeb-a46e-cd9134587d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:27.529482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fb947-79f9-4eeb-a46e-cd9134587d63 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:27.531821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fb947-79f9-4eeb-a46e-cd9134587d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:27.541990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fb947-79f9-4eeb-a46e-cd9134587d63 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:27.566365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78618531-28f1-4ebf-8607-43e54d17c59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:27.568481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78618531-28f1-4ebf-8607-43e54d17c59b admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:27.569089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78618531-28f1-4ebf-8607-43e54d17c59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:27.569430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78618531-28f1-4ebf-8607-43e54d17c59b admin admin] PATH_INFO: `/v3/projects/e461b93cf281411da5658448241ecde7/users/acceecea2d794f83ad18107cd4ace59e/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:27.578969 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78618531-28f1-4ebf-8607-43e54d17c59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e461b93cf281411da5658448241ecde7, user_id=acceecea2d794f83ad18107cd4ace59e, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:27.600667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78618531-28f1-4ebf-8607-43e54d17c59b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:27.638465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 915/1818] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:27 2022] PUT /identity/v3/projects/e461b93cf281411da5658448241ecde7/users/acceecea2d794f83ad18107cd4ace59e/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:27.654721 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5698db-db86-4c5e-9bd6-9fdb43d925f5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:27.657563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5698db-db86-4c5e-9bd6-9fdb43d925f5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:27.661942 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5698db-db86-4c5e-9bd6-9fdb43d925f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:27.671361 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 904/1819] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:27 2022] POST /identity/v3/users => generated 282 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:19:27.675041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fb947-79f9-4eeb-a46e-cd9134587d63 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:27.733393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fb947-79f9-4eeb-a46e-cd9134587d63 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:27.830051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-aa5698db-db86-4c5e-9bd6-9fdb43d925f5 None None] MFA Rules not processed for user `acceecea2d794f83ad18107cd4ace59e`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:27.838754 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-aa5698db-db86-4c5e-9bd6-9fdb43d925f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:27.972536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117dd04d-66e9-42c9-908a-841a715d3189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:27.974606 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117dd04d-66e9-42c9-908a-841a715d3189 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:27.975683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117dd04d-66e9-42c9-908a-841a715d3189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:27.976337 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117dd04d-66e9-42c9-908a-841a715d3189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:27.981958 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117dd04d-66e9-42c9-908a-841a715d3189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:27.986878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117dd04d-66e9-42c9-908a-841a715d3189 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:28.018666 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 905/1820] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:28.022706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117dd04d-66e9-42c9-908a-841a715d3189 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:28.047301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117dd04d-66e9-42c9-908a-841a715d3189 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:28.065953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109472bf-f42e-40a3-901a-867262eea209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:28.065953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109472bf-f42e-40a3-901a-867262eea209 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:28.065953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109472bf-f42e-40a3-901a-867262eea209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:28.065953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109472bf-f42e-40a3-901a-867262eea209 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:28.066505 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109472bf-f42e-40a3-901a-867262eea209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:28.071091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 916/1821] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:27 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:28.071887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109472bf-f42e-40a3-901a-867262eea209 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:28.092134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 906/1822] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:19:28.098364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5698db-db86-4c5e-9bd6-9fdb43d925f5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:28.111121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109472bf-f42e-40a3-901a-867262eea209 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:28.135206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:28.140999 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109472bf-f42e-40a3-901a-867262eea209 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:28.157487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3179bf6-d83b-44b0-8b3c-450bd5df9c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:28.158482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3179bf6-d83b-44b0-8b3c-450bd5df9c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:28.158997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3179bf6-d83b-44b0-8b3c-450bd5df9c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:28.159341 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3179bf6-d83b-44b0-8b3c-450bd5df9c9f admin admin] PATH_INFO: `/v3/projects/72b207a483694f24a133c2de332f0499/users/482da7c27a5b4d52af79ed659ee11cf2/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:28.215368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3179bf6-d83b-44b0-8b3c-450bd5df9c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b207a483694f24a133c2de332f0499, user_id=482da7c27a5b4d52af79ed659ee11cf2, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:28.221762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3179bf6-d83b-44b0-8b3c-450bd5df9c9f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:28.269860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 907/1823] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:28 2022] PUT /identity/v3/projects/72b207a483694f24a133c2de332f0499/users/482da7c27a5b4d52af79ed659ee11cf2/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:28.275421 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5698db-db86-4c5e-9bd6-9fdb43d925f5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:28.275926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55644410-0371-4f9d-a339-c152cfff8c7c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:28.275926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55644410-0371-4f9d-a339-c152cfff8c7c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:28.275926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55644410-0371-4f9d-a339-c152cfff8c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:28.330695 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-55644410-0371-4f9d-a339-c152cfff8c7c None None] MFA Rules not processed for user `482da7c27a5b4d52af79ed659ee11cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:28.332200 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-55644410-0371-4f9d-a339-c152cfff8c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:28.397327 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:28.438341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2695c7-f2aa-475e-a630-0560706bab90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:28.439157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2695c7-f2aa-475e-a630-0560706bab90 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:28.439579 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2695c7-f2aa-475e-a630-0560706bab90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:28.440025 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2695c7-f2aa-475e-a630-0560706bab90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:28.535190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 908/1824] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:19:28.539370 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55644410-0371-4f9d-a339-c152cfff8c7c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:28.603246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2695c7-f2aa-475e-a630-0560706bab90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:28.604831 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2695c7-f2aa-475e-a630-0560706bab90 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:28.628860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 917/1825] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:28 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:28.775358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55644410-0371-4f9d-a339-c152cfff8c7c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:28.778669 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2695c7-f2aa-475e-a630-0560706bab90 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:28.784789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b58de-9899-4d72-b0d5-41d1186ac5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:28.793787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2695c7-f2aa-475e-a630-0560706bab90 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:28.795834 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b58de-9899-4d72-b0d5-41d1186ac5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:28.797808 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b58de-9899-4d72-b0d5-41d1186ac5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:28.799932 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b58de-9899-4d72-b0d5-41d1186ac5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:28.800077 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b58de-9899-4d72-b0d5-41d1186ac5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:28.806820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe16596-da1e-409a-a847-eef416c48573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:28.807497 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe16596-da1e-409a-a847-eef416c48573 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:28.811657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b58de-9899-4d72-b0d5-41d1186ac5f2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:28.815190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe16596-da1e-409a-a847-eef416c48573 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:28.815190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe16596-da1e-409a-a847-eef416c48573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:28.820487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-efe16596-da1e-409a-a847-eef416c48573 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:28.890814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 909/1826] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:28 2022] POST /identity/v3/projects => generated 365 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:28.894071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b58de-9899-4d72-b0d5-41d1186ac5f2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:29.007532 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe16596-da1e-409a-a847-eef416c48573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:29.009142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe16596-da1e-409a-a847-eef416c48573 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:29.033608 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b58de-9899-4d72-b0d5-41d1186ac5f2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:29.041992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb0f72-fa8c-46a4-9990-23f6037142d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:29.042717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb0f72-fa8c-46a4-9990-23f6037142d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:29.043001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb0f72-fa8c-46a4-9990-23f6037142d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:29.043443 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb0f72-fa8c-46a4-9990-23f6037142d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:29.044377 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb0f72-fa8c-46a4-9990-23f6037142d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:29.047766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb0f72-fa8c-46a4-9990-23f6037142d4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:29.049904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 918/1827] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:28 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:19:29.084672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 910/1828] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:28 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:29.085308 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe16596-da1e-409a-a847-eef416c48573 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:29.104551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe16596-da1e-409a-a847-eef416c48573 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:29.111953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65968ed6-f33f-49be-9ac4-c0f0de0239bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:29.112398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65968ed6-f33f-49be-9ac4-c0f0de0239bc admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:29.113006 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65968ed6-f33f-49be-9ac4-c0f0de0239bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:29.113293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65968ed6-f33f-49be-9ac4-c0f0de0239bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:29.116525 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65968ed6-f33f-49be-9ac4-c0f0de0239bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:29.118687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65968ed6-f33f-49be-9ac4-c0f0de0239bc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:29.153341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 919/1829] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:19:29.166463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb0f72-fa8c-46a4-9990-23f6037142d4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:29.183016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb0f72-fa8c-46a4-9990-23f6037142d4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:29.222584 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ae698-4d5a-4db2-8613-ce9e5b3bdf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:29.225280 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ae698-4d5a-4db2-8613-ce9e5b3bdf54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:29.226238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ae698-4d5a-4db2-8613-ce9e5b3bdf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:29.230365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ae698-4d5a-4db2-8613-ce9e5b3bdf54 admin admin] PATH_INFO: `/v3/projects/f227f826ae3e49f4aeb95d61f85a24fb/users/91be53630cb34c3894d6eeebf152cdee/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:29.278465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ae698-4d5a-4db2-8613-ce9e5b3bdf54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f227f826ae3e49f4aeb95d61f85a24fb, user_id=91be53630cb34c3894d6eeebf152cdee, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:29.281761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ae698-4d5a-4db2-8613-ce9e5b3bdf54 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:29.314485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 911/1830] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:29 2022] PUT /identity/v3/projects/f227f826ae3e49f4aeb95d61f85a24fb/users/91be53630cb34c3894d6eeebf152cdee/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:29.315507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65968ed6-f33f-49be-9ac4-c0f0de0239bc admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:29.332422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65968ed6-f33f-49be-9ac4-c0f0de0239bc admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:29.356741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:29.615813 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304eb65-3662-4763-976a-a6079e90fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:29.616827 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304eb65-3662-4763-976a-a6079e90fe4a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:29.617315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304eb65-3662-4763-976a-a6079e90fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:29.617806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304eb65-3662-4763-976a-a6079e90fe4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:29.618678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304eb65-3662-4763-976a-a6079e90fe4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:29.620758 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304eb65-3662-4763-976a-a6079e90fe4a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:29.647566 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 920/1831] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:29.649878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ae698-4d5a-4db2-8613-ce9e5b3bdf54 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:29.685486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ae698-4d5a-4db2-8613-ce9e5b3bdf54 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:29.707057 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc70b53-ece2-4bf3-9990-d8543f1b44af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:29.707815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc70b53-ece2-4bf3-9990-d8543f1b44af admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:29.708847 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc70b53-ece2-4bf3-9990-d8543f1b44af admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:29.712139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc70b53-ece2-4bf3-9990-d8543f1b44af admin admin] PATH_INFO: `/v3/projects/f227f826ae3e49f4aeb95d61f85a24fb/users/91be53630cb34c3894d6eeebf152cdee/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:29.723006 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc70b53-ece2-4bf3-9990-d8543f1b44af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f227f826ae3e49f4aeb95d61f85a24fb, user_id=91be53630cb34c3894d6eeebf152cdee, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:29.738444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc70b53-ece2-4bf3-9990-d8543f1b44af admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:29.766419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:29.769981 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 912/1832] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:29 2022] PUT /identity/v3/projects/f227f826ae3e49f4aeb95d61f85a24fb/users/91be53630cb34c3894d6eeebf152cdee/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:29.781416 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c718867-36cd-48d3-a813-724424373a77 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:29.781834 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c718867-36cd-48d3-a813-724424373a77 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:29.782196 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c718867-36cd-48d3-a813-724424373a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:29.896776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2c718867-36cd-48d3-a813-724424373a77 None None] MFA Rules not processed for user `91be53630cb34c3894d6eeebf152cdee`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:29.900776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2c718867-36cd-48d3-a813-724424373a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:30.033032 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c1b27-7ffa-481d-ac80-10d1ee3e826b None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:30.033317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c1b27-7ffa-481d-ac80-10d1ee3e826b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:30.033595 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c1b27-7ffa-481d-ac80-10d1ee3e826b None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:30.040115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 913/1833] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 13 01:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:19:30.124961 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca245e0b-3a5a-463b-93ef-ac9921dbdf11 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:30.124961 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca245e0b-3a5a-463b-93ef-ac9921dbdf11 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:30.124961 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca245e0b-3a5a-463b-93ef-ac9921dbdf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:30.177919 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 921/1834] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:30.190431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c718867-36cd-48d3-a813-724424373a77 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:30.223424 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ca245e0b-3a5a-463b-93ef-ac9921dbdf11 None None] MFA Rules not processed for user `fadc83bec6be41979e1aa4d71f8fc2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:30.225567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ca245e0b-3a5a-463b-93ef-ac9921dbdf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:30.347498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c718867-36cd-48d3-a813-724424373a77 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:30.356904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4304178-bd29-4388-90e8-b20121b934e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:30.357498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4304178-bd29-4388-90e8-b20121b934e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:30.357785 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4304178-bd29-4388-90e8-b20121b934e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:30.358120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4304178-bd29-4388-90e8-b20121b934e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:30.388221 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 914/1835] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 13 01:19:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:19:30.393310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4304178-bd29-4388-90e8-b20121b934e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:30.398531 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4304178-bd29-4388-90e8-b20121b934e7 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:30.428084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 922/1836] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:30.618252 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca245e0b-3a5a-463b-93ef-ac9921dbdf11 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:30.647059 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca245e0b-3a5a-463b-93ef-ac9921dbdf11 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:30.652566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea823268-be26-48ba-a3d8-d38226bd9cdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:30.653994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea823268-be26-48ba-a3d8-d38226bd9cdc service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:30.654512 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea823268-be26-48ba-a3d8-d38226bd9cdc service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:30.655245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea823268-be26-48ba-a3d8-d38226bd9cdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:30.727609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea823268-be26-48ba-a3d8-d38226bd9cdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:30.729305 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea823268-be26-48ba-a3d8-d38226bd9cdc service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:30.749810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 915/1837] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:30.941548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f03d65-7fb0-47c3-b9ee-e2e777dbf58a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:30.942264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f03d65-7fb0-47c3-b9ee-e2e777dbf58a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:30.943991 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f03d65-7fb0-47c3-b9ee-e2e777dbf58a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:30.946487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 923/1838] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 13 01:19:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:19:31.068118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff3fb6-90c4-428f-b386-c2051bc0fd2d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:31.069964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff3fb6-90c4-428f-b386-c2051bc0fd2d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:31.070605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff3fb6-90c4-428f-b386-c2051bc0fd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:31.156147 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f1ff3fb6-90c4-428f-b386-c2051bc0fd2d None None] MFA Rules not processed for user `fadc83bec6be41979e1aa4d71f8fc2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:31.161726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f1ff3fb6-90c4-428f-b386-c2051bc0fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:31.211044 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 916/1839] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 13 01:19:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:31.511427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f03d65-7fb0-47c3-b9ee-e2e777dbf58a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:31.512552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-19f03d65-7fb0-47c3-b9ee-e2e777dbf58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:31.537274 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f03d65-7fb0-47c3-b9ee-e2e777dbf58a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:31.556711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7f874-324c-4cc9-812f-24f225ab5376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:31.558665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7f874-324c-4cc9-812f-24f225ab5376 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:31.560174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7f874-324c-4cc9-812f-24f225ab5376 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:31.560598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7f874-324c-4cc9-812f-24f225ab5376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:31.583471 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7f874-324c-4cc9-812f-24f225ab5376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:31.587490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7f874-324c-4cc9-812f-24f225ab5376 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:31.624404 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 924/1840] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:31.852721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff3fb6-90c4-428f-b386-c2051bc0fd2d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:31.876537 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff3fb6-90c4-428f-b386-c2051bc0fd2d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:31.925401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1338c-23ad-4c4c-b6a3-12dc70f4d8b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:31.932635 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1338c-23ad-4c4c-b6a3-12dc70f4d8b6 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:31.933356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1338c-23ad-4c4c-b6a3-12dc70f4d8b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:31.939929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1338c-23ad-4c4c-b6a3-12dc70f4d8b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:31.945204 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7f874-324c-4cc9-812f-24f225ab5376 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:31.946789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-18c7f874-324c-4cc9-812f-24f225ab5376 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:32.001034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:32.031788 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1338c-23ad-4c4c-b6a3-12dc70f4d8b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:32.046569 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1338c-23ad-4c4c-b6a3-12dc70f4d8b6 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:32.112160 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 917/1841] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:32.128924 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7f874-324c-4cc9-812f-24f225ab5376 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:32.157286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaffc3-10fb-4be0-9f4a-8f5ac5f522ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:32.157945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaffc3-10fb-4be0-9f4a-8f5ac5f522ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:32.158226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaffc3-10fb-4be0-9f4a-8f5ac5f522ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:32.158500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaffc3-10fb-4be0-9f4a-8f5ac5f522ce admin admin] PATH_INFO: `/v3/users/90f9b3b9e5fc4d7783bfdf3214ad0453` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:32.162607 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaffc3-10fb-4be0-9f4a-8f5ac5f522ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f9b3b9e5fc4d7783bfdf3214ad0453)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:32.166835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaffc3-10fb-4be0-9f4a-8f5ac5f522ce admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:32.339781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cceaffc3-10fb-4be0-9f4a-8f5ac5f522ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f9b3b9e5fc4d7783bfdf3214ad0453'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:32.340761 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cceaffc3-10fb-4be0-9f4a-8f5ac5f522ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f9b3b9e5fc4d7783bfdf3214ad0453'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:32.365151 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cceaffc3-10fb-4be0-9f4a-8f5ac5f522ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f9b3b9e5fc4d7783bfdf3214ad0453'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:32.412743 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cceaffc3-10fb-4be0-9f4a-8f5ac5f522ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f9b3b9e5fc4d7783bfdf3214ad0453'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:32.413582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cceaffc3-10fb-4be0-9f4a-8f5ac5f522ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f9b3b9e5fc4d7783bfdf3214ad0453'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:32.441784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 925/1842] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:31 2022] DELETE /identity/v3/users/90f9b3b9e5fc4d7783bfdf3214ad0453 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:32.447888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303f9d9-f792-4612-9346-1741b03a5116 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:32.448248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303f9d9-f792-4612-9346-1741b03a5116 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:32.448494 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303f9d9-f792-4612-9346-1741b03a5116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:32.515158 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c303f9d9-f792-4612-9346-1741b03a5116 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:32.516492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c303f9d9-f792-4612-9346-1741b03a5116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:32.704924 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 918/1843] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:32.717767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaffc3-10fb-4be0-9f4a-8f5ac5f522ce admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:32.719402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cceaffc3-10fb-4be0-9f4a-8f5ac5f522ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:32.857527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaffc3-10fb-4be0-9f4a-8f5ac5f522ce admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:32.862530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec7a07-6242-4892-b2e3-8c1111627944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:32.863912 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec7a07-6242-4892-b2e3-8c1111627944 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:32.864889 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec7a07-6242-4892-b2e3-8c1111627944 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:32.866390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec7a07-6242-4892-b2e3-8c1111627944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:32.879957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec7a07-6242-4892-b2e3-8c1111627944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:32.882431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec7a07-6242-4892-b2e3-8c1111627944 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:32.897352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 926/1844] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:33.585455 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303f9d9-f792-4612-9346-1741b03a5116 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:33.588765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c303f9d9-f792-4612-9346-1741b03a5116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:33.612398 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303f9d9-f792-4612-9346-1741b03a5116 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:33.639955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a092e-8420-48e3-b5a0-2c697c72c91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:33.641122 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a092e-8420-48e3-b5a0-2c697c72c91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:33.658845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a092e-8420-48e3-b5a0-2c697c72c91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:33.659991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a092e-8420-48e3-b5a0-2c697c72c91c admin admin] PATH_INFO: `/v3/projects/480859af39c64adbbff20647d51b1cb7` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:33.663875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a092e-8420-48e3-b5a0-2c697c72c91c admin admin] RBAC: Authorizing `identity:delete_project(project_id=480859af39c64adbbff20647d51b1cb7)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:33.668609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a092e-8420-48e3-b5a0-2c697c72c91c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:33.698229 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:33.800463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c57a092e-8420-48e3-b5a0-2c697c72c91c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480859af39c64adbbff20647d51b1cb7', 'request_id': 'req-c57a092e-8420-48e3-b5a0-2c697c72c91c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:33.824921 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c57a092e-8420-48e3-b5a0-2c697c72c91c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480859af39c64adbbff20647d51b1cb7', 'request_id': 'req-c57a092e-8420-48e3-b5a0-2c697c72c91c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:33.852473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c57a092e-8420-48e3-b5a0-2c697c72c91c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480859af39c64adbbff20647d51b1cb7', 'request_id': 'req-c57a092e-8420-48e3-b5a0-2c697c72c91c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:33.886907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c57a092e-8420-48e3-b5a0-2c697c72c91c admin admin] The token cache is being invalidate because project 480859af39c64adbbff20647d51b1cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:33.887231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c57a092e-8420-48e3-b5a0-2c697c72c91c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:33.888765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c57a092e-8420-48e3-b5a0-2c697c72c91c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:33.895156 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 919/1845] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:33 2022] DELETE /identity/v3/projects/480859af39c64adbbff20647d51b1cb7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:33.903124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec7a07-6242-4892-b2e3-8c1111627944 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:33.918647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec7a07-6242-4892-b2e3-8c1111627944 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:33.981645 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:34.002791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ca685-cf3d-4e7c-9e6b-96c7a1a4ef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:34.004414 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ca685-cf3d-4e7c-9e6b-96c7a1a4ef54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:34.004697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ca685-cf3d-4e7c-9e6b-96c7a1a4ef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:34.005175 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ca685-cf3d-4e7c-9e6b-96c7a1a4ef54 admin admin] PATH_INFO: `/v3/users/765ddad0e47941b58762e53d8229767c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:34.006834 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ca685-cf3d-4e7c-9e6b-96c7a1a4ef54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=765ddad0e47941b58762e53d8229767c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:34.008905 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ca685-cf3d-4e7c-9e6b-96c7a1a4ef54 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:34.086805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6c6ca685-cf3d-4e7c-9e6b-96c7a1a4ef54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765ddad0e47941b58762e53d8229767c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.087504 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6c6ca685-cf3d-4e7c-9e6b-96c7a1a4ef54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765ddad0e47941b58762e53d8229767c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.095441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6c6ca685-cf3d-4e7c-9e6b-96c7a1a4ef54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765ddad0e47941b58762e53d8229767c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.108800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6c6ca685-cf3d-4e7c-9e6b-96c7a1a4ef54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765ddad0e47941b58762e53d8229767c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.109534 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6c6ca685-cf3d-4e7c-9e6b-96c7a1a4ef54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765ddad0e47941b58762e53d8229767c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.122965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 927/1846] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:33 2022] DELETE /identity/v3/users/765ddad0e47941b58762e53d8229767c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:34.468564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a092e-8420-48e3-b5a0-2c697c72c91c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:34.470432 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c57a092e-8420-48e3-b5a0-2c697c72c91c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:34.507907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a092e-8420-48e3-b5a0-2c697c72c91c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:34.538221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ca685-cf3d-4e7c-9e6b-96c7a1a4ef54 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:34.539727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6c6ca685-cf3d-4e7c-9e6b-96c7a1a4ef54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:34.572904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb2a61-73b7-4032-8435-465132a2b42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:34.574260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb2a61-73b7-4032-8435-465132a2b42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:34.574552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb2a61-73b7-4032-8435-465132a2b42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:34.574933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb2a61-73b7-4032-8435-465132a2b42a admin admin] PATH_INFO: `/v3/projects/865f94525e27442ebe1ac89cbd75e909` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:34.576135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb2a61-73b7-4032-8435-465132a2b42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=865f94525e27442ebe1ac89cbd75e909)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:34.578095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb2a61-73b7-4032-8435-465132a2b42a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:34.616724 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ca685-cf3d-4e7c-9e6b-96c7a1a4ef54 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:34.622414 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ba564-e45b-4b62-a70c-f0615dfe00d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:34.623081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ba564-e45b-4b62-a70c-f0615dfe00d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:34.623383 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ba564-e45b-4b62-a70c-f0615dfe00d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:34.623658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ba564-e45b-4b62-a70c-f0615dfe00d8 admin admin] PATH_INFO: `/v3/users/482da7c27a5b4d52af79ed659ee11cf2` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:34.624831 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ba564-e45b-4b62-a70c-f0615dfe00d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=482da7c27a5b4d52af79ed659ee11cf2)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:34.626762 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ba564-e45b-4b62-a70c-f0615dfe00d8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:34.636006 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-13fb2a61-73b7-4032-8435-465132a2b42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '865f94525e27442ebe1ac89cbd75e909', 'request_id': 'req-13fb2a61-73b7-4032-8435-465132a2b42a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.644107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-13fb2a61-73b7-4032-8435-465132a2b42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '865f94525e27442ebe1ac89cbd75e909', 'request_id': 'req-13fb2a61-73b7-4032-8435-465132a2b42a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.650490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-13fb2a61-73b7-4032-8435-465132a2b42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '865f94525e27442ebe1ac89cbd75e909', 'request_id': 'req-13fb2a61-73b7-4032-8435-465132a2b42a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.666202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-13fb2a61-73b7-4032-8435-465132a2b42a admin admin] The token cache is being invalidate because project 865f94525e27442ebe1ac89cbd75e909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:34.666921 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-13fb2a61-73b7-4032-8435-465132a2b42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.667845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-13fb2a61-73b7-4032-8435-465132a2b42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.669849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 920/1847] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:34 2022] DELETE /identity/v3/projects/865f94525e27442ebe1ac89cbd75e909 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:34.674808 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc22b2-30e7-4da3-a967-ae216f36bdb6 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:34.675217 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc22b2-30e7-4da3-a967-ae216f36bdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:34.675506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc22b2-30e7-4da3-a967-ae216f36bdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:34.683352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fc4ba564-e45b-4b62-a70c-f0615dfe00d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '482da7c27a5b4d52af79ed659ee11cf2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.683352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fc4ba564-e45b-4b62-a70c-f0615dfe00d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '482da7c27a5b4d52af79ed659ee11cf2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.690608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fc4ba564-e45b-4b62-a70c-f0615dfe00d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '482da7c27a5b4d52af79ed659ee11cf2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.697385 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:34.702519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-54bc22b2-30e7-4da3-a967-ae216f36bdb6 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:34.704047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-54bc22b2-30e7-4da3-a967-ae216f36bdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:34.709762 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fc4ba564-e45b-4b62-a70c-f0615dfe00d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '482da7c27a5b4d52af79ed659ee11cf2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.711443 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fc4ba564-e45b-4b62-a70c-f0615dfe00d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '482da7c27a5b4d52af79ed659ee11cf2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.726243 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 928/1848] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:34 2022] DELETE /identity/v3/users/482da7c27a5b4d52af79ed659ee11cf2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:34.726907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:34.727819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ba564-e45b-4b62-a70c-f0615dfe00d8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:34.730627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fc4ba564-e45b-4b62-a70c-f0615dfe00d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:34.772307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 921/1849] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:34.773796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc7101-38d8-44b4-a7db-5637e8fb6cbe None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:34.773919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc7101-38d8-44b4-a7db-5637e8fb6cbe None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:34.774130 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc7101-38d8-44b4-a7db-5637e8fb6cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:34.795648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-91bc7101-38d8-44b4-a7db-5637e8fb6cbe None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:34.796308 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ba564-e45b-4b62-a70c-f0615dfe00d8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:34.796850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-91bc7101-38d8-44b4-a7db-5637e8fb6cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:34.800993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ededc6-b99f-4af2-989c-018d2fd78902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:34.801664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ededc6-b99f-4af2-989c-018d2fd78902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:34.801957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ededc6-b99f-4af2-989c-018d2fd78902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:34.802239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ededc6-b99f-4af2-989c-018d2fd78902 admin admin] PATH_INFO: `/v3/users/5432c812eb9744b3bfbb5605b67b48e4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:34.803457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ededc6-b99f-4af2-989c-018d2fd78902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5432c812eb9744b3bfbb5605b67b48e4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:34.804441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 922/1850] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:34.805364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ededc6-b99f-4af2-989c-018d2fd78902 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:34.805606 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709642e9-4596-41a2-8208-70134a672dae None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:34.805890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709642e9-4596-41a2-8208-70134a672dae None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:34.806160 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709642e9-4596-41a2-8208-70134a672dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:34.825653 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-709642e9-4596-41a2-8208-70134a672dae None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:34.826863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-709642e9-4596-41a2-8208-70134a672dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:34.836146 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 923/1851] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:34.837605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709642e9-4596-41a2-8208-70134a672dae None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:34.838836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-709642e9-4596-41a2-8208-70134a672dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:34.860617 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f7ededc6-b99f-4af2-989c-018d2fd78902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5432c812eb9744b3bfbb5605b67b48e4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.862577 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f7ededc6-b99f-4af2-989c-018d2fd78902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5432c812eb9744b3bfbb5605b67b48e4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.872709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f7ededc6-b99f-4af2-989c-018d2fd78902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5432c812eb9744b3bfbb5605b67b48e4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.887844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f7ededc6-b99f-4af2-989c-018d2fd78902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5432c812eb9744b3bfbb5605b67b48e4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.888590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f7ededc6-b99f-4af2-989c-018d2fd78902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5432c812eb9744b3bfbb5605b67b48e4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:34.905089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 929/1852] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:34 2022] DELETE /identity/v3/users/5432c812eb9744b3bfbb5605b67b48e4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:34.905089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ededc6-b99f-4af2-989c-018d2fd78902 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:34.908132 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f7ededc6-b99f-4af2-989c-018d2fd78902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:34.915394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709642e9-4596-41a2-8208-70134a672dae None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:34.983465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6515b-888f-437d-9164-e534039e478b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:34.983770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6515b-888f-437d-9164-e534039e478b service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:34.984008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6515b-888f-437d-9164-e534039e478b service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:34.984919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6515b-888f-437d-9164-e534039e478b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:34.987659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c8b6515b-888f-437d-9164-e534039e478b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:35.064428 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ededc6-b99f-4af2-989c-018d2fd78902 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:35.071297 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387c732-50a8-4bf5-af44-06c2d937bc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:35.072092 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387c732-50a8-4bf5-af44-06c2d937bc4b admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:35.072453 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387c732-50a8-4bf5-af44-06c2d937bc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:35.072708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387c732-50a8-4bf5-af44-06c2d937bc4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:35.073375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387c732-50a8-4bf5-af44-06c2d937bc4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:35.073685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387c732-50a8-4bf5-af44-06c2d937bc4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:35.075668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387c732-50a8-4bf5-af44-06c2d937bc4b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:35.078097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:35.095887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6515b-888f-437d-9164-e534039e478b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:35.099188 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6515b-888f-437d-9164-e534039e478b service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:35.117891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 924/1853] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:35.119502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d86953-e924-4df2-8b65-0095ff9427de None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:35.124642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 930/1854] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:35.124875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d86953-e924-4df2-8b65-0095ff9427de None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:35.125290 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d86953-e924-4df2-8b65-0095ff9427de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:35.128544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387c732-50a8-4bf5-af44-06c2d937bc4b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:35.144194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387c732-50a8-4bf5-af44-06c2d937bc4b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:35.161841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11208779-b85a-44ce-a1c9-8e9c73152442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:35.162554 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11208779-b85a-44ce-a1c9-8e9c73152442 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:35.162839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11208779-b85a-44ce-a1c9-8e9c73152442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:35.163378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11208779-b85a-44ce-a1c9-8e9c73152442 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:35.164821 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11208779-b85a-44ce-a1c9-8e9c73152442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:35.166751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11208779-b85a-44ce-a1c9-8e9c73152442 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:35.180374 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-66d86953-e924-4df2-8b65-0095ff9427de None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:35.184061 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-66d86953-e924-4df2-8b65-0095ff9427de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:35.194167 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 925/1855] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:35.204735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d86953-e924-4df2-8b65-0095ff9427de None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:35.206423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-66d86953-e924-4df2-8b65-0095ff9427de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:35.230010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d86953-e924-4df2-8b65-0095ff9427de None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:35.235222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea14da-b86a-44d6-80e4-272d6fd59d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:35.235879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea14da-b86a-44d6-80e4-272d6fd59d70 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:35.236189 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea14da-b86a-44d6-80e4-272d6fd59d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:35.236655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea14da-b86a-44d6-80e4-272d6fd59d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:35.243242 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 931/1856] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:35 2022] POST /identity/v3/projects => generated 409 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:35.247129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11208779-b85a-44ce-a1c9-8e9c73152442 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:35.263516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea14da-b86a-44d6-80e4-272d6fd59d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:35.269598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea14da-b86a-44d6-80e4-272d6fd59d70 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:35.274710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:35.293935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 926/1857] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:19:35.410243 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11208779-b85a-44ce-a1c9-8e9c73152442 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:35.425052 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2621354-e84a-4d4d-8bb9-256f31c3ca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:35.426399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2621354-e84a-4d4d-8bb9-256f31c3ca23 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:35.426860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2621354-e84a-4d4d-8bb9-256f31c3ca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:35.430773 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2621354-e84a-4d4d-8bb9-256f31c3ca23 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:35.432678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2621354-e84a-4d4d-8bb9-256f31c3ca23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:35.435553 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2621354-e84a-4d4d-8bb9-256f31c3ca23 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:35.468843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 932/1858] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:35 2022] POST /identity/v3/users => generated 305 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:35.473272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea14da-b86a-44d6-80e4-272d6fd59d70 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:35.485708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea14da-b86a-44d6-80e4-272d6fd59d70 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:35.493164 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12402904-7e40-4c7c-9528-fb147db903ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:35.494189 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12402904-7e40-4c7c-9528-fb147db903ee admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:35.494729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12402904-7e40-4c7c-9528-fb147db903ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:35.495406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12402904-7e40-4c7c-9528-fb147db903ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:35.496830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12402904-7e40-4c7c-9528-fb147db903ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:35.499294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12402904-7e40-4c7c-9528-fb147db903ee admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:35.521326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 927/1859] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:35.524736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2621354-e84a-4d4d-8bb9-256f31c3ca23 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:35.549740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2621354-e84a-4d4d-8bb9-256f31c3ca23 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:35.565498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201f7a6-aab5-4cf1-9377-fee99fae8408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:35.571051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201f7a6-aab5-4cf1-9377-fee99fae8408 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:35.571051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201f7a6-aab5-4cf1-9377-fee99fae8408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:35.571051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201f7a6-aab5-4cf1-9377-fee99fae8408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:35.571051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201f7a6-aab5-4cf1-9377-fee99fae8408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:35.578091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201f7a6-aab5-4cf1-9377-fee99fae8408 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:35.596501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 933/1860] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:35.596957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12402904-7e40-4c7c-9528-fb147db903ee admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:35.608807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12402904-7e40-4c7c-9528-fb147db903ee admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:35.616417 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a4883-39cc-4176-b1b6-7413d936bda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:35.617322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a4883-39cc-4176-b1b6-7413d936bda2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:35.617601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a4883-39cc-4176-b1b6-7413d936bda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:35.618080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a4883-39cc-4176-b1b6-7413d936bda2 admin admin] PATH_INFO: `/v3/projects/a18d6c5ca8d24cf5b17ec6081ebfbdb2/users/c7d22823839245558a4b3a842aace0a2/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:35.641427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a4883-39cc-4176-b1b6-7413d936bda2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18d6c5ca8d24cf5b17ec6081ebfbdb2, user_id=c7d22823839245558a4b3a842aace0a2, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:35.644543 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a4883-39cc-4176-b1b6-7413d936bda2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:35.673153 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 928/1861] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:35 2022] PUT /identity/v3/projects/a18d6c5ca8d24cf5b17ec6081ebfbdb2/users/c7d22823839245558a4b3a842aace0a2/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:35.686002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6eef5-9812-466e-94c6-29d9cc0e5e36 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:35.686292 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6eef5-9812-466e-94c6-29d9cc0e5e36 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:35.686599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6eef5-9812-466e-94c6-29d9cc0e5e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:35.722120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c8a6eef5-9812-466e-94c6-29d9cc0e5e36 None None] MFA Rules not processed for user `c7d22823839245558a4b3a842aace0a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:35.724016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c8a6eef5-9812-466e-94c6-29d9cc0e5e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:35.770346 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a4883-39cc-4176-b1b6-7413d936bda2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:35.772312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-067a4883-39cc-4176-b1b6-7413d936bda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:35.821948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 934/1862] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:35 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:35.823169 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6eef5-9812-466e-94c6-29d9cc0e5e36 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:35.824633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c8a6eef5-9812-466e-94c6-29d9cc0e5e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:35.860078 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a4883-39cc-4176-b1b6-7413d936bda2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:35.865362 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:35.865997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:35.866277 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:35.866553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a admin admin] PATH_INFO: `/v3/projects/72b207a483694f24a133c2de332f0499` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:35.867726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b207a483694f24a133c2de332f0499)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:35.869665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:35.870754 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:35.893971 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6eef5-9812-466e-94c6-29d9cc0e5e36 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:35.899776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339ae56-d392-41b4-b8ee-3c88892bbac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:35.900419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339ae56-d392-41b4-b8ee-3c88892bbac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:35.900688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339ae56-d392-41b4-b8ee-3c88892bbac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:35.901081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339ae56-d392-41b4-b8ee-3c88892bbac4 admin admin] PATH_INFO: `/v3/projects/0b5ca451b5b04449a8d4c6f31507117a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:35.902646 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339ae56-d392-41b4-b8ee-3c88892bbac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b5ca451b5b04449a8d4c6f31507117a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:35.904973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339ae56-d392-41b4-b8ee-3c88892bbac4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:35.924542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b207a483694f24a133c2de332f0499', 'request_id': 'req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:35.938284 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b207a483694f24a133c2de332f0499', 'request_id': 'req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:35.949001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b207a483694f24a133c2de332f0499', 'request_id': 'req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:35.965325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a admin admin] The token cache is being invalidate because project 72b207a483694f24a133c2de332f0499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:35.966367 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:35.967057 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:35.969422 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 929/1863] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:35 2022] DELETE /identity/v3/projects/72b207a483694f24a133c2de332f0499 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:35.969794 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4339ae56-d392-41b4-b8ee-3c88892bbac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5ca451b5b04449a8d4c6f31507117a', 'request_id': 'req-4339ae56-d392-41b4-b8ee-3c88892bbac4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:35.970333 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:35.973150 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:35.979901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4339ae56-d392-41b4-b8ee-3c88892bbac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5ca451b5b04449a8d4c6f31507117a', 'request_id': 'req-4339ae56-d392-41b4-b8ee-3c88892bbac4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:35.986726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4339ae56-d392-41b4-b8ee-3c88892bbac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5ca451b5b04449a8d4c6f31507117a', 'request_id': 'req-4339ae56-d392-41b4-b8ee-3c88892bbac4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:35.999606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4339ae56-d392-41b4-b8ee-3c88892bbac4 admin admin] The token cache is being invalidate because project 0b5ca451b5b04449a8d4c6f31507117a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:35.999606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4339ae56-d392-41b4-b8ee-3c88892bbac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:36.000326 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4339ae56-d392-41b4-b8ee-3c88892bbac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:36.002073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 935/1864] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:35 2022] DELETE /identity/v3/projects/0b5ca451b5b04449a8d4c6f31507117a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:36.003187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339ae56-d392-41b4-b8ee-3c88892bbac4 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:36.011239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4339ae56-d392-41b4-b8ee-3c88892bbac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:36.054006 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:36.090592 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda7cd8-e286-4a01-8bf2-0aaa3f46a23a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:36.157491 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339ae56-d392-41b4-b8ee-3c88892bbac4 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:36.165400 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd43c25-9a0f-43be-b7d2-1d67c63c8062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:36.166332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd43c25-9a0f-43be-b7d2-1d67c63c8062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:36.166735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd43c25-9a0f-43be-b7d2-1d67c63c8062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:36.167448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd43c25-9a0f-43be-b7d2-1d67c63c8062 admin admin] PATH_INFO: `/v3/users/91be53630cb34c3894d6eeebf152cdee` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:36.169315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd43c25-9a0f-43be-b7d2-1d67c63c8062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91be53630cb34c3894d6eeebf152cdee)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:36.176836 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd43c25-9a0f-43be-b7d2-1d67c63c8062 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:36.227090 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e65e4-1475-4b17-ad71-39f5ad3602a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:36.228268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e65e4-1475-4b17-ad71-39f5ad3602a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:36.228758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e65e4-1475-4b17-ad71-39f5ad3602a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:36.229251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e65e4-1475-4b17-ad71-39f5ad3602a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:36.231413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e65e4-1475-4b17-ad71-39f5ad3602a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:36.233819 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e65e4-1475-4b17-ad71-39f5ad3602a3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:36.293240 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bcd43c25-9a0f-43be-b7d2-1d67c63c8062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91be53630cb34c3894d6eeebf152cdee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:36.293936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bcd43c25-9a0f-43be-b7d2-1d67c63c8062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91be53630cb34c3894d6eeebf152cdee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:36.305864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bcd43c25-9a0f-43be-b7d2-1d67c63c8062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91be53630cb34c3894d6eeebf152cdee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:36.322265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:36.323389 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bcd43c25-9a0f-43be-b7d2-1d67c63c8062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91be53630cb34c3894d6eeebf152cdee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:36.324666 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bcd43c25-9a0f-43be-b7d2-1d67c63c8062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91be53630cb34c3894d6eeebf152cdee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:36.331131 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 930/1865] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:35 2022] POST /identity/v3/projects => generated 407 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:36.335030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e65e4-1475-4b17-ad71-39f5ad3602a3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:36.337387 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3b4e65e4-1475-4b17-ad71-39f5ad3602a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:36.350857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 936/1866] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:36 2022] DELETE /identity/v3/users/91be53630cb34c3894d6eeebf152cdee => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:36.350857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd43c25-9a0f-43be-b7d2-1d67c63c8062 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:36.351148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bcd43c25-9a0f-43be-b7d2-1d67c63c8062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:36.438383 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd43c25-9a0f-43be-b7d2-1d67c63c8062 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:36.445156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff55b7-23b9-4e78-99d0-cab321d62cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:36.446248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff55b7-23b9-4e78-99d0-cab321d62cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:36.446632 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff55b7-23b9-4e78-99d0-cab321d62cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:36.447123 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff55b7-23b9-4e78-99d0-cab321d62cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:36.448518 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff55b7-23b9-4e78-99d0-cab321d62cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:36.451315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff55b7-23b9-4e78-99d0-cab321d62cd0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:36.486413 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 937/1867] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:36 2022] POST /identity/v3/users => generated 310 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:36.486895 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e65e4-1475-4b17-ad71-39f5ad3602a3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:36.492159 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff55b7-23b9-4e78-99d0-cab321d62cd0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:36.495670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e5805-0894-4b38-bd69-2d0e9c2933bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:36.496766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e5805-0894-4b38-bd69-2d0e9c2933bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:36.497551 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e5805-0894-4b38-bd69-2d0e9c2933bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:36.498226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e5805-0894-4b38-bd69-2d0e9c2933bf admin admin] PATH_INFO: `/v3/users/acceecea2d794f83ad18107cd4ace59e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:36.500424 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e5805-0894-4b38-bd69-2d0e9c2933bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=acceecea2d794f83ad18107cd4ace59e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:36.503166 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e5805-0894-4b38-bd69-2d0e9c2933bf admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:36.505637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff55b7-23b9-4e78-99d0-cab321d62cd0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:36.512830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18531d3-e803-483a-acb2-d859980ccd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:36.513978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18531d3-e803-483a-acb2-d859980ccd0c admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:36.514631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18531d3-e803-483a-acb2-d859980ccd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:36.515373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18531d3-e803-483a-acb2-d859980ccd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:36.516429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18531d3-e803-483a-acb2-d859980ccd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:36.518655 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18531d3-e803-483a-acb2-d859980ccd0c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:36.539548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 938/1868] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:36.541448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18531d3-e803-483a-acb2-d859980ccd0c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:36.560286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18531d3-e803-483a-acb2-d859980ccd0c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:36.569598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60188509-1195-4032-b75f-faf346a3a51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:36.570818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60188509-1195-4032-b75f-faf346a3a51b admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:36.571434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60188509-1195-4032-b75f-faf346a3a51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:36.572115 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60188509-1195-4032-b75f-faf346a3a51b admin admin] PATH_INFO: `/v3/projects/06bee943ed314fd598ca7ae803eb6db1/users/800167ac5c77456eb517f14f43e7c6ad/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:36.572903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3b2e5805-0894-4b38-bd69-2d0e9c2933bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acceecea2d794f83ad18107cd4ace59e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:36.573627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3b2e5805-0894-4b38-bd69-2d0e9c2933bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acceecea2d794f83ad18107cd4ace59e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:36.599512 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3b2e5805-0894-4b38-bd69-2d0e9c2933bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acceecea2d794f83ad18107cd4ace59e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:36.604352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60188509-1195-4032-b75f-faf346a3a51b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06bee943ed314fd598ca7ae803eb6db1, user_id=800167ac5c77456eb517f14f43e7c6ad, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:36.608664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60188509-1195-4032-b75f-faf346a3a51b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:36.633166 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3b2e5805-0894-4b38-bd69-2d0e9c2933bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acceecea2d794f83ad18107cd4ace59e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:36.634544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3b2e5805-0894-4b38-bd69-2d0e9c2933bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acceecea2d794f83ad18107cd4ace59e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:36.650371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 939/1869] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:36 2022] PUT /identity/v3/projects/06bee943ed314fd598ca7ae803eb6db1/users/800167ac5c77456eb517f14f43e7c6ad/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:36.650371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60188509-1195-4032-b75f-faf346a3a51b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:36.659329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-60188509-1195-4032-b75f-faf346a3a51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:36.675876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 931/1870] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:36 2022] DELETE /identity/v3/users/acceecea2d794f83ad18107cd4ace59e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:36.827269 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60188509-1195-4032-b75f-faf346a3a51b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:36.911539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:36.925885 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9e890-630a-4eba-b17d-1ba57959e85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:36.926887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9e890-630a-4eba-b17d-1ba57959e85b admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:36.927362 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9e890-630a-4eba-b17d-1ba57959e85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:36.927796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9e890-630a-4eba-b17d-1ba57959e85b admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:36.930125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9e890-630a-4eba-b17d-1ba57959e85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:36.933031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9e890-630a-4eba-b17d-1ba57959e85b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:36.952981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 940/1871] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:36.957330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e5805-0894-4b38-bd69-2d0e9c2933bf admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:36.966080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:36.970905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e5805-0894-4b38-bd69-2d0e9c2933bf admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:36.986684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d849f6-bfdb-4157-baa6-5559d403ae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:36.986684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d849f6-bfdb-4157-baa6-5559d403ae0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:36.986684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d849f6-bfdb-4157-baa6-5559d403ae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:36.986684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d849f6-bfdb-4157-baa6-5559d403ae0d admin admin] PATH_INFO: `/v3/projects/06bee943ed314fd598ca7ae803eb6db1/users/800167ac5c77456eb517f14f43e7c6ad/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:36.989360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d849f6-bfdb-4157-baa6-5559d403ae0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06bee943ed314fd598ca7ae803eb6db1, user_id=800167ac5c77456eb517f14f43e7c6ad, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:36.993066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d849f6-bfdb-4157-baa6-5559d403ae0d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:37.025376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 932/1872] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:36 2022] PUT /identity/v3/projects/06bee943ed314fd598ca7ae803eb6db1/users/800167ac5c77456eb517f14f43e7c6ad/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:37.037281 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9e890-630a-4eba-b17d-1ba57959e85b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:37.039386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4dc9e890-630a-4eba-b17d-1ba57959e85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:37.039789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dd3c5-806c-495a-947b-a3cf8c923a50 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.040072 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dd3c5-806c-495a-947b-a3cf8c923a50 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.040340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dd3c5-806c-495a-947b-a3cf8c923a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.075716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9e890-630a-4eba-b17d-1ba57959e85b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:37.116010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3d7dd3c5-806c-495a-947b-a3cf8c923a50 None None] MFA Rules not processed for user `800167ac5c77456eb517f14f43e7c6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:37.117627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3d7dd3c5-806c-495a-947b-a3cf8c923a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:37.242451 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b305e5-040d-45bb-b27c-b31152da4916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:37.243261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b305e5-040d-45bb-b27c-b31152da4916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.243747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b305e5-040d-45bb-b27c-b31152da4916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.244284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b305e5-040d-45bb-b27c-b31152da4916 admin admin] PATH_INFO: `/v3/projects/f227f826ae3e49f4aeb95d61f85a24fb` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.248260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b305e5-040d-45bb-b27c-b31152da4916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f227f826ae3e49f4aeb95d61f85a24fb)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:37.254543 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b305e5-040d-45bb-b27c-b31152da4916 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:37.262437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 933/1873] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:37 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:19:37.275758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7dd3c5-806c-495a-947b-a3cf8c923a50 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:37.277527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3d7dd3c5-806c-495a-947b-a3cf8c923a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:37.325060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-75b305e5-040d-45bb-b27c-b31152da4916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f227f826ae3e49f4aeb95d61f85a24fb', 'request_id': 'req-75b305e5-040d-45bb-b27c-b31152da4916'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:37.344859 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-75b305e5-040d-45bb-b27c-b31152da4916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f227f826ae3e49f4aeb95d61f85a24fb', 'request_id': 'req-75b305e5-040d-45bb-b27c-b31152da4916'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:37.355588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-75b305e5-040d-45bb-b27c-b31152da4916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f227f826ae3e49f4aeb95d61f85a24fb', 'request_id': 'req-75b305e5-040d-45bb-b27c-b31152da4916'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:37.367503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7dd3c5-806c-495a-947b-a3cf8c923a50 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:37.384871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-75b305e5-040d-45bb-b27c-b31152da4916 admin admin] The token cache is being invalidate because project f227f826ae3e49f4aeb95d61f85a24fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:37.385516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-75b305e5-040d-45bb-b27c-b31152da4916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:37.396324 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-75b305e5-040d-45bb-b27c-b31152da4916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:37.398216 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 941/1874] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:37 2022] DELETE /identity/v3/projects/f227f826ae3e49f4aeb95d61f85a24fb => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:37.402953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b305e5-040d-45bb-b27c-b31152da4916 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:37.408043 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-75b305e5-040d-45bb-b27c-b31152da4916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:37.431187 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd52a3-4aaa-4ced-bc31-7165ecaa5bba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:37.432016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd52a3-4aaa-4ced-bc31-7165ecaa5bba service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.432399 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd52a3-4aaa-4ced-bc31-7165ecaa5bba service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.433144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd52a3-4aaa-4ced-bc31-7165ecaa5bba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.434668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5ffd52a3-4aaa-4ced-bc31-7165ecaa5bba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:37.491181 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:37.493067 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b305e5-040d-45bb-b27c-b31152da4916 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:37.498457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff384972-5d67-427c-9b3d-0810e8eded99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:37.499147 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384972-5d67-427c-9b3d-0810e8eded99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.499439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384972-5d67-427c-9b3d-0810e8eded99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.499718 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384972-5d67-427c-9b3d-0810e8eded99 admin admin] PATH_INFO: `/v3/projects/e461b93cf281411da5658448241ecde7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.500891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff384972-5d67-427c-9b3d-0810e8eded99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e461b93cf281411da5658448241ecde7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:37.502804 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff384972-5d67-427c-9b3d-0810e8eded99 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:37.512538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd52a3-4aaa-4ced-bc31-7165ecaa5bba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:37.513981 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd52a3-4aaa-4ced-bc31-7165ecaa5bba service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:37.524533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 934/1875] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:37 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:37.525773 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8818bd2-5a5a-44ed-857f-40d5b2dded19 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.526037 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:37.526283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8818bd2-5a5a-44ed-857f-40d5b2dded19 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.526383 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8818bd2-5a5a-44ed-857f-40d5b2dded19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.550233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b8818bd2-5a5a-44ed-857f-40d5b2dded19 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:37.551658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b8818bd2-5a5a-44ed-857f-40d5b2dded19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:37.558897 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff384972-5d67-427c-9b3d-0810e8eded99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e461b93cf281411da5658448241ecde7', 'request_id': 'req-ff384972-5d67-427c-9b3d-0810e8eded99'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:37.568326 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff384972-5d67-427c-9b3d-0810e8eded99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e461b93cf281411da5658448241ecde7', 'request_id': 'req-ff384972-5d67-427c-9b3d-0810e8eded99'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:37.575163 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff384972-5d67-427c-9b3d-0810e8eded99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e461b93cf281411da5658448241ecde7', 'request_id': 'req-ff384972-5d67-427c-9b3d-0810e8eded99'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:37.591881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff384972-5d67-427c-9b3d-0810e8eded99 admin admin] The token cache is being invalidate because project e461b93cf281411da5658448241ecde7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:37.593149 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff384972-5d67-427c-9b3d-0810e8eded99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:37.593841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff384972-5d67-427c-9b3d-0810e8eded99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:37.598820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 942/1876] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:37 2022] DELETE /identity/v3/projects/e461b93cf281411da5658448241ecde7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:37.600449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448662ae-6841-445c-a5a7-c0bf4233bc2f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.600806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448662ae-6841-445c-a5a7-c0bf4233bc2f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.601164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448662ae-6841-445c-a5a7-c0bf4233bc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.622037 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-448662ae-6841-445c-a5a7-c0bf4233bc2f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:37.623472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-448662ae-6841-445c-a5a7-c0bf4233bc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:37.628813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 935/1877] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:37.633329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 943/1878] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:37.638365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16c2b9-97ae-4da7-8101-5b7640add52f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.638655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16c2b9-97ae-4da7-8101-5b7640add52f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.639094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16c2b9-97ae-4da7-8101-5b7640add52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.642292 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fae494-0f66-4af3-b988-00a05ec1cf76 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.642996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fae494-0f66-4af3-b988-00a05ec1cf76 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.643346 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fae494-0f66-4af3-b988-00a05ec1cf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.666750 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-89fae494-0f66-4af3-b988-00a05ec1cf76 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:37.668230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-89fae494-0f66-4af3-b988-00a05ec1cf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:37.668614 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-de16c2b9-97ae-4da7-8101-5b7640add52f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:37.669934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-de16c2b9-97ae-4da7-8101-5b7640add52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:37.676819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 944/1879] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:37.679568 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 936/1880] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:19:37.681093 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fae494-0f66-4af3-b988-00a05ec1cf76 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:37.684076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16c2b9-97ae-4da7-8101-5b7640add52f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:37.690709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fae494-0f66-4af3-b988-00a05ec1cf76 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:37.696190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16c2b9-97ae-4da7-8101-5b7640add52f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:37.697431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d6aa2-928c-4640-80d1-194f8bdbe693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:37.698186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d6aa2-928c-4640-80d1-194f8bdbe693 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.698467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d6aa2-928c-4640-80d1-194f8bdbe693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.698770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d6aa2-928c-4640-80d1-194f8bdbe693 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.699604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d6aa2-928c-4640-80d1-194f8bdbe693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:37.699924 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d6aa2-928c-4640-80d1-194f8bdbe693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:37.701192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44e8b4-8c10-411e-a01c-d55cfaf4e008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:37.701584 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d6aa2-928c-4640-80d1-194f8bdbe693 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:37.701913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44e8b4-8c10-411e-a01c-d55cfaf4e008 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.702260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44e8b4-8c10-411e-a01c-d55cfaf4e008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.702596 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44e8b4-8c10-411e-a01c-d55cfaf4e008 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.703374 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44e8b4-8c10-411e-a01c-d55cfaf4e008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:37.703738 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44e8b4-8c10-411e-a01c-d55cfaf4e008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:37.705394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44e8b4-8c10-411e-a01c-d55cfaf4e008 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:37.725371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 945/1881] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:37.725640 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 937/1882] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:19:37.726155 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d6aa2-928c-4640-80d1-194f8bdbe693 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:37.726260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44e8b4-8c10-411e-a01c-d55cfaf4e008 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:37.736295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44e8b4-8c10-411e-a01c-d55cfaf4e008 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:37.736423 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d6aa2-928c-4640-80d1-194f8bdbe693 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:37.741765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba433e37-2587-402c-b76d-d41f92e14a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:37.742652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba433e37-2587-402c-b76d-d41f92e14a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.742777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd282a-a461-4d01-bf12-39754f2696aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:37.742882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba433e37-2587-402c-b76d-d41f92e14a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.742882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba433e37-2587-402c-b76d-d41f92e14a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.743541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba433e37-2587-402c-b76d-d41f92e14a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:37.743662 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd282a-a461-4d01-bf12-39754f2696aa admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.743982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd282a-a461-4d01-bf12-39754f2696aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.744317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd282a-a461-4d01-bf12-39754f2696aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.745081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd282a-a461-4d01-bf12-39754f2696aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:37.745598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba433e37-2587-402c-b76d-d41f92e14a8c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:37.747296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd282a-a461-4d01-bf12-39754f2696aa admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:37.778269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 938/1883] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:37 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:37.779331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd282a-a461-4d01-bf12-39754f2696aa admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:37.782102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c4cd282a-a461-4d01-bf12-39754f2696aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:37.787227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 946/1884] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:37 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:19:37.787227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba433e37-2587-402c-b76d-d41f92e14a8c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:37.853413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd282a-a461-4d01-bf12-39754f2696aa admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:37.855965 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba433e37-2587-402c-b76d-d41f92e14a8c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:37.860687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce928fc-f3b7-4690-8f4a-a6c23101089a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:37.861625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce928fc-f3b7-4690-8f4a-a6c23101089a admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.862024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce928fc-f3b7-4690-8f4a-a6c23101089a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.862373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce928fc-f3b7-4690-8f4a-a6c23101089a admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.863168 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce928fc-f3b7-4690-8f4a-a6c23101089a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:37.865739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce928fc-f3b7-4690-8f4a-a6c23101089a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:37.893797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 947/1885] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:37 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:37.893797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce928fc-f3b7-4690-8f4a-a6c23101089a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:37.902838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce928fc-f3b7-4690-8f4a-a6c23101089a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:37.908150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162871c-18fb-4647-82e7-94ea5ba7c542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:37.908958 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162871c-18fb-4647-82e7-94ea5ba7c542 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.909340 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162871c-18fb-4647-82e7-94ea5ba7c542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.909849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162871c-18fb-4647-82e7-94ea5ba7c542 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.910427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162871c-18fb-4647-82e7-94ea5ba7c542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:37.913104 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162871c-18fb-4647-82e7-94ea5ba7c542 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:37.914923 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c366c2c-1dea-4c85-8fb5-c32c689c7cf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:37.915807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366c2c-1dea-4c85-8fb5-c32c689c7cf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.916247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366c2c-1dea-4c85-8fb5-c32c689c7cf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.916708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366c2c-1dea-4c85-8fb5-c32c689c7cf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.919371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5c366c2c-1dea-4c85-8fb5-c32c689c7cf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:37.939060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:37.940211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 948/1886] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:37 2022] POST /identity/v3/users => generated 294 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:37.941606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162871c-18fb-4647-82e7-94ea5ba7c542 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:37.955756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162871c-18fb-4647-82e7-94ea5ba7c542 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:37.961652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043355e-c6d4-4660-9eb2-129de91adce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:37.962261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043355e-c6d4-4660-9eb2-129de91adce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.962539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043355e-c6d4-4660-9eb2-129de91adce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.962808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043355e-c6d4-4660-9eb2-129de91adce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.963487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043355e-c6d4-4660-9eb2-129de91adce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:37.965064 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043355e-c6d4-4660-9eb2-129de91adce5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:37.976223 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 949/1887] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:37.977022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043355e-c6d4-4660-9eb2-129de91adce5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:37.987253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043355e-c6d4-4660-9eb2-129de91adce5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:37.993498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185155b-df03-427f-8d20-aeda5a434e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:37.994113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185155b-df03-427f-8d20-aeda5a434e96 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:37.994467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185155b-df03-427f-8d20-aeda5a434e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:37.994810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185155b-df03-427f-8d20-aeda5a434e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:37.995548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185155b-df03-427f-8d20-aeda5a434e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:37.997528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185155b-df03-427f-8d20-aeda5a434e96 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:38.001366 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c366c2c-1dea-4c85-8fb5-c32c689c7cf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:38.002820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c366c2c-1dea-4c85-8fb5-c32c689c7cf2 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:38.009889 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 950/1888] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:38.011144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185155b-df03-427f-8d20-aeda5a434e96 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:38.014136 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 939/1889] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:37 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:38.014835 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c366c2c-1dea-4c85-8fb5-c32c689c7cf2 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:38.023699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185155b-df03-427f-8d20-aeda5a434e96 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:38.026710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c366c2c-1dea-4c85-8fb5-c32c689c7cf2 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:38.029752 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c409af4-c759-4a56-9b3e-5e99726688d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:38.030553 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409af4-c759-4a56-9b3e-5e99726688d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:38.030834 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409af4-c759-4a56-9b3e-5e99726688d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:38.031146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409af4-c759-4a56-9b3e-5e99726688d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:38.031830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c409af4-c759-4a56-9b3e-5e99726688d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:38.032464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eff670-f14d-4214-a676-f458f1fdbf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:38.033165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eff670-f14d-4214-a676-f458f1fdbf91 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:38.033385 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c409af4-c759-4a56-9b3e-5e99726688d2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:38.033640 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eff670-f14d-4214-a676-f458f1fdbf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:38.034008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eff670-f14d-4214-a676-f458f1fdbf91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:38.034764 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eff670-f14d-4214-a676-f458f1fdbf91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:38.036543 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eff670-f14d-4214-a676-f458f1fdbf91 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:38.037504 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=8 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:38.050002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 951/1890] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:38.050290 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 940/1891] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:38.053305 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c409af4-c759-4a56-9b3e-5e99726688d2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:38.054241 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eff670-f14d-4214-a676-f458f1fdbf91 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:38.065063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eff670-f14d-4214-a676-f458f1fdbf91 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:38.065475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c409af4-c759-4a56-9b3e-5e99726688d2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:38.071240 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3782e0b-be4a-4e8a-9524-f7a2606c880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:38.071721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722c70c-e910-47b3-9538-5b66f8539b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:38.072038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3782e0b-be4a-4e8a-9524-f7a2606c880f admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:38.072399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3782e0b-be4a-4e8a-9524-f7a2606c880f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:38.072524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722c70c-e910-47b3-9538-5b66f8539b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:38.072797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3782e0b-be4a-4e8a-9524-f7a2606c880f admin admin] PATH_INFO: `/v3/projects/9a5b8d8b06e2436eae2d2cc24e0032a7/users/ddf20e90f78e47e7b11def93701b0eef/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:38.072905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722c70c-e910-47b3-9538-5b66f8539b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:38.073115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722c70c-e910-47b3-9538-5b66f8539b0f admin admin] PATH_INFO: `/v3/projects/c9af13408ec749318893a73f448b6dac/users/11163fd1221847778ee67d5d05421c27/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:38.090858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3782e0b-be4a-4e8a-9524-f7a2606c880f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5b8d8b06e2436eae2d2cc24e0032a7, user_id=ddf20e90f78e47e7b11def93701b0eef, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:38.094113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3782e0b-be4a-4e8a-9524-f7a2606c880f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:38.096799 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722c70c-e910-47b3-9538-5b66f8539b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9af13408ec749318893a73f448b6dac, user_id=11163fd1221847778ee67d5d05421c27, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:38.100292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722c70c-e910-47b3-9538-5b66f8539b0f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:38.115836 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 952/1892] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:38 2022] PUT /identity/v3/projects/9a5b8d8b06e2436eae2d2cc24e0032a7/users/ddf20e90f78e47e7b11def93701b0eef/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:38.119172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 941/1893] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:38 2022] PUT /identity/v3/projects/c9af13408ec749318893a73f448b6dac/users/11163fd1221847778ee67d5d05421c27/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:38.138946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90aeb0-39ed-44fa-804a-0bd71a0e7263 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:38.139401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90aeb0-39ed-44fa-804a-0bd71a0e7263 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:38.140102 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90aeb0-39ed-44fa-804a-0bd71a0e7263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:38.144988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6837cf-c7b0-455a-ab6c-eff5eb868e1b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:38.145345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6837cf-c7b0-455a-ab6c-eff5eb868e1b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:38.145743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6837cf-c7b0-455a-ab6c-eff5eb868e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:38.195702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0b6837cf-c7b0-455a-ab6c-eff5eb868e1b None None] MFA Rules not processed for user `11163fd1221847778ee67d5d05421c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:38.197458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0b6837cf-c7b0-455a-ab6c-eff5eb868e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:38.198160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8e90aeb0-39ed-44fa-804a-0bd71a0e7263 None None] MFA Rules not processed for user `ddf20e90f78e47e7b11def93701b0eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:38.200751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8e90aeb0-39ed-44fa-804a-0bd71a0e7263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:38.310519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 942/1894] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:38.312436 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6837cf-c7b0-455a-ab6c-eff5eb868e1b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:38.340571 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 953/1895] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:38.354563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90aeb0-39ed-44fa-804a-0bd71a0e7263 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:38.356044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8e90aeb0-39ed-44fa-804a-0bd71a0e7263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:38.437315 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6837cf-c7b0-455a-ab6c-eff5eb868e1b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:38.444179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5bd33-bc4a-40bf-88a5-55c66729e6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:38.444881 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5bd33-bc4a-40bf-88a5-55c66729e6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:38.445245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5bd33-bc4a-40bf-88a5-55c66729e6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:38.445593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5bd33-bc4a-40bf-88a5-55c66729e6d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:38.446314 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5bd33-bc4a-40bf-88a5-55c66729e6d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:38.448554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5bd33-bc4a-40bf-88a5-55c66729e6d3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:38.463838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:38.492350 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 943/1896] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:38 2022] POST /identity/v3/projects => generated 389 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:38.493591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5bd33-bc4a-40bf-88a5-55c66729e6d3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:38.541440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90aeb0-39ed-44fa-804a-0bd71a0e7263 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:38.639307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5bd33-bc4a-40bf-88a5-55c66729e6d3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:38.644766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96db849-e9c3-467a-b919-ea37b5d1a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:38.645915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96db849-e9c3-467a-b919-ea37b5d1a093 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:38.646313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96db849-e9c3-467a-b919-ea37b5d1a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:38.646818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96db849-e9c3-467a-b919-ea37b5d1a093 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:38.647528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96db849-e9c3-467a-b919-ea37b5d1a093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:38.649455 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96db849-e9c3-467a-b919-ea37b5d1a093 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:38.652260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebecc22-5be1-45f4-8752-4c6a278ca7af service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c78d95e6774755b11508fc1954ad5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:38.653801 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebecc22-5be1-45f4-8752-4c6a278ca7af service glance] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:38.653801 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebecc22-5be1-45f4-8752-4c6a278ca7af service glance] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:38.653801 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebecc22-5be1-45f4-8752-4c6a278ca7af service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:38.669604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:38.677311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 944/1897] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:38 2022] POST /identity/v3/users => generated 301 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:38.678950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96db849-e9c3-467a-b919-ea37b5d1a093 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:38.692795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96db849-e9c3-467a-b919-ea37b5d1a093 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:38.697942 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528a3ab-d15d-429f-918a-f516c9b04bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:38.698624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528a3ab-d15d-429f-918a-f516c9b04bfc admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:38.699009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528a3ab-d15d-429f-918a-f516c9b04bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:38.699379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528a3ab-d15d-429f-918a-f516c9b04bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:38.700128 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528a3ab-d15d-429f-918a-f516c9b04bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:38.701885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528a3ab-d15d-429f-918a-f516c9b04bfc admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:38.714689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 945/1898] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:38.720009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528a3ab-d15d-429f-918a-f516c9b04bfc admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:38.735731 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528a3ab-d15d-429f-918a-f516c9b04bfc admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:38.738402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebecc22-5be1-45f4-8752-4c6a278ca7af service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:38.740937 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebecc22-5be1-45f4-8752-4c6a278ca7af service glance] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:38.744793 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b7726-61cd-4b08-b4df-e673daffa369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:38.745643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b7726-61cd-4b08-b4df-e673daffa369 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:38.746230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b7726-61cd-4b08-b4df-e673daffa369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:38.746610 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b7726-61cd-4b08-b4df-e673daffa369 admin admin] PATH_INFO: `/v3/projects/137093b655634217bfc7f3ea0d4533db/users/d299fd3d6e34437fade57fdaf8420a76/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:38.756374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 954/1899] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:19:38.767664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b7726-61cd-4b08-b4df-e673daffa369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137093b655634217bfc7f3ea0d4533db, user_id=d299fd3d6e34437fade57fdaf8420a76, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:38.770878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b7726-61cd-4b08-b4df-e673daffa369 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:38.794221 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 946/1900] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:38 2022] PUT /identity/v3/projects/137093b655634217bfc7f3ea0d4533db/users/d299fd3d6e34437fade57fdaf8420a76/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:38.795332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebecc22-5be1-45f4-8752-4c6a278ca7af service glance] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:38.815695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebecc22-5be1-45f4-8752-4c6a278ca7af service glance] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:38.902036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964626a-57ea-4df9-9493-4e1dc5de1f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:38.903195 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964626a-57ea-4df9-9493-4e1dc5de1f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:38.903924 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964626a-57ea-4df9-9493-4e1dc5de1f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:38.905897 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964626a-57ea-4df9-9493-4e1dc5de1f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:38.906825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964626a-57ea-4df9-9493-4e1dc5de1f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:38.908829 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964626a-57ea-4df9-9493-4e1dc5de1f83 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:38.927845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 955/1901] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:19:38.929563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b7726-61cd-4b08-b4df-e673daffa369 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:38.942047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b7726-61cd-4b08-b4df-e673daffa369 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:38.947810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4d095-0283-4c0c-939f-a444579cce6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:38.948483 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4d095-0283-4c0c-939f-a444579cce6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:38.948762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4d095-0283-4c0c-939f-a444579cce6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:38.949028 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4d095-0283-4c0c-939f-a444579cce6b admin admin] PATH_INFO: `/v3/projects/137093b655634217bfc7f3ea0d4533db/users/d299fd3d6e34437fade57fdaf8420a76/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:38.951214 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4d095-0283-4c0c-939f-a444579cce6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=137093b655634217bfc7f3ea0d4533db, user_id=d299fd3d6e34437fade57fdaf8420a76, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:38.953982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4d095-0283-4c0c-939f-a444579cce6b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:38.965783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 947/1902] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:38 2022] PUT /identity/v3/projects/137093b655634217bfc7f3ea0d4533db/users/d299fd3d6e34437fade57fdaf8420a76/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:38.976529 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc757f-bc73-4482-aa4e-bf4e779301e1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:38.976819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc757f-bc73-4482-aa4e-bf4e779301e1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:38.977095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc757f-bc73-4482-aa4e-bf4e779301e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:39.015240 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-adbc757f-bc73-4482-aa4e-bf4e779301e1 None None] MFA Rules not processed for user `d299fd3d6e34437fade57fdaf8420a76`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:39.016860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-adbc757f-bc73-4482-aa4e-bf4e779301e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:39.225232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 956/1903] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:38 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:39.236604 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4d095-0283-4c0c-939f-a444579cce6b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:39.238304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e7e4d095-0283-4c0c-939f-a444579cce6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:39.302144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4d095-0283-4c0c-939f-a444579cce6b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:39.306571 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8be9f3-5d0a-46dd-9054-8607751000e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:39.307896 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8be9f3-5d0a-46dd-9054-8607751000e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:39.308182 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8be9f3-5d0a-46dd-9054-8607751000e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:39.308586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8be9f3-5d0a-46dd-9054-8607751000e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:39.318046 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8be9f3-5d0a-46dd-9054-8607751000e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:39.319530 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8be9f3-5d0a-46dd-9054-8607751000e8 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:39.329725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 948/1904] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:39 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:39.489999 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc757f-bc73-4482-aa4e-bf4e779301e1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:39.537190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:39.564276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc757f-bc73-4482-aa4e-bf4e779301e1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:39.568962 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae198a08-9bf9-4c2a-aa84-8dd791497075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:39.569603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae198a08-9bf9-4c2a-aa84-8dd791497075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:39.569946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae198a08-9bf9-4c2a-aa84-8dd791497075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:39.570227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae198a08-9bf9-4c2a-aa84-8dd791497075 admin admin] PATH_INFO: `/v3/users/11163fd1221847778ee67d5d05421c27` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:39.571379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae198a08-9bf9-4c2a-aa84-8dd791497075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11163fd1221847778ee67d5d05421c27)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:39.573332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae198a08-9bf9-4c2a-aa84-8dd791497075 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:39.624822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ae198a08-9bf9-4c2a-aa84-8dd791497075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11163fd1221847778ee67d5d05421c27'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:39.625505 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ae198a08-9bf9-4c2a-aa84-8dd791497075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11163fd1221847778ee67d5d05421c27'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:39.634858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ae198a08-9bf9-4c2a-aa84-8dd791497075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11163fd1221847778ee67d5d05421c27'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:39.649765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ae198a08-9bf9-4c2a-aa84-8dd791497075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11163fd1221847778ee67d5d05421c27'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:39.650811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ae198a08-9bf9-4c2a-aa84-8dd791497075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11163fd1221847778ee67d5d05421c27'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:39.667156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 957/1905] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:39 2022] DELETE /identity/v3/users/11163fd1221847778ee67d5d05421c27 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:39.672260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27031534-7e85-40e8-97bc-471c2f6fc412 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:39.672552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27031534-7e85-40e8-97bc-471c2f6fc412 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:39.672828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27031534-7e85-40e8-97bc-471c2f6fc412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:39.700957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-27031534-7e85-40e8-97bc-471c2f6fc412 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:39.702172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-27031534-7e85-40e8-97bc-471c2f6fc412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:39.750252 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:39.799774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 949/1906] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:39.811851 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae198a08-9bf9-4c2a-aa84-8dd791497075 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:39.813426 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ae198a08-9bf9-4c2a-aa84-8dd791497075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:39.877709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae198a08-9bf9-4c2a-aa84-8dd791497075 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:39.882112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818a576-46e0-47f1-b05e-f57d419036a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:39.882712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818a576-46e0-47f1-b05e-f57d419036a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:39.882988 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818a576-46e0-47f1-b05e-f57d419036a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:39.883288 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818a576-46e0-47f1-b05e-f57d419036a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:39.891955 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818a576-46e0-47f1-b05e-f57d419036a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:39.893366 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818a576-46e0-47f1-b05e-f57d419036a0 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:39.903776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 958/1907] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:40.279611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27031534-7e85-40e8-97bc-471c2f6fc412 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:40.281389 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-27031534-7e85-40e8-97bc-471c2f6fc412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:40.308761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27031534-7e85-40e8-97bc-471c2f6fc412 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:40.315272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b2faf-e86e-40d8-8186-6d0460901765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:40.316419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b2faf-e86e-40d8-8186-6d0460901765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:40.316791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b2faf-e86e-40d8-8186-6d0460901765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:40.317103 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b2faf-e86e-40d8-8186-6d0460901765 admin admin] PATH_INFO: `/v3/projects/c9af13408ec749318893a73f448b6dac` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:40.318504 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b2faf-e86e-40d8-8186-6d0460901765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9af13408ec749318893a73f448b6dac)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:40.320803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b2faf-e86e-40d8-8186-6d0460901765 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:40.396412 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b89b2faf-e86e-40d8-8186-6d0460901765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9af13408ec749318893a73f448b6dac', 'request_id': 'req-b89b2faf-e86e-40d8-8186-6d0460901765'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:40.407534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b89b2faf-e86e-40d8-8186-6d0460901765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9af13408ec749318893a73f448b6dac', 'request_id': 'req-b89b2faf-e86e-40d8-8186-6d0460901765'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:40.425212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b89b2faf-e86e-40d8-8186-6d0460901765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9af13408ec749318893a73f448b6dac', 'request_id': 'req-b89b2faf-e86e-40d8-8186-6d0460901765'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:40.447642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b89b2faf-e86e-40d8-8186-6d0460901765 admin admin] The token cache is being invalidate because project c9af13408ec749318893a73f448b6dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:40.447946 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b89b2faf-e86e-40d8-8186-6d0460901765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:40.449024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b89b2faf-e86e-40d8-8186-6d0460901765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:40.454668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818a576-46e0-47f1-b05e-f57d419036a0 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:40.460451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 950/1908] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:40 2022] DELETE /identity/v3/projects/c9af13408ec749318893a73f448b6dac => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:40.472030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818a576-46e0-47f1-b05e-f57d419036a0 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:40.555004 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:40.561861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de0b19-d8a8-4e44-a243-ca7efa015972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:40.562794 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de0b19-d8a8-4e44-a243-ca7efa015972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:40.562911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de0b19-d8a8-4e44-a243-ca7efa015972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:40.563377 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de0b19-d8a8-4e44-a243-ca7efa015972 admin admin] PATH_INFO: `/v3/users/d299fd3d6e34437fade57fdaf8420a76` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:40.564445 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de0b19-d8a8-4e44-a243-ca7efa015972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d299fd3d6e34437fade57fdaf8420a76)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:40.570825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de0b19-d8a8-4e44-a243-ca7efa015972 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:40.653590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e6de0b19-d8a8-4e44-a243-ca7efa015972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd299fd3d6e34437fade57fdaf8420a76'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:40.655493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e6de0b19-d8a8-4e44-a243-ca7efa015972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd299fd3d6e34437fade57fdaf8420a76'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:40.667449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e6de0b19-d8a8-4e44-a243-ca7efa015972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd299fd3d6e34437fade57fdaf8420a76'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:40.687736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e6de0b19-d8a8-4e44-a243-ca7efa015972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd299fd3d6e34437fade57fdaf8420a76'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:40.688544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e6de0b19-d8a8-4e44-a243-ca7efa015972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd299fd3d6e34437fade57fdaf8420a76'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:40.703030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 959/1909] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:40 2022] DELETE /identity/v3/users/d299fd3d6e34437fade57fdaf8420a76 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:41.040005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b2faf-e86e-40d8-8186-6d0460901765 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:41.042132 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b89b2faf-e86e-40d8-8186-6d0460901765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:41.058427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b2faf-e86e-40d8-8186-6d0460901765 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:41.150047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a1b0d-aeff-4052-81e8-c4d8a4afa42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:41.150890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a1b0d-aeff-4052-81e8-c4d8a4afa42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:41.151196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a1b0d-aeff-4052-81e8-c4d8a4afa42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:41.151476 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a1b0d-aeff-4052-81e8-c4d8a4afa42c admin admin] PATH_INFO: `/v3/projects/137093b655634217bfc7f3ea0d4533db` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:41.152738 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a1b0d-aeff-4052-81e8-c4d8a4afa42c admin admin] RBAC: Authorizing `identity:delete_project(project_id=137093b655634217bfc7f3ea0d4533db)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:41.154893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a1b0d-aeff-4052-81e8-c4d8a4afa42c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:41.213988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-968a1b0d-aeff-4052-81e8-c4d8a4afa42c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137093b655634217bfc7f3ea0d4533db', 'request_id': 'req-968a1b0d-aeff-4052-81e8-c4d8a4afa42c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:41.220471 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-968a1b0d-aeff-4052-81e8-c4d8a4afa42c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137093b655634217bfc7f3ea0d4533db', 'request_id': 'req-968a1b0d-aeff-4052-81e8-c4d8a4afa42c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:41.226532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:41.228179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-968a1b0d-aeff-4052-81e8-c4d8a4afa42c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137093b655634217bfc7f3ea0d4533db', 'request_id': 'req-968a1b0d-aeff-4052-81e8-c4d8a4afa42c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:41.244477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-968a1b0d-aeff-4052-81e8-c4d8a4afa42c admin admin] The token cache is being invalidate because project 137093b655634217bfc7f3ea0d4533db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:41.244836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-968a1b0d-aeff-4052-81e8-c4d8a4afa42c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:41.245601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-968a1b0d-aeff-4052-81e8-c4d8a4afa42c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:41.247320 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 951/1910] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:41 2022] DELETE /identity/v3/projects/137093b655634217bfc7f3ea0d4533db => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:41.253030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743250f-9dd4-45d8-8709-b443a35b0e20 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:41.253317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743250f-9dd4-45d8-8709-b443a35b0e20 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:41.253593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743250f-9dd4-45d8-8709-b443a35b0e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:41.273585 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7743250f-9dd4-45d8-8709-b443a35b0e20 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:41.274959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7743250f-9dd4-45d8-8709-b443a35b0e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:41.351864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 960/1911] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:41.361926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22759873-8b6a-438f-adc6-b82f29146e59 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:41.362425 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22759873-8b6a-438f-adc6-b82f29146e59 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:41.362706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22759873-8b6a-438f-adc6-b82f29146e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:41.408960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-22759873-8b6a-438f-adc6-b82f29146e59 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:41.408960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-22759873-8b6a-438f-adc6-b82f29146e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:41.419086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 952/1912] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:41.433836 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743250f-9dd4-45d8-8709-b443a35b0e20 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:41.445948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743250f-9dd4-45d8-8709-b443a35b0e20 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:41.451260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308a92c-6932-43be-946c-a46880e0b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:41.451887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308a92c-6932-43be-946c-a46880e0b37e admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:41.452168 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308a92c-6932-43be-946c-a46880e0b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:41.452441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308a92c-6932-43be-946c-a46880e0b37e admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:41.453095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308a92c-6932-43be-946c-a46880e0b37e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:41.453527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308a92c-6932-43be-946c-a46880e0b37e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:41.455159 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308a92c-6932-43be-946c-a46880e0b37e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:41.478776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 961/1913] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:41.482986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22759873-8b6a-438f-adc6-b82f29146e59 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:41.494690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22759873-8b6a-438f-adc6-b82f29146e59 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:41.515783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4812d-de13-4b21-99e1-67b66f216dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:41.518320 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4812d-de13-4b21-99e1-67b66f216dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:41.519343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4812d-de13-4b21-99e1-67b66f216dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:41.519700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4812d-de13-4b21-99e1-67b66f216dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:41.522379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4812d-de13-4b21-99e1-67b66f216dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:41.526871 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4812d-de13-4b21-99e1-67b66f216dd9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:41.590850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 953/1914] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:41 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:41.591803 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308a92c-6932-43be-946c-a46880e0b37e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:41.602449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308a92c-6932-43be-946c-a46880e0b37e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:41.728054 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715630d-5aa0-444b-a23c-09402063f537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:41.729564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715630d-5aa0-444b-a23c-09402063f537 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:41.729877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715630d-5aa0-444b-a23c-09402063f537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:41.730141 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715630d-5aa0-444b-a23c-09402063f537 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:41.730799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715630d-5aa0-444b-a23c-09402063f537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:41.733340 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715630d-5aa0-444b-a23c-09402063f537 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:41.750381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:41.775685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 962/1915] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:41 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:41.778310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4812d-de13-4b21-99e1-67b66f216dd9 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:41.802458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4812d-de13-4b21-99e1-67b66f216dd9 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:41.817377 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa533b-0ade-4c15-9b9f-67396bc39ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:41.818252 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa533b-0ade-4c15-9b9f-67396bc39ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:41.818633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa533b-0ade-4c15-9b9f-67396bc39ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:41.819083 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa533b-0ade-4c15-9b9f-67396bc39ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:41.820028 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa533b-0ade-4c15-9b9f-67396bc39ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:41.822040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa533b-0ade-4c15-9b9f-67396bc39ac5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:41.840642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715630d-5aa0-444b-a23c-09402063f537 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:41.848454 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 954/1916] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:41.853396 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715630d-5aa0-444b-a23c-09402063f537 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:41.864811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c1659-a83f-44e3-b7f9-f911ace6277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:41.865723 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c1659-a83f-44e3-b7f9-f911ace6277b admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:41.866189 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c1659-a83f-44e3-b7f9-f911ace6277b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:41.866638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c1659-a83f-44e3-b7f9-f911ace6277b admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:41.867588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c1659-a83f-44e3-b7f9-f911ace6277b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:41.869475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c1659-a83f-44e3-b7f9-f911ace6277b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:41.882246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 963/1917] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:41.886308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa533b-0ade-4c15-9b9f-67396bc39ac5 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:41.898223 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa533b-0ade-4c15-9b9f-67396bc39ac5 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:41.904660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c72ae5-6bd4-4fa5-8f47-936b7804fdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:41.905452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c72ae5-6bd4-4fa5-8f47-936b7804fdad admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:41.905803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c72ae5-6bd4-4fa5-8f47-936b7804fdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:41.906171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c72ae5-6bd4-4fa5-8f47-936b7804fdad admin admin] PATH_INFO: `/v3/projects/d7f4b687d7c64aaeae1d24f68882ac12/users/de8e28b81e8d4add8f1117b1a5fa491e/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:41.929789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c72ae5-6bd4-4fa5-8f47-936b7804fdad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f4b687d7c64aaeae1d24f68882ac12, user_id=de8e28b81e8d4add8f1117b1a5fa491e, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:41.936181 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c72ae5-6bd4-4fa5-8f47-936b7804fdad admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:41.963823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 955/1918] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:41 2022] PUT /identity/v3/projects/d7f4b687d7c64aaeae1d24f68882ac12/users/de8e28b81e8d4add8f1117b1a5fa491e/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:41.980482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e57c26-e066-4165-90aa-78194f85339d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:41.981224 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e57c26-e066-4165-90aa-78194f85339d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:41.981533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e57c26-e066-4165-90aa-78194f85339d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:42.029739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-96e57c26-e066-4165-90aa-78194f85339d None None] MFA Rules not processed for user `de8e28b81e8d4add8f1117b1a5fa491e`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:42.032958 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-96e57c26-e066-4165-90aa-78194f85339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:42.157079 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 964/1919] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:42.168886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c72ae5-6bd4-4fa5-8f47-936b7804fdad admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:42.170765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d8c72ae5-6bd4-4fa5-8f47-936b7804fdad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:42.304563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c72ae5-6bd4-4fa5-8f47-936b7804fdad admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:42.309992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59f74f-c8b3-4770-89db-d01db345a9f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:42.310827 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59f74f-c8b3-4770-89db-d01db345a9f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:42.311287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59f74f-c8b3-4770-89db-d01db345a9f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:42.311691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59f74f-c8b3-4770-89db-d01db345a9f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:42.332955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59f74f-c8b3-4770-89db-d01db345a9f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:42.336919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59f74f-c8b3-4770-89db-d01db345a9f9 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:42.362231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 956/1920] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:42.508123 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9c193-d23e-4bb7-847a-3e1d619569f3 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:42.509003 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9c193-d23e-4bb7-847a-3e1d619569f3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:42.509355 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9c193-d23e-4bb7-847a-3e1d619569f3 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:42.511221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 965/1921] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 13 01:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:19:42.525845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcdeb5-c418-4df5-ada7-d4dcc838b4de None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:42.526134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcdeb5-c418-4df5-ada7-d4dcc838b4de None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:42.526411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcdeb5-c418-4df5-ada7-d4dcc838b4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:42.569822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6ebcdeb5-c418-4df5-ada7-d4dcc838b4de None None] MFA Rules not processed for user `fadc83bec6be41979e1aa4d71f8fc2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:42.574022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6ebcdeb5-c418-4df5-ada7-d4dcc838b4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:42.711815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 957/1922] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 13 01:19:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:42.795615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9c193-d23e-4bb7-847a-3e1d619569f3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:42.798065 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-30e9c193-d23e-4bb7-847a-3e1d619569f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:42.826963 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9c193-d23e-4bb7-847a-3e1d619569f3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:42.836165 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8fa7c-5f96-4fd8-8e3c-9dcc7d81a45d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:42.836883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8fa7c-5f96-4fd8-8e3c-9dcc7d81a45d service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:42.837336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8fa7c-5f96-4fd8-8e3c-9dcc7d81a45d service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:42.837700 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8fa7c-5f96-4fd8-8e3c-9dcc7d81a45d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:42.884643 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8fa7c-5f96-4fd8-8e3c-9dcc7d81a45d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:42.886511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8fa7c-5f96-4fd8-8e3c-9dcc7d81a45d service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:42.899603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 966/1923] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:43.925767 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcdeb5-c418-4df5-ada7-d4dcc838b4de None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:43.929362 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6ebcdeb5-c418-4df5-ada7-d4dcc838b4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:43.969385 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:44.075274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcdeb5-c418-4df5-ada7-d4dcc838b4de None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:44.093619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8d2b5-dd88-4395-84e5-591dbc48fdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:44.094619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8d2b5-dd88-4395-84e5-591dbc48fdc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:44.095754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8d2b5-dd88-4395-84e5-591dbc48fdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:44.096359 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8d2b5-dd88-4395-84e5-591dbc48fdc1 admin admin] PATH_INFO: `/v3/users/c7d22823839245558a4b3a842aace0a2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:44.100302 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8d2b5-dd88-4395-84e5-591dbc48fdc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d22823839245558a4b3a842aace0a2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:44.105737 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8d2b5-dd88-4395-84e5-591dbc48fdc1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:44.185260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-01a8d2b5-dd88-4395-84e5-591dbc48fdc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d22823839245558a4b3a842aace0a2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:44.186456 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-01a8d2b5-dd88-4395-84e5-591dbc48fdc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d22823839245558a4b3a842aace0a2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:44.202809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-01a8d2b5-dd88-4395-84e5-591dbc48fdc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d22823839245558a4b3a842aace0a2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:44.221266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-01a8d2b5-dd88-4395-84e5-591dbc48fdc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d22823839245558a4b3a842aace0a2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:44.222665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-01a8d2b5-dd88-4395-84e5-591dbc48fdc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d22823839245558a4b3a842aace0a2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:44.247815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 958/1924] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:43 2022] DELETE /identity/v3/users/c7d22823839245558a4b3a842aace0a2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:44.249888 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80dae5-2f12-44e7-bac4-23e6e90895ab None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:44.250391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80dae5-2f12-44e7-bac4-23e6e90895ab None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:44.250476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80dae5-2f12-44e7-bac4-23e6e90895ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:44.281308 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ee80dae5-2f12-44e7-bac4-23e6e90895ab None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:44.282960 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ee80dae5-2f12-44e7-bac4-23e6e90895ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:44.361135 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 967/1925] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:19:44.372742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8d2b5-dd88-4395-84e5-591dbc48fdc1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:44.374831 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-01a8d2b5-dd88-4395-84e5-591dbc48fdc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:44.481966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8d2b5-dd88-4395-84e5-591dbc48fdc1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:44.486957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde3f62-71f3-4ac5-a7ba-8d34e3ab4063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:44.487695 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde3f62-71f3-4ac5-a7ba-8d34e3ab4063 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:44.488091 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde3f62-71f3-4ac5-a7ba-8d34e3ab4063 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:44.488314 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde3f62-71f3-4ac5-a7ba-8d34e3ab4063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:44.500397 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde3f62-71f3-4ac5-a7ba-8d34e3ab4063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:44.502046 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde3f62-71f3-4ac5-a7ba-8d34e3ab4063 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:44.513420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 959/1926] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:19:44.937532 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80dae5-2f12-44e7-bac4-23e6e90895ab None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:44.939277 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ee80dae5-2f12-44e7-bac4-23e6e90895ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:44.957021 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80dae5-2f12-44e7-bac4-23e6e90895ab None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:44.960701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd21c8-891b-4bb5-a8df-3ba8a7a4c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:44.961622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd21c8-891b-4bb5-a8df-3ba8a7a4c820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:44.962108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd21c8-891b-4bb5-a8df-3ba8a7a4c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:44.962614 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd21c8-891b-4bb5-a8df-3ba8a7a4c820 admin admin] PATH_INFO: `/v3/users/2a208c8da9c64d5aa43e967dadca6759` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:44.964058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd21c8-891b-4bb5-a8df-3ba8a7a4c820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a208c8da9c64d5aa43e967dadca6759)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:44.966527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd21c8-891b-4bb5-a8df-3ba8a7a4c820 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:45.048078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-39fd21c8-891b-4bb5-a8df-3ba8a7a4c820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a208c8da9c64d5aa43e967dadca6759'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.049449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-39fd21c8-891b-4bb5-a8df-3ba8a7a4c820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a208c8da9c64d5aa43e967dadca6759'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.058120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:INSERT=1,keystone:SELECT=92,keystone:DELETE=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:45.064355 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-39fd21c8-891b-4bb5-a8df-3ba8a7a4c820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a208c8da9c64d5aa43e967dadca6759'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.096612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-39fd21c8-891b-4bb5-a8df-3ba8a7a4c820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a208c8da9c64d5aa43e967dadca6759'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.097866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-39fd21c8-891b-4bb5-a8df-3ba8a7a4c820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a208c8da9c64d5aa43e967dadca6759'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.109540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde3f62-71f3-4ac5-a7ba-8d34e3ab4063 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:45.114365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0cde3f62-71f3-4ac5-a7ba-8d34e3ab4063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:45.131142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 968/1927] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:44 2022] DELETE /identity/v3/users/2a208c8da9c64d5aa43e967dadca6759 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:45.139959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8129e95-4d28-4350-aa13-f608e5a740ab None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:45.140269 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8129e95-4d28-4350-aa13-f608e5a740ab None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:45.141093 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8129e95-4d28-4350-aa13-f608e5a740ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:45.144151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde3f62-71f3-4ac5-a7ba-8d34e3ab4063 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:45.183713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a8129e95-4d28-4350-aa13-f608e5a740ab None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:45.184954 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a8129e95-4d28-4350-aa13-f608e5a740ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:45.240512 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:45.264064 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0913022-c381-4509-af3f-c9f6ab5ca7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:45.265093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0913022-c381-4509-af3f-c9f6ab5ca7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:45.265657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0913022-c381-4509-af3f-c9f6ab5ca7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:45.266134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0913022-c381-4509-af3f-c9f6ab5ca7b2 admin admin] PATH_INFO: `/v3/projects/a18d6c5ca8d24cf5b17ec6081ebfbdb2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:45.267503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0913022-c381-4509-af3f-c9f6ab5ca7b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18d6c5ca8d24cf5b17ec6081ebfbdb2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:45.269926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0913022-c381-4509-af3f-c9f6ab5ca7b2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:45.283963 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 969/1928] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:45.285002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8129e95-4d28-4350-aa13-f608e5a740ab None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:45.287941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a8129e95-4d28-4350-aa13-f608e5a740ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:45.344210 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f0913022-c381-4509-af3f-c9f6ab5ca7b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18d6c5ca8d24cf5b17ec6081ebfbdb2', 'request_id': 'req-f0913022-c381-4509-af3f-c9f6ab5ca7b2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.354743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f0913022-c381-4509-af3f-c9f6ab5ca7b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18d6c5ca8d24cf5b17ec6081ebfbdb2', 'request_id': 'req-f0913022-c381-4509-af3f-c9f6ab5ca7b2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.364778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f0913022-c381-4509-af3f-c9f6ab5ca7b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18d6c5ca8d24cf5b17ec6081ebfbdb2', 'request_id': 'req-f0913022-c381-4509-af3f-c9f6ab5ca7b2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.376984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8129e95-4d28-4350-aa13-f608e5a740ab None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:45.399569 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f0913022-c381-4509-af3f-c9f6ab5ca7b2 admin admin] The token cache is being invalidate because project a18d6c5ca8d24cf5b17ec6081ebfbdb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:45.400024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f0913022-c381-4509-af3f-c9f6ab5ca7b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.400827 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f0913022-c381-4509-af3f-c9f6ab5ca7b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.411162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 960/1929] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:45 2022] DELETE /identity/v3/projects/a18d6c5ca8d24cf5b17ec6081ebfbdb2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:45.413941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0913022-c381-4509-af3f-c9f6ab5ca7b2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:45.416431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f0913022-c381-4509-af3f-c9f6ab5ca7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:45.524112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b024e37-2587-4d98-bae7-f0370f0d8a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:45.524867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b024e37-2587-4d98-bae7-f0370f0d8a8a service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:45.525321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b024e37-2587-4d98-bae7-f0370f0d8a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:45.525758 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b024e37-2587-4d98-bae7-f0370f0d8a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:45.527674 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7b024e37-2587-4d98-bae7-f0370f0d8a8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:45.576130 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0913022-c381-4509-af3f-c9f6ab5ca7b2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:45.581009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e631255-117e-46ec-bcba-5ecfb49ec95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:45.581654 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e631255-117e-46ec-bcba-5ecfb49ec95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:45.582009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e631255-117e-46ec-bcba-5ecfb49ec95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:45.582285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e631255-117e-46ec-bcba-5ecfb49ec95f admin admin] PATH_INFO: `/v3/users/800167ac5c77456eb517f14f43e7c6ad` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:45.584948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e631255-117e-46ec-bcba-5ecfb49ec95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=800167ac5c77456eb517f14f43e7c6ad)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:45.586900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e631255-117e-46ec-bcba-5ecfb49ec95f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:45.595861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:45.623998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b024e37-2587-4d98-bae7-f0370f0d8a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:45.625994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b024e37-2587-4d98-bae7-f0370f0d8a8a service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:45.645805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 970/1930] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:45.650293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8e631255-117e-46ec-bcba-5ecfb49ec95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800167ac5c77456eb517f14f43e7c6ad'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.653309 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8e631255-117e-46ec-bcba-5ecfb49ec95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800167ac5c77456eb517f14f43e7c6ad'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.654759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b024e37-2587-4d98-bae7-f0370f0d8a8a service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:45.664358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8e631255-117e-46ec-bcba-5ecfb49ec95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800167ac5c77456eb517f14f43e7c6ad'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.669161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7b024e37-2587-4d98-bae7-f0370f0d8a8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:45.684033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8e631255-117e-46ec-bcba-5ecfb49ec95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800167ac5c77456eb517f14f43e7c6ad'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.685451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8e631255-117e-46ec-bcba-5ecfb49ec95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800167ac5c77456eb517f14f43e7c6ad'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.688230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:45.688431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b024e37-2587-4d98-bae7-f0370f0d8a8a service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:45.699535 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afec891-5dda-499a-b184-8c542889906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:45.700210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afec891-5dda-499a-b184-8c542889906d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:45.700552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afec891-5dda-499a-b184-8c542889906d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:45.700771 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afec891-5dda-499a-b184-8c542889906d admin admin] PATH_INFO: `/v3/users/de8e28b81e8d4add8f1117b1a5fa491e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:45.704182 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afec891-5dda-499a-b184-8c542889906d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8e28b81e8d4add8f1117b1a5fa491e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:45.706109 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afec891-5dda-499a-b184-8c542889906d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:45.712804 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 961/1931] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:45 2022] DELETE /identity/v3/users/800167ac5c77456eb517f14f43e7c6ad => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:45.788775 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0afec891-5dda-499a-b184-8c542889906d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8e28b81e8d4add8f1117b1a5fa491e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.789843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0afec891-5dda-499a-b184-8c542889906d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8e28b81e8d4add8f1117b1a5fa491e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.800776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0afec891-5dda-499a-b184-8c542889906d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8e28b81e8d4add8f1117b1a5fa491e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.824500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0afec891-5dda-499a-b184-8c542889906d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8e28b81e8d4add8f1117b1a5fa491e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.825502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0afec891-5dda-499a-b184-8c542889906d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8e28b81e8d4add8f1117b1a5fa491e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:45.843335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 971/1932] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:45 2022] DELETE /identity/v3/users/de8e28b81e8d4add8f1117b1a5fa491e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:45.848818 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763e993-85af-40ed-a803-42555d3cdcbe None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:45.849296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763e993-85af-40ed-a803-42555d3cdcbe None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:45.849841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763e993-85af-40ed-a803-42555d3cdcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:45.877339 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3763e993-85af-40ed-a803-42555d3cdcbe None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:45.878808 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3763e993-85af-40ed-a803-42555d3cdcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:45.969945 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 962/1933] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:46.005373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afec891-5dda-499a-b184-8c542889906d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:46.008589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0afec891-5dda-499a-b184-8c542889906d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:46.110537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afec891-5dda-499a-b184-8c542889906d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:46.116799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaf401-d74c-41d0-a765-7e5b4faf3876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:46.117578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaf401-d74c-41d0-a765-7e5b4faf3876 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:46.117863 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaf401-d74c-41d0-a765-7e5b4faf3876 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:46.118252 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaf401-d74c-41d0-a765-7e5b4faf3876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:46.136794 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaf401-d74c-41d0-a765-7e5b4faf3876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:46.138332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaf401-d74c-41d0-a765-7e5b4faf3876 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:46.150378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 972/1934] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:46.167255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763e993-85af-40ed-a803-42555d3cdcbe None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:46.168855 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3763e993-85af-40ed-a803-42555d3cdcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:46.189698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763e993-85af-40ed-a803-42555d3cdcbe None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:46.196570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaf401-d74c-41d0-a765-7e5b4faf3876 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:46.198055 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4dfaf401-d74c-41d0-a765-7e5b4faf3876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:46.213424 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5766a67-0b33-4ea1-8c13-b203ad7bf325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:46.214850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5766a67-0b33-4ea1-8c13-b203ad7bf325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:46.215951 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5766a67-0b33-4ea1-8c13-b203ad7bf325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:46.216400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5766a67-0b33-4ea1-8c13-b203ad7bf325 admin admin] PATH_INFO: `/v3/projects/ddc3a4b0f7314eabb41dff7c49b2ed90` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:46.221490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5766a67-0b33-4ea1-8c13-b203ad7bf325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc3a4b0f7314eabb41dff7c49b2ed90)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:46.228403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5766a67-0b33-4ea1-8c13-b203ad7bf325 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:46.232905 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaf401-d74c-41d0-a765-7e5b4faf3876 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:46.238015 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796717c8-8afe-48b2-a88c-7afd88b23dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:46.238725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796717c8-8afe-48b2-a88c-7afd88b23dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:46.239094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796717c8-8afe-48b2-a88c-7afd88b23dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:46.239420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796717c8-8afe-48b2-a88c-7afd88b23dde admin admin] PATH_INFO: `/v3/projects/06bee943ed314fd598ca7ae803eb6db1` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:46.240649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796717c8-8afe-48b2-a88c-7afd88b23dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=06bee943ed314fd598ca7ae803eb6db1)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:46.242609 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796717c8-8afe-48b2-a88c-7afd88b23dde admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:46.325131 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:46.329570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-796717c8-8afe-48b2-a88c-7afd88b23dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06bee943ed314fd598ca7ae803eb6db1', 'request_id': 'req-796717c8-8afe-48b2-a88c-7afd88b23dde'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.331511 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b5766a67-0b33-4ea1-8c13-b203ad7bf325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc3a4b0f7314eabb41dff7c49b2ed90', 'request_id': 'req-b5766a67-0b33-4ea1-8c13-b203ad7bf325'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.345891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b5766a67-0b33-4ea1-8c13-b203ad7bf325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc3a4b0f7314eabb41dff7c49b2ed90', 'request_id': 'req-b5766a67-0b33-4ea1-8c13-b203ad7bf325'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.350062 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-796717c8-8afe-48b2-a88c-7afd88b23dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06bee943ed314fd598ca7ae803eb6db1', 'request_id': 'req-796717c8-8afe-48b2-a88c-7afd88b23dde'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.354730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b5766a67-0b33-4ea1-8c13-b203ad7bf325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc3a4b0f7314eabb41dff7c49b2ed90', 'request_id': 'req-b5766a67-0b33-4ea1-8c13-b203ad7bf325'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.359806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-796717c8-8afe-48b2-a88c-7afd88b23dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06bee943ed314fd598ca7ae803eb6db1', 'request_id': 'req-796717c8-8afe-48b2-a88c-7afd88b23dde'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.372791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-796717c8-8afe-48b2-a88c-7afd88b23dde admin admin] The token cache is being invalidate because project 06bee943ed314fd598ca7ae803eb6db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:46.373233 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-796717c8-8afe-48b2-a88c-7afd88b23dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.373806 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b5766a67-0b33-4ea1-8c13-b203ad7bf325 admin admin] The token cache is being invalidate because project ddc3a4b0f7314eabb41dff7c49b2ed90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:46.374120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-796717c8-8afe-48b2-a88c-7afd88b23dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.374585 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b5766a67-0b33-4ea1-8c13-b203ad7bf325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.375546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b5766a67-0b33-4ea1-8c13-b203ad7bf325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.380060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 973/1935] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:46 2022] DELETE /identity/v3/projects/06bee943ed314fd598ca7ae803eb6db1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:46.383024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3814d1d-28f4-4460-a366-a254d7245fee None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:46.383463 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3814d1d-28f4-4460-a366-a254d7245fee None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:46.383810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3814d1d-28f4-4460-a366-a254d7245fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:46.386805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 963/1936] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:46 2022] DELETE /identity/v3/projects/ddc3a4b0f7314eabb41dff7c49b2ed90 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:46.388103 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5766a67-0b33-4ea1-8c13-b203ad7bf325 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:46.390057 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b5766a67-0b33-4ea1-8c13-b203ad7bf325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:46.409844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f3814d1d-28f4-4460-a366-a254d7245fee None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:46.411202 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f3814d1d-28f4-4460-a366-a254d7245fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:46.527482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5766a67-0b33-4ea1-8c13-b203ad7bf325 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:46.552804 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 974/1937] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:46.559308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:46.569275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cdfaa-9512-421b-b613-bb67d0fb3f21 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:46.569963 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cdfaa-9512-421b-b613-bb67d0fb3f21 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:46.571046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cdfaa-9512-421b-b613-bb67d0fb3f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:46.615369 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2b6cdfaa-9512-421b-b613-bb67d0fb3f21 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:46.616755 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2b6cdfaa-9512-421b-b613-bb67d0fb3f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:46.628377 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 975/1938] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:46.630593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cdfaa-9512-421b-b613-bb67d0fb3f21 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:46.632333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2b6cdfaa-9512-421b-b613-bb67d0fb3f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:46.639377 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf21b7-c655-42e9-bc03-e60f1c7dc37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:46.640427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf21b7-c655-42e9-bc03-e60f1c7dc37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:46.640895 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf21b7-c655-42e9-bc03-e60f1c7dc37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:46.641428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf21b7-c655-42e9-bc03-e60f1c7dc37f admin admin] PATH_INFO: `/v3/users/a4cb3d3c295c4319b9682254e10f7fa0` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:46.643796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf21b7-c655-42e9-bc03-e60f1c7dc37f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cb3d3c295c4319b9682254e10f7fa0)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:46.646578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cdfaa-9512-421b-b613-bb67d0fb3f21 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:46.647270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf21b7-c655-42e9-bc03-e60f1c7dc37f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:46.653630 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:46.654203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:46.654815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:46.655131 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d admin admin] PATH_INFO: `/v3/projects/d7f4b687d7c64aaeae1d24f68882ac12` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:46.656336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f4b687d7c64aaeae1d24f68882ac12)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:46.659392 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:46.720263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bfbf21b7-c655-42e9-bc03-e60f1c7dc37f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cb3d3c295c4319b9682254e10f7fa0'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.722284 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bfbf21b7-c655-42e9-bc03-e60f1c7dc37f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cb3d3c295c4319b9682254e10f7fa0'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.740230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f4b687d7c64aaeae1d24f68882ac12', 'request_id': 'req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.741877 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bfbf21b7-c655-42e9-bc03-e60f1c7dc37f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cb3d3c295c4319b9682254e10f7fa0'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.760239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f4b687d7c64aaeae1d24f68882ac12', 'request_id': 'req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.773212 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bfbf21b7-c655-42e9-bc03-e60f1c7dc37f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cb3d3c295c4319b9682254e10f7fa0'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.774657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bfbf21b7-c655-42e9-bc03-e60f1c7dc37f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cb3d3c295c4319b9682254e10f7fa0'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.775623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f4b687d7c64aaeae1d24f68882ac12', 'request_id': 'req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.794164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d admin admin] The token cache is being invalidate because project d7f4b687d7c64aaeae1d24f68882ac12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:46.794470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.795218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:46.801848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 976/1939] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:46 2022] DELETE /identity/v3/projects/d7f4b687d7c64aaeae1d24f68882ac12 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:46.801848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:46.802275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:46.811837 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 964/1940] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:46 2022] DELETE /identity/v3/users/a4cb3d3c295c4319b9682254e10f7fa0 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:46.813197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8324c-8f46-44ef-b5b1-f7442dd86502 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:46.813669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8324c-8f46-44ef-b5b1-f7442dd86502 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:46.813744 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8324c-8f46-44ef-b5b1-f7442dd86502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:46.868591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-47c8324c-8f46-44ef-b5b1-f7442dd86502 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:46.871379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-47c8324c-8f46-44ef-b5b1-f7442dd86502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:46.900238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:46.930155 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d19ec3-a9ba-4d4c-9ca7-c066f81b3b5d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:46.974910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 965/1941] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:46.984745 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a7348-1375-4b15-b530-cf23047f7d28 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:46.985161 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a7348-1375-4b15-b530-cf23047f7d28 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:46.985542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a7348-1375-4b15-b530-cf23047f7d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.008281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c15a7348-1375-4b15-b530-cf23047f7d28 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:47.010148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c15a7348-1375-4b15-b530-cf23047f7d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:47.026119 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 966/1942] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:47.030526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a7348-1375-4b15-b530-cf23047f7d28 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:47.065698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a7348-1375-4b15-b530-cf23047f7d28 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:47.069556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b104f1-1f6a-411a-b58a-f46c9a6f7588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:47.070239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b104f1-1f6a-411a-b58a-f46c9a6f7588 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.070581 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b104f1-1f6a-411a-b58a-f46c9a6f7588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.070867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b104f1-1f6a-411a-b58a-f46c9a6f7588 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.071569 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b104f1-1f6a-411a-b58a-f46c9a6f7588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:47.071931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b104f1-1f6a-411a-b58a-f46c9a6f7588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:47.076006 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b104f1-1f6a-411a-b58a-f46c9a6f7588 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:47.078829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3863eb6-f4ce-4af8-bc3c-b92cb087ddb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:47.081319 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3863eb6-f4ce-4af8-bc3c-b92cb087ddb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.083249 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3863eb6-f4ce-4af8-bc3c-b92cb087ddb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.083677 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3863eb6-f4ce-4af8-bc3c-b92cb087ddb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.086638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3863eb6-f4ce-4af8-bc3c-b92cb087ddb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:47.088156 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3863eb6-f4ce-4af8-bc3c-b92cb087ddb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:47.094636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3863eb6-f4ce-4af8-bc3c-b92cb087ddb1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:47.105558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 977/1943] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:47.110206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b104f1-1f6a-411a-b58a-f46c9a6f7588 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:47.136086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b104f1-1f6a-411a-b58a-f46c9a6f7588 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:47.142771 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 967/1944] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:19:47.149470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9da7b6-b7f9-4eca-a802-1b57efb3e31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:47.150299 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9da7b6-b7f9-4eca-a802-1b57efb3e31c admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.150469 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3863eb6-f4ce-4af8-bc3c-b92cb087ddb1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:47.150570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9da7b6-b7f9-4eca-a802-1b57efb3e31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.151357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9da7b6-b7f9-4eca-a802-1b57efb3e31c admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.152381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9da7b6-b7f9-4eca-a802-1b57efb3e31c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:47.154360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9da7b6-b7f9-4eca-a802-1b57efb3e31c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:47.190503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3863eb6-f4ce-4af8-bc3c-b92cb087ddb1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:47.210630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e36f5c-455e-449d-8918-f384f3cbb2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:47.211566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e36f5c-455e-449d-8918-f384f3cbb2cb admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.212011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e36f5c-455e-449d-8918-f384f3cbb2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.212430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e36f5c-455e-449d-8918-f384f3cbb2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.213250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e36f5c-455e-449d-8918-f384f3cbb2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:47.215516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e36f5c-455e-449d-8918-f384f3cbb2cb admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:47.221563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 978/1945] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:47 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:47.222533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9da7b6-b7f9-4eca-a802-1b57efb3e31c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:47.229493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-eb9da7b6-b7f9-4eca-a802-1b57efb3e31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:47.259936 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:47.280531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 968/1946] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:47 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:47.281897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e36f5c-455e-449d-8918-f384f3cbb2cb admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:47.349862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9da7b6-b7f9-4eca-a802-1b57efb3e31c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:47.369982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e36f5c-455e-449d-8918-f384f3cbb2cb admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:47.377098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da1022-1672-4b89-8771-e31670862478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:47.377725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1022-1672-4b89-8771-e31670862478 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.378007 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1022-1672-4b89-8771-e31670862478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.378288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1022-1672-4b89-8771-e31670862478 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.378967 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da1022-1672-4b89-8771-e31670862478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:47.381483 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da1022-1672-4b89-8771-e31670862478 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:47.406083 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 969/1947] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:47 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:47.406783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da1022-1672-4b89-8771-e31670862478 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:47.424692 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da1022-1672-4b89-8771-e31670862478 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:47.433013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e38b5-0a08-4ac5-9a1a-e807a3e8f7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:47.433852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e38b5-0a08-4ac5-9a1a-e807a3e8f7ec admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.434133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e38b5-0a08-4ac5-9a1a-e807a3e8f7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.434405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e38b5-0a08-4ac5-9a1a-e807a3e8f7ec admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.435060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e38b5-0a08-4ac5-9a1a-e807a3e8f7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:47.437197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e38b5-0a08-4ac5-9a1a-e807a3e8f7ec admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:47.446407 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc3528-9734-4559-9a24-e1ba7c6c3980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:47.447606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc3528-9734-4559-9a24-e1ba7c6c3980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.447606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc3528-9734-4559-9a24-e1ba7c6c3980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.447893 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc3528-9734-4559-9a24-e1ba7c6c3980 admin admin] PATH_INFO: `/v3/projects/25c5be074231498f987ee7d01efa71e3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.449252 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc3528-9734-4559-9a24-e1ba7c6c3980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25c5be074231498f987ee7d01efa71e3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:47.451318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc3528-9734-4559-9a24-e1ba7c6c3980 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:47.467291 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 970/1948] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:47 2022] POST /identity/v3/users => generated 288 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:47.468242 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e38b5-0a08-4ac5-9a1a-e807a3e8f7ec admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:47.479473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e38b5-0a08-4ac5-9a1a-e807a3e8f7ec admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:47.484159 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d60731-7f98-4c0e-8cf4-55f0390e36d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:47.484776 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d60731-7f98-4c0e-8cf4-55f0390e36d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.485056 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d60731-7f98-4c0e-8cf4-55f0390e36d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.485331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d60731-7f98-4c0e-8cf4-55f0390e36d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.485969 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d60731-7f98-4c0e-8cf4-55f0390e36d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:47.487609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d60731-7f98-4c0e-8cf4-55f0390e36d2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:47.495006 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:47.503426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 971/1949] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:47.503426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d60731-7f98-4c0e-8cf4-55f0390e36d2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:47.513072 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d60731-7f98-4c0e-8cf4-55f0390e36d2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:47.529370 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9edc3528-9734-4559-9a24-e1ba7c6c3980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25c5be074231498f987ee7d01efa71e3', 'request_id': 'req-9edc3528-9734-4559-9a24-e1ba7c6c3980'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:47.539691 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9edc3528-9734-4559-9a24-e1ba7c6c3980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25c5be074231498f987ee7d01efa71e3', 'request_id': 'req-9edc3528-9734-4559-9a24-e1ba7c6c3980'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:47.546618 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9edc3528-9734-4559-9a24-e1ba7c6c3980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25c5be074231498f987ee7d01efa71e3', 'request_id': 'req-9edc3528-9734-4559-9a24-e1ba7c6c3980'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:47.559853 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9edc3528-9734-4559-9a24-e1ba7c6c3980 admin admin] The token cache is being invalidate because project 25c5be074231498f987ee7d01efa71e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:47.560146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9edc3528-9734-4559-9a24-e1ba7c6c3980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:47.560818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9edc3528-9734-4559-9a24-e1ba7c6c3980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:47.562345 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 979/1950] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:47 2022] DELETE /identity/v3/projects/25c5be074231498f987ee7d01efa71e3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:47.563263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc3528-9734-4559-9a24-e1ba7c6c3980 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:47.564589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9edc3528-9734-4559-9a24-e1ba7c6c3980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:47.601164 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6d9ce-9ab5-471d-b0ba-ca9feff27bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:47.601950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6d9ce-9ab5-471d-b0ba-ca9feff27bed admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.602288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6d9ce-9ab5-471d-b0ba-ca9feff27bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.602705 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6d9ce-9ab5-471d-b0ba-ca9feff27bed admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.604019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6d9ce-9ab5-471d-b0ba-ca9feff27bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:47.606253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6d9ce-9ab5-471d-b0ba-ca9feff27bed admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:47.618635 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 972/1951] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:47.619938 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb612774-50fc-4700-91a3-b05c3f961822 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.620278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb612774-50fc-4700-91a3-b05c3f961822 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.620556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb612774-50fc-4700-91a3-b05c3f961822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.643709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-eb612774-50fc-4700-91a3-b05c3f961822 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:47.644990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-eb612774-50fc-4700-91a3-b05c3f961822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:47.654066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc3528-9734-4559-9a24-e1ba7c6c3980 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:47.656708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 973/1952] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:47.657673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb612774-50fc-4700-91a3-b05c3f961822 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:47.664219 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-eb612774-50fc-4700-91a3-b05c3f961822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:47.667579 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b864de7-e42e-4292-a9a7-5b13e02dfee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:47.668412 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b864de7-e42e-4292-a9a7-5b13e02dfee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.673604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b864de7-e42e-4292-a9a7-5b13e02dfee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.673604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b864de7-e42e-4292-a9a7-5b13e02dfee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.673604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b864de7-e42e-4292-a9a7-5b13e02dfee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:47.673604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b864de7-e42e-4292-a9a7-5b13e02dfee6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:47.682517 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb612774-50fc-4700-91a3-b05c3f961822 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:47.687624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf382a-f902-419d-80b6-6e1643594709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:47.688307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf382a-f902-419d-80b6-6e1643594709 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.688679 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf382a-f902-419d-80b6-6e1643594709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.689022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf382a-f902-419d-80b6-6e1643594709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.689728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf382a-f902-419d-80b6-6e1643594709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:47.691442 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf382a-f902-419d-80b6-6e1643594709 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:47.698718 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 980/1953] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:47.700994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a305208-fee1-47d5-a4c8-ff2e306b5081 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.701285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a305208-fee1-47d5-a4c8-ff2e306b5081 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.701805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a305208-fee1-47d5-a4c8-ff2e306b5081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.702761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 974/1954] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:47.703698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf382a-f902-419d-80b6-6e1643594709 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:47.723518 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1a305208-fee1-47d5-a4c8-ff2e306b5081 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:47.724998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1a305208-fee1-47d5-a4c8-ff2e306b5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:47.737002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf382a-f902-419d-80b6-6e1643594709 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:47.741492 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 981/1955] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:47.742122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a305208-fee1-47d5-a4c8-ff2e306b5081 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:47.746726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c30c40-5939-40f9-bea0-37298c5999d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:47.747635 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c30c40-5939-40f9-bea0-37298c5999d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.748109 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c30c40-5939-40f9-bea0-37298c5999d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.748545 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c30c40-5939-40f9-bea0-37298c5999d6 admin admin] PATH_INFO: `/v3/projects/5756266bd63d45c2974b788230bd18fe/users/305b70fc32dd4f44ac01f3fa90cd7c53/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.754499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a305208-fee1-47d5-a4c8-ff2e306b5081 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:47.759652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90666-e234-4dab-bb36-4965c0280782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:47.760887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90666-e234-4dab-bb36-4965c0280782 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.760887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90666-e234-4dab-bb36-4965c0280782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.761090 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90666-e234-4dab-bb36-4965c0280782 admin admin] PATH_INFO: `/v3/projects/73dc464ab5b44e2ca7ce450907f730d9/users/91815c1307cf43c8a1fb6bb71add76e9/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.779301 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef90666-e234-4dab-bb36-4965c0280782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dc464ab5b44e2ca7ce450907f730d9, user_id=91815c1307cf43c8a1fb6bb71add76e9, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:47.781995 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef90666-e234-4dab-bb36-4965c0280782 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:47.783938 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c30c40-5939-40f9-bea0-37298c5999d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5756266bd63d45c2974b788230bd18fe, user_id=305b70fc32dd4f44ac01f3fa90cd7c53, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:47.788094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c30c40-5939-40f9-bea0-37298c5999d6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:47.799457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 982/1956] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:47 2022] PUT /identity/v3/projects/73dc464ab5b44e2ca7ce450907f730d9/users/91815c1307cf43c8a1fb6bb71add76e9/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:47.811697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90666-e234-4dab-bb36-4965c0280782 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:47.814465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 975/1957] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:47 2022] PUT /identity/v3/projects/5756266bd63d45c2974b788230bd18fe/users/305b70fc32dd4f44ac01f3fa90cd7c53/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:47.816081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dc751-dc22-421c-ab23-9f325929485d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.816557 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dc751-dc22-421c-ab23-9f325929485d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.817169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dc751-dc22-421c-ab23-9f325929485d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.866657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f88dc751-dc22-421c-ab23-9f325929485d None None] MFA Rules not processed for user `91815c1307cf43c8a1fb6bb71add76e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:47.868472 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f88dc751-dc22-421c-ab23-9f325929485d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:47.873099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:47.906140 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90666-e234-4dab-bb36-4965c0280782 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:47.933057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:47.941686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 976/1958] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:47.943807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601591d-88ba-42ed-96a3-c3149825dabe None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.944213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601591d-88ba-42ed-96a3-c3149825dabe None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.944591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601591d-88ba-42ed-96a3-c3149825dabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.985582 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0601591d-88ba-42ed-96a3-c3149825dabe None None] MFA Rules not processed for user `305b70fc32dd4f44ac01f3fa90cd7c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:47.986981 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0601591d-88ba-42ed-96a3-c3149825dabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:47.993180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4505470-e2b0-40aa-aee2-5b375a34ff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:47.994367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505470-e2b0-40aa-aee2-5b375a34ff61 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:47.994367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505470-e2b0-40aa-aee2-5b375a34ff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:47.994367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505470-e2b0-40aa-aee2-5b375a34ff61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:47.994970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4505470-e2b0-40aa-aee2-5b375a34ff61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:47.995318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4505470-e2b0-40aa-aee2-5b375a34ff61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:47.996962 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4505470-e2b0-40aa-aee2-5b375a34ff61 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:48.012920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 983/1959] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:48.013677 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4505470-e2b0-40aa-aee2-5b375a34ff61 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:48.015796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a4505470-e2b0-40aa-aee2-5b375a34ff61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:48.086568 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 977/1960] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:48.087597 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601591d-88ba-42ed-96a3-c3149825dabe None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:48.116927 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601591d-88ba-42ed-96a3-c3149825dabe None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:48.122982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2e9d9-99c9-4887-91a9-7e72196ef5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:48.123660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2e9d9-99c9-4887-91a9-7e72196ef5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:48.124052 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2e9d9-99c9-4887-91a9-7e72196ef5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:48.124322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2e9d9-99c9-4887-91a9-7e72196ef5f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:48.125181 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2e9d9-99c9-4887-91a9-7e72196ef5f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:48.125888 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4505470-e2b0-40aa-aee2-5b375a34ff61 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:48.127631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2e9d9-99c9-4887-91a9-7e72196ef5f5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:48.131056 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667aa0d-2bfb-4c76-8663-41b57a6bb085 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:48.131850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667aa0d-2bfb-4c76-8663-41b57a6bb085 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:48.132239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667aa0d-2bfb-4c76-8663-41b57a6bb085 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:48.132622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667aa0d-2bfb-4c76-8663-41b57a6bb085 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:48.142217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667aa0d-2bfb-4c76-8663-41b57a6bb085 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:48.143792 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667aa0d-2bfb-4c76-8663-41b57a6bb085 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:48.155730 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 984/1961] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:48.156599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667aa0d-2bfb-4c76-8663-41b57a6bb085 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:48.160184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f667aa0d-2bfb-4c76-8663-41b57a6bb085 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:48.173299 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 978/1962] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:48 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:48.177892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2e9d9-99c9-4887-91a9-7e72196ef5f5 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:48.179095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667aa0d-2bfb-4c76-8663-41b57a6bb085 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:48.243944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63842b-513d-472c-a988-5bea625bd441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:48.244724 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63842b-513d-472c-a988-5bea625bd441 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:48.245097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63842b-513d-472c-a988-5bea625bd441 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:48.245498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63842b-513d-472c-a988-5bea625bd441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:48.259232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2e9d9-99c9-4887-91a9-7e72196ef5f5 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:48.264711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbfe0a-c178-4703-a5fb-aa063f6d9d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:48.265427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbfe0a-c178-4703-a5fb-aa063f6d9d8c admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:48.265821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbfe0a-c178-4703-a5fb-aa063f6d9d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:48.266192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbfe0a-c178-4703-a5fb-aa063f6d9d8c admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:48.266919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbfe0a-c178-4703-a5fb-aa063f6d9d8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:48.268999 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbfe0a-c178-4703-a5fb-aa063f6d9d8c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:48.301885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 979/1963] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:48 2022] POST /identity/v3/users => generated 285 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:48.306081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbfe0a-c178-4703-a5fb-aa063f6d9d8c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:48.311624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:48.314242 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63842b-513d-472c-a988-5bea625bd441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:48.315998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63842b-513d-472c-a988-5bea625bd441 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:48.318981 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbfe0a-c178-4703-a5fb-aa063f6d9d8c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:48.326446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 985/1964] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:48.329672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a714c-130b-4277-bee9-38c2de235226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:48.330730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a714c-130b-4277-bee9-38c2de235226 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:48.330966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a714c-130b-4277-bee9-38c2de235226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:48.331238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a714c-130b-4277-bee9-38c2de235226 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:48.332219 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a714c-130b-4277-bee9-38c2de235226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:48.335600 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a714c-130b-4277-bee9-38c2de235226 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:48.348485 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63842b-513d-472c-a988-5bea625bd441 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:48.357499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 980/1965] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:19:48.361511 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a714c-130b-4277-bee9-38c2de235226 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:48.362812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63842b-513d-472c-a988-5bea625bd441 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:48.373618 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd371711-1a45-4b0a-9c36-b868925ee221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:48.374270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd371711-1a45-4b0a-9c36-b868925ee221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:48.374666 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd371711-1a45-4b0a-9c36-b868925ee221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:48.374985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd371711-1a45-4b0a-9c36-b868925ee221 admin admin] PATH_INFO: `/v3/users/305b70fc32dd4f44ac01f3fa90cd7c53` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:48.375285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a714c-130b-4277-bee9-38c2de235226 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:48.376130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd371711-1a45-4b0a-9c36-b868925ee221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=305b70fc32dd4f44ac01f3fa90cd7c53)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:48.378415 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd371711-1a45-4b0a-9c36-b868925ee221 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:48.381537 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6730b61-fba4-4baf-b0b8-81f1d77b9c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:48.382370 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6730b61-fba4-4baf-b0b8-81f1d77b9c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:48.382827 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6730b61-fba4-4baf-b0b8-81f1d77b9c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:48.383374 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6730b61-fba4-4baf-b0b8-81f1d77b9c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:48.384367 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6730b61-fba4-4baf-b0b8-81f1d77b9c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:48.385749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:48.386579 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6730b61-fba4-4baf-b0b8-81f1d77b9c0a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:48.423732 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 981/1966] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:19:48.423732 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6730b61-fba4-4baf-b0b8-81f1d77b9c0a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:48.443351 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6730b61-fba4-4baf-b0b8-81f1d77b9c0a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:48.466311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d3c15-1ca8-4f10-9034-d685b1c20de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:48.466311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d3c15-1ca8-4f10-9034-d685b1c20de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:48.466311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d3c15-1ca8-4f10-9034-d685b1c20de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:48.467771 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d3c15-1ca8-4f10-9034-d685b1c20de4 admin admin] PATH_INFO: `/v3/projects/511b51d5a94040da875d5d7079e0563c/users/cf1434f62508447289982187e70dba31/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:48.490655 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cd371711-1a45-4b0a-9c36-b868925ee221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '305b70fc32dd4f44ac01f3fa90cd7c53'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:48.493083 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cd371711-1a45-4b0a-9c36-b868925ee221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '305b70fc32dd4f44ac01f3fa90cd7c53'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:48.511140 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cd371711-1a45-4b0a-9c36-b868925ee221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '305b70fc32dd4f44ac01f3fa90cd7c53'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:48.538275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d3c15-1ca8-4f10-9034-d685b1c20de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=511b51d5a94040da875d5d7079e0563c, user_id=cf1434f62508447289982187e70dba31, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:48.540934 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cd371711-1a45-4b0a-9c36-b868925ee221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '305b70fc32dd4f44ac01f3fa90cd7c53'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:48.541501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cd371711-1a45-4b0a-9c36-b868925ee221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '305b70fc32dd4f44ac01f3fa90cd7c53'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:48.570643 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 986/1967] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:48 2022] DELETE /identity/v3/users/305b70fc32dd4f44ac01f3fa90cd7c53 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:48.574504 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d3c15-1ca8-4f10-9034-d685b1c20de4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:48.575373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3564ea-46cd-402a-8708-c930b089ea58 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:48.575666 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3564ea-46cd-402a-8708-c930b089ea58 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:48.576021 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3564ea-46cd-402a-8708-c930b089ea58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:48.622115 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7d3564ea-46cd-402a-8708-c930b089ea58 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:48.623398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7d3564ea-46cd-402a-8708-c930b089ea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:48.626392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 982/1968] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:48 2022] PUT /identity/v3/projects/511b51d5a94040da875d5d7079e0563c/users/cf1434f62508447289982187e70dba31/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:48.637991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581060d4-ee4f-4b77-b808-74d485a4dca1 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:48.638384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581060d4-ee4f-4b77-b808-74d485a4dca1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:48.638890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581060d4-ee4f-4b77-b808-74d485a4dca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:48.730111 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-581060d4-ee4f-4b77-b808-74d485a4dca1 None None] MFA Rules not processed for user `cf1434f62508447289982187e70dba31`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:48.731935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-581060d4-ee4f-4b77-b808-74d485a4dca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:48.794709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 987/1969] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:48.811384 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3564ea-46cd-402a-8708-c930b089ea58 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:48.813753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7d3564ea-46cd-402a-8708-c930b089ea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:48.846800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 983/1970] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:48.852255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581060d4-ee4f-4b77-b808-74d485a4dca1 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:48.855675 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-581060d4-ee4f-4b77-b808-74d485a4dca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:48.878167 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581060d4-ee4f-4b77-b808-74d485a4dca1 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:48.888029 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf07a8-82a0-4996-9d33-a61d4179b761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:48.889058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf07a8-82a0-4996-9d33-a61d4179b761 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:48.889461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf07a8-82a0-4996-9d33-a61d4179b761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:48.889817 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf07a8-82a0-4996-9d33-a61d4179b761 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:48.890685 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf07a8-82a0-4996-9d33-a61d4179b761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:48.893131 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf07a8-82a0-4996-9d33-a61d4179b761 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:48.939464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3564ea-46cd-402a-8708-c930b089ea58 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:48.944725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e21be9-9f55-45e3-bcfc-00d07ea68ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:48.945434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e21be9-9f55-45e3-bcfc-00d07ea68ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:48.945831 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e21be9-9f55-45e3-bcfc-00d07ea68ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:48.946184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e21be9-9f55-45e3-bcfc-00d07ea68ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:48.948743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 984/1971] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:48 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:48.949934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf07a8-82a0-4996-9d33-a61d4179b761 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:48.951821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-20cf07a8-82a0-4996-9d33-a61d4179b761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:48.961797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e21be9-9f55-45e3-bcfc-00d07ea68ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:48.964661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e21be9-9f55-45e3-bcfc-00d07ea68ee6 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:48.977991 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 988/1972] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:19:48.980035 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e21be9-9f55-45e3-bcfc-00d07ea68ee6 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:48.993672 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e21be9-9f55-45e3-bcfc-00d07ea68ee6 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:49.041902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:49.104737 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf07a8-82a0-4996-9d33-a61d4179b761 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:49.113282 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6b1e5-0a7e-4649-b3f7-a9e11fd31745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:49.115690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6b1e5-0a7e-4649-b3f7-a9e11fd31745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:49.116218 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6b1e5-0a7e-4649-b3f7-a9e11fd31745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:49.116692 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6b1e5-0a7e-4649-b3f7-a9e11fd31745 admin admin] PATH_INFO: `/v3/users/991af6c712e24a53adbe6acd6e298c5c` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:49.118151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6b1e5-0a7e-4649-b3f7-a9e11fd31745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=991af6c712e24a53adbe6acd6e298c5c)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:49.121794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6b1e5-0a7e-4649-b3f7-a9e11fd31745 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:49.124055 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bace024-7b0e-4d20-a89b-d86574209569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:49.124224 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bace024-7b0e-4d20-a89b-d86574209569 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:49.124483 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bace024-7b0e-4d20-a89b-d86574209569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:49.124770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bace024-7b0e-4d20-a89b-d86574209569 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:49.125417 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bace024-7b0e-4d20-a89b-d86574209569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:49.127573 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bace024-7b0e-4d20-a89b-d86574209569 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:49.162344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 989/1973] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:48 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:49.165736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:49.170000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bace024-7b0e-4d20-a89b-d86574209569 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:49.187373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bace024-7b0e-4d20-a89b-d86574209569 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:49.193766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a1de3-c630-4a8c-b63d-f92eb0791902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:49.194653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a1de3-c630-4a8c-b63d-f92eb0791902 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:49.195046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a1de3-c630-4a8c-b63d-f92eb0791902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:49.195464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a1de3-c630-4a8c-b63d-f92eb0791902 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:49.197003 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a1de3-c630-4a8c-b63d-f92eb0791902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:49.198470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a1de3-c630-4a8c-b63d-f92eb0791902 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:49.217193 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 990/1974] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:49.218573 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a1de3-c630-4a8c-b63d-f92eb0791902 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:49.223734 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-faa6b1e5-0a7e-4649-b3f7-a9e11fd31745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991af6c712e24a53adbe6acd6e298c5c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:49.225896 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-faa6b1e5-0a7e-4649-b3f7-a9e11fd31745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991af6c712e24a53adbe6acd6e298c5c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:49.231479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a1de3-c630-4a8c-b63d-f92eb0791902 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:49.243781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2575fb-8c15-4b94-9cbb-82627a2fe352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:49.244531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-faa6b1e5-0a7e-4649-b3f7-a9e11fd31745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991af6c712e24a53adbe6acd6e298c5c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:49.244644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2575fb-8c15-4b94-9cbb-82627a2fe352 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:49.245823 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2575fb-8c15-4b94-9cbb-82627a2fe352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:49.246190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2575fb-8c15-4b94-9cbb-82627a2fe352 admin admin] PATH_INFO: `/v3/projects/35495ae882d94cc78c2fff7d50b7e4dd/users/0b79936546fb420c8e4fe172d2c12516/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:49.264424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2575fb-8c15-4b94-9cbb-82627a2fe352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35495ae882d94cc78c2fff7d50b7e4dd, user_id=0b79936546fb420c8e4fe172d2c12516, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:49.267366 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2575fb-8c15-4b94-9cbb-82627a2fe352 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:49.279223 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-faa6b1e5-0a7e-4649-b3f7-a9e11fd31745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991af6c712e24a53adbe6acd6e298c5c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:49.281328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-faa6b1e5-0a7e-4649-b3f7-a9e11fd31745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991af6c712e24a53adbe6acd6e298c5c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:49.284348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 991/1975] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:49 2022] PUT /identity/v3/projects/35495ae882d94cc78c2fff7d50b7e4dd/users/0b79936546fb420c8e4fe172d2c12516/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:49.288877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2575fb-8c15-4b94-9cbb-82627a2fe352 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:49.291178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fd2575fb-8c15-4b94-9cbb-82627a2fe352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:49.309299 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 985/1976] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:48 2022] DELETE /identity/v3/users/991af6c712e24a53adbe6acd6e298c5c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:49.313843 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef48cc1-ead8-4dc9-80d1-201685535f8a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:49.314132 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef48cc1-ead8-4dc9-80d1-201685535f8a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:49.314409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef48cc1-ead8-4dc9-80d1-201685535f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:49.356040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-aef48cc1-ead8-4dc9-80d1-201685535f8a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:49.357527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-aef48cc1-ead8-4dc9-80d1-201685535f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:49.396722 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2575fb-8c15-4b94-9cbb-82627a2fe352 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:49.509939 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 986/1977] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:19:49.509939 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef48cc1-ead8-4dc9-80d1-201685535f8a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:49.510328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-aef48cc1-ead8-4dc9-80d1-201685535f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:49.539371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef48cc1-ead8-4dc9-80d1-201685535f8a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:49.547498 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd962d47-9639-4d5a-bdbb-290654fe58b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:49.548555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd962d47-9639-4d5a-bdbb-290654fe58b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:49.549433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd962d47-9639-4d5a-bdbb-290654fe58b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:49.549721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd962d47-9639-4d5a-bdbb-290654fe58b1 admin admin] PATH_INFO: `/v3/projects/5756266bd63d45c2974b788230bd18fe` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:49.551192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd962d47-9639-4d5a-bdbb-290654fe58b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5756266bd63d45c2974b788230bd18fe)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:49.555986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd962d47-9639-4d5a-bdbb-290654fe58b1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:49.560937 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821aa66a-36f9-4138-bc00-6118cfc363a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:49.561780 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aa66a-36f9-4138-bc00-6118cfc363a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:49.562380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aa66a-36f9-4138-bc00-6118cfc363a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:49.562816 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aa66a-36f9-4138-bc00-6118cfc363a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:49.563763 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821aa66a-36f9-4138-bc00-6118cfc363a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:49.565679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821aa66a-36f9-4138-bc00-6118cfc363a9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:49.583310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 992/1978] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:49.584757 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821aa66a-36f9-4138-bc00-6118cfc363a9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:49.586636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-821aa66a-36f9-4138-bc00-6118cfc363a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:49.649555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bd962d47-9639-4d5a-bdbb-290654fe58b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5756266bd63d45c2974b788230bd18fe', 'request_id': 'req-bd962d47-9639-4d5a-bdbb-290654fe58b1'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:49.649807 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:49.657893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bd962d47-9639-4d5a-bdbb-290654fe58b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5756266bd63d45c2974b788230bd18fe', 'request_id': 'req-bd962d47-9639-4d5a-bdbb-290654fe58b1'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:49.665889 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bd962d47-9639-4d5a-bdbb-290654fe58b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5756266bd63d45c2974b788230bd18fe', 'request_id': 'req-bd962d47-9639-4d5a-bdbb-290654fe58b1'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:49.686857 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bd962d47-9639-4d5a-bdbb-290654fe58b1 admin admin] The token cache is being invalidate because project 5756266bd63d45c2974b788230bd18fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:49.687346 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bd962d47-9639-4d5a-bdbb-290654fe58b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:49.687450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821aa66a-36f9-4138-bc00-6118cfc363a9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:49.688136 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bd962d47-9639-4d5a-bdbb-290654fe58b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:49.690159 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 987/1979] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:49 2022] DELETE /identity/v3/projects/5756266bd63d45c2974b788230bd18fe => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:49.694732 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd962d47-9639-4d5a-bdbb-290654fe58b1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:49.696189 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bd962d47-9639-4d5a-bdbb-290654fe58b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:49.736535 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:49.750032 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f3b67-95ef-4abd-a7b7-11f0022ec694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:49.750634 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f3b67-95ef-4abd-a7b7-11f0022ec694 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:49.750917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f3b67-95ef-4abd-a7b7-11f0022ec694 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:49.751224 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f3b67-95ef-4abd-a7b7-11f0022ec694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:49.753023 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d26f3b67-95ef-4abd-a7b7-11f0022ec694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:49.778211 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd962d47-9639-4d5a-bdbb-290654fe58b1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:49.782886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3d919-5f57-4a96-948f-a6d0685d9e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:49.783586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3d919-5f57-4a96-948f-a6d0685d9e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:49.783869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3d919-5f57-4a96-948f-a6d0685d9e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:49.784145 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3d919-5f57-4a96-948f-a6d0685d9e47 admin admin] PATH_INFO: `/v3/projects/35495ae882d94cc78c2fff7d50b7e4dd/users/0b79936546fb420c8e4fe172d2c12516/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:49.786648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3d919-5f57-4a96-948f-a6d0685d9e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35495ae882d94cc78c2fff7d50b7e4dd, user_id=0b79936546fb420c8e4fe172d2c12516, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:49.789317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3d919-5f57-4a96-948f-a6d0685d9e47 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:49.800566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 988/1980] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:49 2022] PUT /identity/v3/projects/35495ae882d94cc78c2fff7d50b7e4dd/users/0b79936546fb420c8e4fe172d2c12516/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:49.801869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f1df-3f1d-461c-818a-7cae08934339 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:49.802161 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f1df-3f1d-461c-818a-7cae08934339 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:49.802434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f1df-3f1d-461c-818a-7cae08934339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:49.825801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-cc97f1df-3f1d-461c-818a-7cae08934339 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:49.827028 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-cc97f1df-3f1d-461c-818a-7cae08934339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:49.831719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f3b67-95ef-4abd-a7b7-11f0022ec694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:49.833991 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f3b67-95ef-4abd-a7b7-11f0022ec694 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:49.843446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 993/1981] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:49.844672 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c4db0-ee13-46dd-8855-ea01d39456e8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:49.844961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c4db0-ee13-46dd-8855-ea01d39456e8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:49.845238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c4db0-ee13-46dd-8855-ea01d39456e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:49.866837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-482c4db0-ee13-46dd-8855-ea01d39456e8 None None] MFA Rules not processed for user `91815c1307cf43c8a1fb6bb71add76e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:49.868130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-482c4db0-ee13-46dd-8855-ea01d39456e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:49.907826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 989/1982] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:49.909370 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06848b1-9231-4046-be50-320d14be9943 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:49.909653 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06848b1-9231-4046-be50-320d14be9943 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:49.909977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06848b1-9231-4046-be50-320d14be9943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:49.947159 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c06848b1-9231-4046-be50-320d14be9943 None None] MFA Rules not processed for user `0b79936546fb420c8e4fe172d2c12516`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:49.948714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c06848b1-9231-4046-be50-320d14be9943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:49.975329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 994/1983] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:49.977287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175dec4-804d-4559-abab-7b52c3e7dd62 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:49.977729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175dec4-804d-4559-abab-7b52c3e7dd62 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:49.978174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175dec4-804d-4559-abab-7b52c3e7dd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:50.007835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7175dec4-804d-4559-abab-7b52c3e7dd62 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:50.009101 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7175dec4-804d-4559-abab-7b52c3e7dd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:50.031329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 995/1984] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:50.035570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175dec4-804d-4559-abab-7b52c3e7dd62 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:50.047055 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175dec4-804d-4559-abab-7b52c3e7dd62 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:50.055152 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b99d19-6672-48b3-94ee-47278062df5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:50.055805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b99d19-6672-48b3-94ee-47278062df5d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:50.056344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b99d19-6672-48b3-94ee-47278062df5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:50.056684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b99d19-6672-48b3-94ee-47278062df5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:50.057527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b99d19-6672-48b3-94ee-47278062df5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:50.057795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b99d19-6672-48b3-94ee-47278062df5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:50.063368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 990/1985] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:50.065948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b99d19-6672-48b3-94ee-47278062df5d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:50.071994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06848b1-9231-4046-be50-320d14be9943 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:50.073708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c06848b1-9231-4046-be50-320d14be9943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:50.091386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 996/1986] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:50.093101 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b99d19-6672-48b3-94ee-47278062df5d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:50.105996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b99d19-6672-48b3-94ee-47278062df5d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:50.112942 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379d12-bcb0-4901-ba43-10bd05aa0f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:50.113578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379d12-bcb0-4901-ba43-10bd05aa0f3a admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:50.114471 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379d12-bcb0-4901-ba43-10bd05aa0f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:50.114846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379d12-bcb0-4901-ba43-10bd05aa0f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:50.115541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3379d12-bcb0-4901-ba43-10bd05aa0f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:50.117455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3379d12-bcb0-4901-ba43-10bd05aa0f3a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:50.148860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:50.171233 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 997/1987] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:50 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:19:50.174764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379d12-bcb0-4901-ba43-10bd05aa0f3a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:50.184159 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:50.191636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06848b1-9231-4046-be50-320d14be9943 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:50.275500 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c35027-993a-4122-8a4d-6d4adf634844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:50.276699 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c35027-993a-4122-8a4d-6d4adf634844 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:50.277147 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c35027-993a-4122-8a4d-6d4adf634844 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:50.277720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c35027-993a-4122-8a4d-6d4adf634844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:50.336089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379d12-bcb0-4901-ba43-10bd05aa0f3a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:50.343563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23434dc0-0cb5-462d-90f7-e85d595c0f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:50.344391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23434dc0-0cb5-462d-90f7-e85d595c0f84 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:50.344674 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23434dc0-0cb5-462d-90f7-e85d595c0f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:50.345254 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23434dc0-0cb5-462d-90f7-e85d595c0f84 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:50.345984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23434dc0-0cb5-462d-90f7-e85d595c0f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:50.348014 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23434dc0-0cb5-462d-90f7-e85d595c0f84 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:50.383092 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 998/1988] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:50 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:50.383092 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23434dc0-0cb5-462d-90f7-e85d595c0f84 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:50.383092 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-23434dc0-0cb5-462d-90f7-e85d595c0f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:50.390522 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23434dc0-0cb5-462d-90f7-e85d595c0f84 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:50.396148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a67a3-f02a-44f4-af47-7c0490e7ba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:50.396795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a67a3-f02a-44f4-af47-7c0490e7ba0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:50.397347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a67a3-f02a-44f4-af47-7c0490e7ba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:50.397347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a67a3-f02a-44f4-af47-7c0490e7ba0e admin admin] PATH_INFO: `/v3/projects/85916123cd2842e1bfdf45c73decf22b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:50.398463 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a67a3-f02a-44f4-af47-7c0490e7ba0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=85916123cd2842e1bfdf45c73decf22b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:50.400405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a67a3-f02a-44f4-af47-7c0490e7ba0e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:50.405521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c35027-993a-4122-8a4d-6d4adf634844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:50.407044 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c35027-993a-4122-8a4d-6d4adf634844 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:50.435281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 991/1989] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:19:50.436966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c35027-993a-4122-8a4d-6d4adf634844 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:50.456342 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c35027-993a-4122-8a4d-6d4adf634844 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:50.474013 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-669a67a3-f02a-44f4-af47-7c0490e7ba0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85916123cd2842e1bfdf45c73decf22b', 'request_id': 'req-669a67a3-f02a-44f4-af47-7c0490e7ba0e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:50.488899 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-669a67a3-f02a-44f4-af47-7c0490e7ba0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85916123cd2842e1bfdf45c73decf22b', 'request_id': 'req-669a67a3-f02a-44f4-af47-7c0490e7ba0e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:50.502100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-669a67a3-f02a-44f4-af47-7c0490e7ba0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85916123cd2842e1bfdf45c73decf22b', 'request_id': 'req-669a67a3-f02a-44f4-af47-7c0490e7ba0e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:50.525513 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-669a67a3-f02a-44f4-af47-7c0490e7ba0e admin admin] The token cache is being invalidate because project 85916123cd2842e1bfdf45c73decf22b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:50.525807 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-669a67a3-f02a-44f4-af47-7c0490e7ba0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:50.537695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-669a67a3-f02a-44f4-af47-7c0490e7ba0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:50.543151 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 999/1990] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:50 2022] DELETE /identity/v3/projects/85916123cd2842e1bfdf45c73decf22b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:50.544457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a67a3-f02a-44f4-af47-7c0490e7ba0e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:50.550044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-669a67a3-f02a-44f4-af47-7c0490e7ba0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:50.569168 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5906e-34d0-4877-b752-8a04b0b713c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:50.570418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5906e-34d0-4877-b752-8a04b0b713c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:50.570418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5906e-34d0-4877-b752-8a04b0b713c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:50.570645 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5906e-34d0-4877-b752-8a04b0b713c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:50.571283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5906e-34d0-4877-b752-8a04b0b713c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:50.572097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a67a3-f02a-44f4-af47-7c0490e7ba0e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:50.573731 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5906e-34d0-4877-b752-8a04b0b713c5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:50.587263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d7672-5414-4a9e-969b-4cea16525cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:50.589186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d7672-5414-4a9e-969b-4cea16525cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:50.589801 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d7672-5414-4a9e-969b-4cea16525cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:50.590984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d7672-5414-4a9e-969b-4cea16525cc5 admin admin] PATH_INFO: `/v3/users/434bd386c732462f8c3b8212fe8d74ee` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:50.593874 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 992/1991] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:50.597791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d7672-5414-4a9e-969b-4cea16525cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=434bd386c732462f8c3b8212fe8d74ee)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:50.599618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5906e-34d0-4877-b752-8a04b0b713c5 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:50.601791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-02e5906e-34d0-4877-b752-8a04b0b713c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:50.602647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d7672-5414-4a9e-969b-4cea16525cc5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:50.635677 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5906e-34d0-4877-b752-8a04b0b713c5 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:50.647599 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd1fc1-b205-4eb5-86ba-9dea59b3095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:50.650619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd1fc1-b205-4eb5-86ba-9dea59b3095d admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:50.651167 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd1fc1-b205-4eb5-86ba-9dea59b3095d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:50.651672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd1fc1-b205-4eb5-86ba-9dea59b3095d admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:50.654093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd1fc1-b205-4eb5-86ba-9dea59b3095d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:50.656259 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd1fc1-b205-4eb5-86ba-9dea59b3095d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:50.696589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 993/1992] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:50.700947 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd1fc1-b205-4eb5-86ba-9dea59b3095d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:50.714003 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b16d7672-5414-4a9e-969b-4cea16525cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434bd386c732462f8c3b8212fe8d74ee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:50.716081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b16d7672-5414-4a9e-969b-4cea16525cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434bd386c732462f8c3b8212fe8d74ee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:50.716716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd1fc1-b205-4eb5-86ba-9dea59b3095d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:50.723415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6abff9-672f-4de5-8e87-080547abd66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:50.724500 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6abff9-672f-4de5-8e87-080547abd66a admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:50.729203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b16d7672-5414-4a9e-969b-4cea16525cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434bd386c732462f8c3b8212fe8d74ee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:50.732511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:50.733987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6abff9-672f-4de5-8e87-080547abd66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:50.735151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6abff9-672f-4de5-8e87-080547abd66a admin admin] PATH_INFO: `/v3/projects/1d1b3a83be874e36b4346c4adc41fe77/users/4167b300c9ea44f8bceaf0d4271fd9f8/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:50.744562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b16d7672-5414-4a9e-969b-4cea16525cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434bd386c732462f8c3b8212fe8d74ee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:50.746316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b16d7672-5414-4a9e-969b-4cea16525cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434bd386c732462f8c3b8212fe8d74ee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:50.765737 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6abff9-672f-4de5-8e87-080547abd66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1b3a83be874e36b4346c4adc41fe77, user_id=4167b300c9ea44f8bceaf0d4271fd9f8, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:50.768706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6abff9-672f-4de5-8e87-080547abd66a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:50.786619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1000/1993] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:50 2022] DELETE /identity/v3/users/434bd386c732462f8c3b8212fe8d74ee => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:50.823638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 994/1994] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:50 2022] PUT /identity/v3/projects/1d1b3a83be874e36b4346c4adc41fe77/users/4167b300c9ea44f8bceaf0d4271fd9f8/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:50.823840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800d9ad-401d-437f-bf0b-06b39b6a6022 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:50.824565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800d9ad-401d-437f-bf0b-06b39b6a6022 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:50.824856 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800d9ad-401d-437f-bf0b-06b39b6a6022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:50.883686 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3800d9ad-401d-437f-bf0b-06b39b6a6022 None None] MFA Rules not processed for user `4167b300c9ea44f8bceaf0d4271fd9f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:50.885494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3800d9ad-401d-437f-bf0b-06b39b6a6022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:51.076179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1001/1995] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:51.080591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6abff9-672f-4de5-8e87-080547abd66a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:51.083559 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ef6abff9-672f-4de5-8e87-080547abd66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:51.110064 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:51.207887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6abff9-672f-4de5-8e87-080547abd66a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:51.215165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979ed8d-7802-4ff1-a57c-da98c552a49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:51.216040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979ed8d-7802-4ff1-a57c-da98c552a49d admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:51.219146 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979ed8d-7802-4ff1-a57c-da98c552a49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:51.219146 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979ed8d-7802-4ff1-a57c-da98c552a49d admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:51.219146 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979ed8d-7802-4ff1-a57c-da98c552a49d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:51.229694 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979ed8d-7802-4ff1-a57c-da98c552a49d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:51.322394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 995/1996] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:51 2022] POST /identity/v3/projects => generated 373 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:51.323637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800d9ad-401d-437f-bf0b-06b39b6a6022 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:51.342724 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800d9ad-401d-437f-bf0b-06b39b6a6022 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:51.507287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979ed8d-7802-4ff1-a57c-da98c552a49d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:51.509791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5979ed8d-7802-4ff1-a57c-da98c552a49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:51.512273 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc532f-667b-4697-a9df-da02172d8620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:51.527784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc532f-667b-4697-a9df-da02172d8620 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:51.527784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc532f-667b-4697-a9df-da02172d8620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:51.528088 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc532f-667b-4697-a9df-da02172d8620 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:51.528677 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc532f-667b-4697-a9df-da02172d8620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:51.530613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc532f-667b-4697-a9df-da02172d8620 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:51.535920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979ed8d-7802-4ff1-a57c-da98c552a49d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:51.550221 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea77fd-2aca-459f-bd88-824ac0a22229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:51.552069 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea77fd-2aca-459f-bd88-824ac0a22229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:51.552414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea77fd-2aca-459f-bd88-824ac0a22229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:51.552691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea77fd-2aca-459f-bd88-824ac0a22229 admin admin] PATH_INFO: `/v3/projects/5bf6a67cf9c0422e82056021610578fe` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:51.558033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea77fd-2aca-459f-bd88-824ac0a22229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf6a67cf9c0422e82056021610578fe)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:51.560386 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea77fd-2aca-459f-bd88-824ac0a22229 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:51.571396 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1002/1997] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:51 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:51.575104 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc532f-667b-4697-a9df-da02172d8620 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:51.599912 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc532f-667b-4697-a9df-da02172d8620 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:51.632360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2f2c9-703d-4d1c-95c7-9ce70b425929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:51.633063 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f2c9-703d-4d1c-95c7-9ce70b425929 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:51.633346 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f2c9-703d-4d1c-95c7-9ce70b425929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:51.633687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f2c9-703d-4d1c-95c7-9ce70b425929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:51.634370 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2f2c9-703d-4d1c-95c7-9ce70b425929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:51.636815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2f2c9-703d-4d1c-95c7-9ce70b425929 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:51.649785 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e7ea77fd-2aca-459f-bd88-824ac0a22229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf6a67cf9c0422e82056021610578fe', 'request_id': 'req-e7ea77fd-2aca-459f-bd88-824ac0a22229'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:51.649964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1003/1998] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:19:51.654755 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2f2c9-703d-4d1c-95c7-9ce70b425929 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:51.666258 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e7ea77fd-2aca-459f-bd88-824ac0a22229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf6a67cf9c0422e82056021610578fe', 'request_id': 'req-e7ea77fd-2aca-459f-bd88-824ac0a22229'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:51.668352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2f2c9-703d-4d1c-95c7-9ce70b425929 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:51.709187 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e7ea77fd-2aca-459f-bd88-824ac0a22229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf6a67cf9c0422e82056021610578fe', 'request_id': 'req-e7ea77fd-2aca-459f-bd88-824ac0a22229'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:51.728747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e7ea77fd-2aca-459f-bd88-824ac0a22229 admin admin] The token cache is being invalidate because project 5bf6a67cf9c0422e82056021610578fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:51.729120 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e7ea77fd-2aca-459f-bd88-824ac0a22229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:51.729851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e7ea77fd-2aca-459f-bd88-824ac0a22229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:51.731573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 996/1999] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:51 2022] DELETE /identity/v3/projects/5bf6a67cf9c0422e82056021610578fe => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:51.737946 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a899e5d-8224-4128-9f2d-8f54d1d7523c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:51.744895 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a899e5d-8224-4128-9f2d-8f54d1d7523c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:51.745352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a899e5d-8224-4128-9f2d-8f54d1d7523c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:51.773159 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:51.796728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93c4dc-1ff9-409d-abe0-9efaa5b268a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:51.798106 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6a899e5d-8224-4128-9f2d-8f54d1d7523c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:51.798246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93c4dc-1ff9-409d-abe0-9efaa5b268a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:51.798246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93c4dc-1ff9-409d-abe0-9efaa5b268a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:51.798643 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93c4dc-1ff9-409d-abe0-9efaa5b268a8 admin admin] PATH_INFO: `/v3/projects/d5c2cd3f8dc14de982b2b8ce77624fbf/users/a28dfa7eef0c4b6098539e958284eab9/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:51.798926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6a899e5d-8224-4128-9f2d-8f54d1d7523c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:51.811809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 997/2000] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:51.821259 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18f479-abe3-44d4-bb65-bf122f4849e0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:51.821638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18f479-abe3-44d4-bb65-bf122f4849e0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:51.823109 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18f479-abe3-44d4-bb65-bf122f4849e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:51.834418 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93c4dc-1ff9-409d-abe0-9efaa5b268a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c2cd3f8dc14de982b2b8ce77624fbf, user_id=a28dfa7eef0c4b6098539e958284eab9, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:51.842008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93c4dc-1ff9-409d-abe0-9efaa5b268a8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:51.851496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7e18f479-abe3-44d4-bb65-bf122f4849e0 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:51.853128 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7e18f479-abe3-44d4-bb65-bf122f4849e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:51.862888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 998/2001] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:51.867773 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18f479-abe3-44d4-bb65-bf122f4849e0 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:51.875672 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1004/2002] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:51 2022] PUT /identity/v3/projects/d5c2cd3f8dc14de982b2b8ce77624fbf/users/a28dfa7eef0c4b6098539e958284eab9/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:51.882120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93c4dc-1ff9-409d-abe0-9efaa5b268a8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:51.885485 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ae93c4dc-1ff9-409d-abe0-9efaa5b268a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:51.893350 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18f479-abe3-44d4-bb65-bf122f4849e0 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:51.984615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ef274-000d-4445-8ed6-5553a4945014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:51.985261 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ef274-000d-4445-8ed6-5553a4945014 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:51.985589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ef274-000d-4445-8ed6-5553a4945014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:51.985868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ef274-000d-4445-8ed6-5553a4945014 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:51.986529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ef274-000d-4445-8ed6-5553a4945014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:51.987027 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ef274-000d-4445-8ed6-5553a4945014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:51.988499 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ef274-000d-4445-8ed6-5553a4945014 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:52.002702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 999/2003] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:52.007290 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ef274-000d-4445-8ed6-5553a4945014 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:52.012035 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93c4dc-1ff9-409d-abe0-9efaa5b268a8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:52.016578 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:52.021580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ef274-000d-4445-8ed6-5553a4945014 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:52.025752 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d39fc-29d9-455e-90bd-2ab3bd1904f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:52.026698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d39fc-29d9-455e-90bd-2ab3bd1904f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:52.027516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d39fc-29d9-455e-90bd-2ab3bd1904f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:52.027947 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d39fc-29d9-455e-90bd-2ab3bd1904f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:52.028454 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22129848-ce57-4c27-8971-48991fedd97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:52.028768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d39fc-29d9-455e-90bd-2ab3bd1904f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:52.029697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22129848-ce57-4c27-8971-48991fedd97a admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:52.030342 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22129848-ce57-4c27-8971-48991fedd97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:52.030703 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d39fc-29d9-455e-90bd-2ab3bd1904f6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:52.030874 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22129848-ce57-4c27-8971-48991fedd97a admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:52.032015 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22129848-ce57-4c27-8971-48991fedd97a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:52.036180 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22129848-ce57-4c27-8971-48991fedd97a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:52.052713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1005/2004] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:52.052713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d39fc-29d9-455e-90bd-2ab3bd1904f6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:52.070552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d39fc-29d9-455e-90bd-2ab3bd1904f6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:52.079719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98f9fe-4c8f-4b40-8102-b55852f3bbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:52.080672 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98f9fe-4c8f-4b40-8102-b55852f3bbab admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:52.080932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98f9fe-4c8f-4b40-8102-b55852f3bbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:52.081375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98f9fe-4c8f-4b40-8102-b55852f3bbab admin admin] PATH_INFO: `/v3/projects/d5c2cd3f8dc14de982b2b8ce77624fbf/users/a28dfa7eef0c4b6098539e958284eab9/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:52.085046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98f9fe-4c8f-4b40-8102-b55852f3bbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c2cd3f8dc14de982b2b8ce77624fbf, user_id=a28dfa7eef0c4b6098539e958284eab9, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:52.086778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1000/2005] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:52 2022] POST /identity/v3/projects => generated 363 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:52.088959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98f9fe-4c8f-4b40-8102-b55852f3bbab admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:52.090493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22129848-ce57-4c27-8971-48991fedd97a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:52.110359 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1006/2006] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:52 2022] PUT /identity/v3/projects/d5c2cd3f8dc14de982b2b8ce77624fbf/users/a28dfa7eef0c4b6098539e958284eab9/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:52.124962 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20128f-3a3e-44a2-a74b-8a006c7804d8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:52.125250 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20128f-3a3e-44a2-a74b-8a006c7804d8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:52.125556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20128f-3a3e-44a2-a74b-8a006c7804d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:52.188239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ef20128f-3a3e-44a2-a74b-8a006c7804d8 None None] MFA Rules not processed for user `a28dfa7eef0c4b6098539e958284eab9`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:52.192931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ef20128f-3a3e-44a2-a74b-8a006c7804d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:52.217076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22129848-ce57-4c27-8971-48991fedd97a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:52.296105 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1007/2007] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:52.307969 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe814694-1412-40a8-b178-ea4ff01e1473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:52.308601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe814694-1412-40a8-b178-ea4ff01e1473 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:52.308878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe814694-1412-40a8-b178-ea4ff01e1473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:52.309146 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe814694-1412-40a8-b178-ea4ff01e1473 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:52.310800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20128f-3a3e-44a2-a74b-8a006c7804d8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:52.311340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe814694-1412-40a8-b178-ea4ff01e1473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:52.312284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ef20128f-3a3e-44a2-a74b-8a006c7804d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:52.313343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe814694-1412-40a8-b178-ea4ff01e1473 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:52.344133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1001/2008] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:52 2022] POST /identity/v3/users => generated 282 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:19:52.348296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe814694-1412-40a8-b178-ea4ff01e1473 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:52.361127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe814694-1412-40a8-b178-ea4ff01e1473 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:52.366590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903fcc9-eb30-4155-a84c-08272fbb34ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:52.366791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:52.367963 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903fcc9-eb30-4155-a84c-08272fbb34ce admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:52.367963 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903fcc9-eb30-4155-a84c-08272fbb34ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:52.367963 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903fcc9-eb30-4155-a84c-08272fbb34ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:52.368609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903fcc9-eb30-4155-a84c-08272fbb34ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:52.370476 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903fcc9-eb30-4155-a84c-08272fbb34ce admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:52.382468 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1002/2009] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:52.389578 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903fcc9-eb30-4155-a84c-08272fbb34ce admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:52.393136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20128f-3a3e-44a2-a74b-8a006c7804d8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:52.397361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc8a69-7042-4ade-b7e3-af680b88bf42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:52.398000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc8a69-7042-4ade-b7e3-af680b88bf42 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:52.398283 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc8a69-7042-4ade-b7e3-af680b88bf42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:52.399139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc8a69-7042-4ade-b7e3-af680b88bf42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:52.401326 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cabc8a69-7042-4ade-b7e3-af680b88bf42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:52.403278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903fcc9-eb30-4155-a84c-08272fbb34ce admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:52.409491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f210177-3a66-4827-be82-93a7ab7d25ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:52.410105 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f210177-3a66-4827-be82-93a7ab7d25ff admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:52.411154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f210177-3a66-4827-be82-93a7ab7d25ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:52.411508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f210177-3a66-4827-be82-93a7ab7d25ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:52.411898 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f210177-3a66-4827-be82-93a7ab7d25ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:52.413647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f210177-3a66-4827-be82-93a7ab7d25ff admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:52.429089 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1003/2010] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:52.433898 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f210177-3a66-4827-be82-93a7ab7d25ff admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:52.445916 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f210177-3a66-4827-be82-93a7ab7d25ff admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:52.452324 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da04d4-a1da-4c31-9980-8240bab399f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:52.453698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da04d4-a1da-4c31-9980-8240bab399f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:52.454062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da04d4-a1da-4c31-9980-8240bab399f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:52.454429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da04d4-a1da-4c31-9980-8240bab399f5 admin admin] PATH_INFO: `/v3/projects/d021925f9d644bff816589773102cc05/users/9dc230f77e80443d9db3bf73674f555a/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:52.470492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da04d4-a1da-4c31-9980-8240bab399f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d021925f9d644bff816589773102cc05, user_id=9dc230f77e80443d9db3bf73674f555a, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:52.473538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da04d4-a1da-4c31-9980-8240bab399f5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:52.486258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc8a69-7042-4ade-b7e3-af680b88bf42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:52.488367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc8a69-7042-4ade-b7e3-af680b88bf42 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:52.492571 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1004/2011] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:52 2022] PUT /identity/v3/projects/d021925f9d644bff816589773102cc05/users/9dc230f77e80443d9db3bf73674f555a/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:52.498919 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1008/2012] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:52.506987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcf9b4-ef81-43c6-a539-ada09f4e40f7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:52.507376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcf9b4-ef81-43c6-a539-ada09f4e40f7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:52.507934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcf9b4-ef81-43c6-a539-ada09f4e40f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:52.541050 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-60fcf9b4-ef81-43c6-a539-ada09f4e40f7 None None] MFA Rules not processed for user `9dc230f77e80443d9db3bf73674f555a`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:52.542651 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-60fcf9b4-ef81-43c6-a539-ada09f4e40f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:52.571391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:52.660011 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc8a69-7042-4ade-b7e3-af680b88bf42 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:52.661968 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cabc8a69-7042-4ade-b7e3-af680b88bf42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:52.662085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1005/2013] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:52.666556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcf9b4-ef81-43c6-a539-ada09f4e40f7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:52.694305 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc8a69-7042-4ade-b7e3-af680b88bf42 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:52.761801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcf9b4-ef81-43c6-a539-ada09f4e40f7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:52.771769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1362-f4e8-4f54-a127-a63a3c9da5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:52.772396 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1362-f4e8-4f54-a127-a63a3c9da5bf admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:52.772679 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1362-f4e8-4f54-a127-a63a3c9da5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:52.772956 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1362-f4e8-4f54-a127-a63a3c9da5bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:52.773600 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c1362-f4e8-4f54-a127-a63a3c9da5bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:52.776202 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7d726-722c-487f-b760-5bbbb4b35c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:52.776378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c1362-f4e8-4f54-a127-a63a3c9da5bf admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:52.776936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7d726-722c-487f-b760-5bbbb4b35c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:52.777221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7d726-722c-487f-b760-5bbbb4b35c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:52.777521 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7d726-722c-487f-b760-5bbbb4b35c63 admin admin] PATH_INFO: `/v3/users/cf1434f62508447289982187e70dba31` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:52.785603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7d726-722c-487f-b760-5bbbb4b35c63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1434f62508447289982187e70dba31)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:52.787831 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7d726-722c-487f-b760-5bbbb4b35c63 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:52.819401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1006/2014] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:52 2022] POST /identity/v3/projects => generated 361 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:19:52.820481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1362-f4e8-4f54-a127-a63a3c9da5bf admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:52.870300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77a7d726-722c-487f-b760-5bbbb4b35c63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1434f62508447289982187e70dba31'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:52.879021 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77a7d726-722c-487f-b760-5bbbb4b35c63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1434f62508447289982187e70dba31'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:52.896910 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77a7d726-722c-487f-b760-5bbbb4b35c63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1434f62508447289982187e70dba31'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:52.919740 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1362-f4e8-4f54-a127-a63a3c9da5bf admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:52.921386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77a7d726-722c-487f-b760-5bbbb4b35c63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1434f62508447289982187e70dba31'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:52.922171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77a7d726-722c-487f-b760-5bbbb4b35c63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1434f62508447289982187e70dba31'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:52.927019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb59507-5289-42ed-b24d-56edcefccb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:52.928328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb59507-5289-42ed-b24d-56edcefccb65 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:52.928725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb59507-5289-42ed-b24d-56edcefccb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:52.929075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb59507-5289-42ed-b24d-56edcefccb65 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:52.929816 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb59507-5289-42ed-b24d-56edcefccb65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:52.932000 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb59507-5289-42ed-b24d-56edcefccb65 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:52.954630 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1009/2015] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:52 2022] DELETE /identity/v3/users/cf1434f62508447289982187e70dba31 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:52.958312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1007/2016] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:52 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:52.960488 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34143b81-54e2-49c5-b2f3-46e9ea653128 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:52.960824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34143b81-54e2-49c5-b2f3-46e9ea653128 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:52.961191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34143b81-54e2-49c5-b2f3-46e9ea653128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:52.962350 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb59507-5289-42ed-b24d-56edcefccb65 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:52.964695 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3cb59507-5289-42ed-b24d-56edcefccb65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:52.978769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb59507-5289-42ed-b24d-56edcefccb65 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:52.987913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-34143b81-54e2-49c5-b2f3-46e9ea653128 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:52.990451 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-34143b81-54e2-49c5-b2f3-46e9ea653128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:52.999278 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:53.014669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:53.041129 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da4b8c-dfec-41b0-9959-8d4e5d1d3425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:53.041737 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da4b8c-dfec-41b0-9959-8d4e5d1d3425 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:53.042015 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da4b8c-dfec-41b0-9959-8d4e5d1d3425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:53.042287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da4b8c-dfec-41b0-9959-8d4e5d1d3425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:53.042929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da4b8c-dfec-41b0-9959-8d4e5d1d3425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:53.044556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da4b8c-dfec-41b0-9959-8d4e5d1d3425 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:53.054550 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1008/2017] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:19:53.056091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1010/2018] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:19:53.060703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da4b8c-dfec-41b0-9959-8d4e5d1d3425 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:53.067434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34143b81-54e2-49c5-b2f3-46e9ea653128 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:53.068873 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-34143b81-54e2-49c5-b2f3-46e9ea653128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:53.070995 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da4b8c-dfec-41b0-9959-8d4e5d1d3425 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:53.075807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c193c2-c5b3-4448-b3f8-4817df58a9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:53.076464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c193c2-c5b3-4448-b3f8-4817df58a9b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:53.076747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c193c2-c5b3-4448-b3f8-4817df58a9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:53.077024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c193c2-c5b3-4448-b3f8-4817df58a9b7 admin admin] PATH_INFO: `/v3/projects/baf9fc0d85ef4977b8234c9bd1cc5c8f/users/5c53c206c8354801888b3972e18d337e/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:53.093333 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c193c2-c5b3-4448-b3f8-4817df58a9b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf9fc0d85ef4977b8234c9bd1cc5c8f, user_id=5c53c206c8354801888b3972e18d337e, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:53.096083 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c193c2-c5b3-4448-b3f8-4817df58a9b7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:53.110319 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1009/2019] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:53 2022] PUT /identity/v3/projects/baf9fc0d85ef4977b8234c9bd1cc5c8f/users/5c53c206c8354801888b3972e18d337e/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:53.114934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c193c2-c5b3-4448-b3f8-4817df58a9b7 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:53.136103 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34143b81-54e2-49c5-b2f3-46e9ea653128 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:53.181430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c193c2-c5b3-4448-b3f8-4817df58a9b7 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:53.186692 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e45d75-4846-4c13-947a-c1531907382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:53.187512 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e45d75-4846-4c13-947a-c1531907382a admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:53.187865 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e45d75-4846-4c13-947a-c1531907382a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:53.188148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e45d75-4846-4c13-947a-c1531907382a admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:53.188797 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e45d75-4846-4c13-947a-c1531907382a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:53.190404 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e45d75-4846-4c13-947a-c1531907382a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:53.201591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1010/2020] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:19:53.204025 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353d8cf-685c-49e5-88d3-c426a613710a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:53.205292 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353d8cf-685c-49e5-88d3-c426a613710a service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:53.205577 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353d8cf-685c-49e5-88d3-c426a613710a service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:53.205682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e45d75-4846-4c13-947a-c1531907382a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:53.205867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353d8cf-685c-49e5-88d3-c426a613710a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:53.216684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353d8cf-685c-49e5-88d3-c426a613710a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:53.218261 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e45d75-4846-4c13-947a-c1531907382a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:53.218381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353d8cf-685c-49e5-88d3-c426a613710a service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:53.224845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953db78-a1a4-457e-b650-357ed6540f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:53.225516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953db78-a1a4-457e-b650-357ed6540f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:53.225799 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953db78-a1a4-457e-b650-357ed6540f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:53.226078 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953db78-a1a4-457e-b650-357ed6540f22 admin admin] PATH_INFO: `/v3/projects/baf9fc0d85ef4977b8234c9bd1cc5c8f/users/5c53c206c8354801888b3972e18d337e/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:53.228076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953db78-a1a4-457e-b650-357ed6540f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf9fc0d85ef4977b8234c9bd1cc5c8f, user_id=5c53c206c8354801888b3972e18d337e, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:53.230875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1011/2021] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:19:53.231202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953db78-a1a4-457e-b650-357ed6540f22 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:53.242388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1011/2022] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:53 2022] PUT /identity/v3/projects/baf9fc0d85ef4977b8234c9bd1cc5c8f/users/5c53c206c8354801888b3972e18d337e/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:53.253581 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4e409-a1e1-4131-82c9-def8383f3237 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:53.253875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4e409-a1e1-4131-82c9-def8383f3237 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:53.254158 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4e409-a1e1-4131-82c9-def8383f3237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:53.289257 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-59a4e409-a1e1-4131-82c9-def8383f3237 None None] MFA Rules not processed for user `5c53c206c8354801888b3972e18d337e`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:53.290652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-59a4e409-a1e1-4131-82c9-def8383f3237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:53.379056 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:53.389127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1012/2023] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:53.401761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953db78-a1a4-457e-b650-357ed6540f22 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:53.403654 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e953db78-a1a4-457e-b650-357ed6540f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:53.483347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953db78-a1a4-457e-b650-357ed6540f22 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:53.487313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec4f1a-e713-476b-8f04-d2c877871219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:53.487942 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec4f1a-e713-476b-8f04-d2c877871219 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:53.488226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec4f1a-e713-476b-8f04-d2c877871219 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:53.488500 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec4f1a-e713-476b-8f04-d2c877871219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:53.500810 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec4f1a-e713-476b-8f04-d2c877871219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:53.503134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec4f1a-e713-476b-8f04-d2c877871219 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:53.516002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1012/2024] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:53 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:53.561788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4e409-a1e1-4131-82c9-def8383f3237 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:53.569464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-59a4e409-a1e1-4131-82c9-def8383f3237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:53.611458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec4f1a-e713-476b-8f04-d2c877871219 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:53.620978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec4f1a-e713-476b-8f04-d2c877871219 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:53.625340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b191753-f2d2-4cf2-9e60-39eaef08e8f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:53.625923 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b191753-f2d2-4cf2-9e60-39eaef08e8f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:53.626196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b191753-f2d2-4cf2-9e60-39eaef08e8f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:53.626471 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b191753-f2d2-4cf2-9e60-39eaef08e8f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:53.628805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0b191753-f2d2-4cf2-9e60-39eaef08e8f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:53.674250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:53.691344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4e409-a1e1-4131-82c9-def8383f3237 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:53.707316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a80cb4-9be7-46db-a32f-01de256c5145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:53.709633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a80cb4-9be7-46db-a32f-01de256c5145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:53.710174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a80cb4-9be7-46db-a32f-01de256c5145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:53.710587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a80cb4-9be7-46db-a32f-01de256c5145 admin admin] PATH_INFO: `/v3/projects/511b51d5a94040da875d5d7079e0563c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:53.713759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a80cb4-9be7-46db-a32f-01de256c5145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=511b51d5a94040da875d5d7079e0563c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:53.716070 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a80cb4-9be7-46db-a32f-01de256c5145 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:53.722694 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b191753-f2d2-4cf2-9e60-39eaef08e8f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:53.725206 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b191753-f2d2-4cf2-9e60-39eaef08e8f8 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:53.744779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1013/2025] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:19:53.798336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b3a80cb4-9be7-46db-a32f-01de256c5145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511b51d5a94040da875d5d7079e0563c', 'request_id': 'req-b3a80cb4-9be7-46db-a32f-01de256c5145'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:53.807582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b3a80cb4-9be7-46db-a32f-01de256c5145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511b51d5a94040da875d5d7079e0563c', 'request_id': 'req-b3a80cb4-9be7-46db-a32f-01de256c5145'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:53.814830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b3a80cb4-9be7-46db-a32f-01de256c5145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511b51d5a94040da875d5d7079e0563c', 'request_id': 'req-b3a80cb4-9be7-46db-a32f-01de256c5145'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:53.827213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b3a80cb4-9be7-46db-a32f-01de256c5145 admin admin] The token cache is being invalidate because project 511b51d5a94040da875d5d7079e0563c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:53.827524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b3a80cb4-9be7-46db-a32f-01de256c5145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:53.828164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b3a80cb4-9be7-46db-a32f-01de256c5145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:53.829664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1013/2026] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:53 2022] DELETE /identity/v3/projects/511b51d5a94040da875d5d7079e0563c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:53.833763 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b191753-f2d2-4cf2-9e60-39eaef08e8f8 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:53.845943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b191753-f2d2-4cf2-9e60-39eaef08e8f8 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:53.922199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25497f80-a6d6-43df-aa5e-07828bcb7060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:53.922842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25497f80-a6d6-43df-aa5e-07828bcb7060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:53.923295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25497f80-a6d6-43df-aa5e-07828bcb7060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:53.923577 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25497f80-a6d6-43df-aa5e-07828bcb7060 admin admin] PATH_INFO: `/v3/users/0b79936546fb420c8e4fe172d2c12516` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:53.924732 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25497f80-a6d6-43df-aa5e-07828bcb7060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b79936546fb420c8e4fe172d2c12516)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:53.926820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25497f80-a6d6-43df-aa5e-07828bcb7060 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:53.979157 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-25497f80-a6d6-43df-aa5e-07828bcb7060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b79936546fb420c8e4fe172d2c12516'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:53.979805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-25497f80-a6d6-43df-aa5e-07828bcb7060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b79936546fb420c8e4fe172d2c12516'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:53.987890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-25497f80-a6d6-43df-aa5e-07828bcb7060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b79936546fb420c8e4fe172d2c12516'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:54.000453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-25497f80-a6d6-43df-aa5e-07828bcb7060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b79936546fb420c8e4fe172d2c12516'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:54.001154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-25497f80-a6d6-43df-aa5e-07828bcb7060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b79936546fb420c8e4fe172d2c12516'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:54.016222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1014/2027] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:53 2022] DELETE /identity/v3/users/0b79936546fb420c8e4fe172d2c12516 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:54.351238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a80cb4-9be7-46db-a32f-01de256c5145 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:54.352773 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b3a80cb4-9be7-46db-a32f-01de256c5145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:54.379102 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a80cb4-9be7-46db-a32f-01de256c5145 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:54.461040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00850c8c-cbaf-4e0e-a75c-be33d28fe6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:54.461812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00850c8c-cbaf-4e0e-a75c-be33d28fe6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:54.462659 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00850c8c-cbaf-4e0e-a75c-be33d28fe6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:54.462659 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00850c8c-cbaf-4e0e-a75c-be33d28fe6ab admin admin] PATH_INFO: `/v3/projects/35495ae882d94cc78c2fff7d50b7e4dd` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:54.464428 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00850c8c-cbaf-4e0e-a75c-be33d28fe6ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=35495ae882d94cc78c2fff7d50b7e4dd)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:54.468056 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00850c8c-cbaf-4e0e-a75c-be33d28fe6ab admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:54.510181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:54.553279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-00850c8c-cbaf-4e0e-a75c-be33d28fe6ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35495ae882d94cc78c2fff7d50b7e4dd', 'request_id': 'req-00850c8c-cbaf-4e0e-a75c-be33d28fe6ab'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:54.570550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-00850c8c-cbaf-4e0e-a75c-be33d28fe6ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35495ae882d94cc78c2fff7d50b7e4dd', 'request_id': 'req-00850c8c-cbaf-4e0e-a75c-be33d28fe6ab'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:54.578960 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-00850c8c-cbaf-4e0e-a75c-be33d28fe6ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35495ae882d94cc78c2fff7d50b7e4dd', 'request_id': 'req-00850c8c-cbaf-4e0e-a75c-be33d28fe6ab'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:54.594884 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-00850c8c-cbaf-4e0e-a75c-be33d28fe6ab admin admin] The token cache is being invalidate because project 35495ae882d94cc78c2fff7d50b7e4dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:54.595211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-00850c8c-cbaf-4e0e-a75c-be33d28fe6ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:54.595848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-00850c8c-cbaf-4e0e-a75c-be33d28fe6ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:54.597339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1014/2028] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:54 2022] DELETE /identity/v3/projects/35495ae882d94cc78c2fff7d50b7e4dd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:54.603741 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13bc2a-f317-4c30-a73e-2e0a2b165203 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:54.604826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13bc2a-f317-4c30-a73e-2e0a2b165203 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:54.605133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13bc2a-f317-4c30-a73e-2e0a2b165203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:54.628555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ff13bc2a-f317-4c30-a73e-2e0a2b165203 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:54.629840 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ff13bc2a-f317-4c30-a73e-2e0a2b165203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:54.681578 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:54.701300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1015/2029] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:54.709952 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b0665-564d-4b63-ab46-81c7ac2c2806 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:54.710476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b0665-564d-4b63-ab46-81c7ac2c2806 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:54.711580 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b0665-564d-4b63-ab46-81c7ac2c2806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:54.734049 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cc3b0665-564d-4b63-ab46-81c7ac2c2806 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:54.735620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cc3b0665-564d-4b63-ab46-81c7ac2c2806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:54.744739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1015/2030] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:54.749164 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13bc2a-f317-4c30-a73e-2e0a2b165203 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:54.759543 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13bc2a-f317-4c30-a73e-2e0a2b165203 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:54.764351 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b14731-1e89-408b-83b1-86710790c4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:54.765059 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b14731-1e89-408b-83b1-86710790c4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:54.765413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b14731-1e89-408b-83b1-86710790c4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:54.765696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b14731-1e89-408b-83b1-86710790c4d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:54.766355 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b14731-1e89-408b-83b1-86710790c4d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:54.766664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b14731-1e89-408b-83b1-86710790c4d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:54.768325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b14731-1e89-408b-83b1-86710790c4d7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:54.780486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1016/2031] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:54.785007 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b0665-564d-4b63-ab46-81c7ac2c2806 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:54.794940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b0665-564d-4b63-ab46-81c7ac2c2806 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:54.812765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a0a1b-0ec9-4ea8-9450-c8dce3db600a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:54.812765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0a1b-0ec9-4ea8-9450-c8dce3db600a admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:54.812765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0a1b-0ec9-4ea8-9450-c8dce3db600a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:54.812765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0a1b-0ec9-4ea8-9450-c8dce3db600a admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:54.813742 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a0a1b-0ec9-4ea8-9450-c8dce3db600a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:54.821175 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a0a1b-0ec9-4ea8-9450-c8dce3db600a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:54.864595 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1016/2032] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:54 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:54.869271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b14731-1e89-408b-83b1-86710790c4d7 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:54.880034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b14731-1e89-408b-83b1-86710790c4d7 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:55.003815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac380e2-b3ea-49a7-9ea6-765e7c32c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:55.004489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac380e2-b3ea-49a7-9ea6-765e7c32c6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:55.005017 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac380e2-b3ea-49a7-9ea6-765e7c32c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:55.005328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac380e2-b3ea-49a7-9ea6-765e7c32c6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:55.005996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac380e2-b3ea-49a7-9ea6-765e7c32c6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:55.007973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac380e2-b3ea-49a7-9ea6-765e7c32c6b7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:55.035352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1017/2033] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:54 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:55.039555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a0a1b-0ec9-4ea8-9450-c8dce3db600a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:55.050242 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a0a1b-0ec9-4ea8-9450-c8dce3db600a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:55.055685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510643-83dc-48fb-a105-7ba33c929931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:55.056295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510643-83dc-48fb-a105-7ba33c929931 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:55.056578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510643-83dc-48fb-a105-7ba33c929931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:55.056853 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510643-83dc-48fb-a105-7ba33c929931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:55.057500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c510643-83dc-48fb-a105-7ba33c929931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:55.059149 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c510643-83dc-48fb-a105-7ba33c929931 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:55.070736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1017/2034] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:19:55.074742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac380e2-b3ea-49a7-9ea6-765e7c32c6b7 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:55.085195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac380e2-b3ea-49a7-9ea6-765e7c32c6b7 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:55.089842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d538dea-425f-40e1-a44a-06b17797b0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:55.090443 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d538dea-425f-40e1-a44a-06b17797b0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:55.090725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d538dea-425f-40e1-a44a-06b17797b0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:55.090996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d538dea-425f-40e1-a44a-06b17797b0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:55.091680 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d538dea-425f-40e1-a44a-06b17797b0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:55.093372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d538dea-425f-40e1-a44a-06b17797b0f5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:55.104228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1018/2035] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:55.108559 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510643-83dc-48fb-a105-7ba33c929931 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:55.119630 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510643-83dc-48fb-a105-7ba33c929931 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:55.124623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e570a4-0712-456d-9a30-0544bb8fceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:55.125352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e570a4-0712-456d-9a30-0544bb8fceda admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:55.125565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e570a4-0712-456d-9a30-0544bb8fceda admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:55.125912 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e570a4-0712-456d-9a30-0544bb8fceda admin admin] PATH_INFO: `/v3/projects/4c4e61217b46465c8eb2fdfe88f48ca0/users/01c40b7a6c934d7581b86d09b4f226c9/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:55.141830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e570a4-0712-456d-9a30-0544bb8fceda admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4e61217b46465c8eb2fdfe88f48ca0, user_id=01c40b7a6c934d7581b86d09b4f226c9, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:55.144600 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e570a4-0712-456d-9a30-0544bb8fceda admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:55.158902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1018/2036] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:55 2022] PUT /identity/v3/projects/4c4e61217b46465c8eb2fdfe88f48ca0/users/01c40b7a6c934d7581b86d09b4f226c9/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:55.169804 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e938ed4-de46-484d-852b-3db73014a123 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:55.170094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e938ed4-de46-484d-852b-3db73014a123 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:55.170374 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e938ed4-de46-484d-852b-3db73014a123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:55.199232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0e938ed4-de46-484d-852b-3db73014a123 None None] MFA Rules not processed for user `01c40b7a6c934d7581b86d09b4f226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:55.200486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0e938ed4-de46-484d-852b-3db73014a123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:55.253231 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e570a4-0712-456d-9a30-0544bb8fceda admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:55.262710 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b3e570a4-0712-456d-9a30-0544bb8fceda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:55.299226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1019/2037] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:55.304553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e938ed4-de46-484d-852b-3db73014a123 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:55.353254 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e570a4-0712-456d-9a30-0544bb8fceda admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:55.358310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97656c-34a2-4f0e-b7b0-21a27006ccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:55.358941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97656c-34a2-4f0e-b7b0-21a27006ccbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:55.359261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97656c-34a2-4f0e-b7b0-21a27006ccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:55.359572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97656c-34a2-4f0e-b7b0-21a27006ccbc admin admin] PATH_INFO: `/v3/users/4167b300c9ea44f8bceaf0d4271fd9f8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:55.360671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97656c-34a2-4f0e-b7b0-21a27006ccbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4167b300c9ea44f8bceaf0d4271fd9f8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:55.362590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97656c-34a2-4f0e-b7b0-21a27006ccbc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:55.377686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:55.395655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e938ed4-de46-484d-852b-3db73014a123 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:55.400761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306150d-e866-4082-a105-b1eda20feb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:55.401437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306150d-e866-4082-a105-b1eda20feb4f admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:55.401896 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306150d-e866-4082-a105-b1eda20feb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:55.402218 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306150d-e866-4082-a105-b1eda20feb4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:55.402976 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306150d-e866-4082-a105-b1eda20feb4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:55.404915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306150d-e866-4082-a105-b1eda20feb4f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:55.425370 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bf97656c-34a2-4f0e-b7b0-21a27006ccbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4167b300c9ea44f8bceaf0d4271fd9f8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:55.426361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bf97656c-34a2-4f0e-b7b0-21a27006ccbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4167b300c9ea44f8bceaf0d4271fd9f8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:55.434460 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bf97656c-34a2-4f0e-b7b0-21a27006ccbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4167b300c9ea44f8bceaf0d4271fd9f8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:55.435637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:55.441112 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1020/2038] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:55 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:19:55.450937 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bf97656c-34a2-4f0e-b7b0-21a27006ccbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4167b300c9ea44f8bceaf0d4271fd9f8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:55.451934 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bf97656c-34a2-4f0e-b7b0-21a27006ccbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4167b300c9ea44f8bceaf0d4271fd9f8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:55.455229 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306150d-e866-4082-a105-b1eda20feb4f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:55.459907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d306150d-e866-4082-a105-b1eda20feb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:55.475093 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1019/2039] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:55 2022] DELETE /identity/v3/users/4167b300c9ea44f8bceaf0d4271fd9f8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:55.479699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a484c1-5858-43d6-8997-60fd1060a298 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:55.480177 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a484c1-5858-43d6-8997-60fd1060a298 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:55.480559 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a484c1-5858-43d6-8997-60fd1060a298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:55.518546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-39a484c1-5858-43d6-8997-60fd1060a298 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:55.520634 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-39a484c1-5858-43d6-8997-60fd1060a298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:55.534534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306150d-e866-4082-a105-b1eda20feb4f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:55.584107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1020/2040] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:19:55.596308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f6a8a-0ff0-468c-b88a-d8ad0c8a83e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:55.597057 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f6a8a-0ff0-468c-b88a-d8ad0c8a83e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:55.597336 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f6a8a-0ff0-468c-b88a-d8ad0c8a83e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:55.597611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f6a8a-0ff0-468c-b88a-d8ad0c8a83e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:55.598780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f6a8a-0ff0-468c-b88a-d8ad0c8a83e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:55.600913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f6a8a-0ff0-468c-b88a-d8ad0c8a83e1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:55.616054 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a484c1-5858-43d6-8997-60fd1060a298 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:55.618639 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-39a484c1-5858-43d6-8997-60fd1060a298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:55.635011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1021/2041] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:55 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:55.638850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f6a8a-0ff0-468c-b88a-d8ad0c8a83e1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:55.651237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f6a8a-0ff0-468c-b88a-d8ad0c8a83e1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:55.656437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ff14d-2213-4b67-8ce5-76a4dc5941e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:55.657533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ff14d-2213-4b67-8ce5-76a4dc5941e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:55.657812 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ff14d-2213-4b67-8ce5-76a4dc5941e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:55.658088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ff14d-2213-4b67-8ce5-76a4dc5941e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:55.659226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ff14d-2213-4b67-8ce5-76a4dc5941e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:55.660425 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ff14d-2213-4b67-8ce5-76a4dc5941e4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:55.671892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1022/2042] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:19:55.675905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ff14d-2213-4b67-8ce5-76a4dc5941e4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:55.688993 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ff14d-2213-4b67-8ce5-76a4dc5941e4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:55.695593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb42163-f04f-4b9d-adcb-71f525969574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:55.696508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb42163-f04f-4b9d-adcb-71f525969574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:55.696852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb42163-f04f-4b9d-adcb-71f525969574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:55.700445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb42163-f04f-4b9d-adcb-71f525969574 admin admin] PATH_INFO: `/v3/projects/d27014998bba47f180dc1634aaaa3470/users/e3d3ba1c57264067b9e1214553b3c482/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:55.712810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a484c1-5858-43d6-8997-60fd1060a298 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:55.718574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd45cc5-fde7-4ec0-be13-f50c22718e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:55.720025 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd45cc5-fde7-4ec0-be13-f50c22718e50 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:55.720493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd45cc5-fde7-4ec0-be13-f50c22718e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:55.721185 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd45cc5-fde7-4ec0-be13-f50c22718e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:55.721820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb42163-f04f-4b9d-adcb-71f525969574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27014998bba47f180dc1634aaaa3470, user_id=e3d3ba1c57264067b9e1214553b3c482, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:55.725441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb42163-f04f-4b9d-adcb-71f525969574 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:55.751021 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd45cc5-fde7-4ec0-be13-f50c22718e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:55.753027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd45cc5-fde7-4ec0-be13-f50c22718e50 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:55.758683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1023/2043] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:55 2022] PUT /identity/v3/projects/d27014998bba47f180dc1634aaaa3470/users/e3d3ba1c57264067b9e1214553b3c482/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:19:55.762655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb42163-f04f-4b9d-adcb-71f525969574 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:55.779460 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1021/2044] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:19:55.814467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:55.854892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb42163-f04f-4b9d-adcb-71f525969574 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:55.860657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9765526-e5a8-48f3-af38-c403e9e35e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:55.861468 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9765526-e5a8-48f3-af38-c403e9e35e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:55.862086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9765526-e5a8-48f3-af38-c403e9e35e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:55.862343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9765526-e5a8-48f3-af38-c403e9e35e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:55.863134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9765526-e5a8-48f3-af38-c403e9e35e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:55.866054 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9765526-e5a8-48f3-af38-c403e9e35e22 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:55.880749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1024/2045] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:55.886078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd45cc5-fde7-4ec0-be13-f50c22718e50 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:55.896954 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd45cc5-fde7-4ec0-be13-f50c22718e50 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:55.902701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628c1f-52fd-47cc-861e-9ee623e42c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:55.904525 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628c1f-52fd-47cc-861e-9ee623e42c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:55.904525 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628c1f-52fd-47cc-861e-9ee623e42c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:55.904525 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628c1f-52fd-47cc-861e-9ee623e42c9e admin admin] PATH_INFO: `/v3/projects/d27014998bba47f180dc1634aaaa3470/users/e3d3ba1c57264067b9e1214553b3c482/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:55.907361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38628c1f-52fd-47cc-861e-9ee623e42c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27014998bba47f180dc1634aaaa3470, user_id=e3d3ba1c57264067b9e1214553b3c482, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:55.910573 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38628c1f-52fd-47cc-861e-9ee623e42c9e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:55.924594 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1022/2046] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:55 2022] PUT /identity/v3/projects/d27014998bba47f180dc1634aaaa3470/users/e3d3ba1c57264067b9e1214553b3c482/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:55.937117 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f4646-5ea0-43ee-bb5b-c77d82145c43 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:55.937384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f4646-5ea0-43ee-bb5b-c77d82145c43 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:55.937586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f4646-5ea0-43ee-bb5b-c77d82145c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:55.997348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-da5f4646-5ea0-43ee-bb5b-c77d82145c43 None None] MFA Rules not processed for user `e3d3ba1c57264067b9e1214553b3c482`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:55.998817 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-da5f4646-5ea0-43ee-bb5b-c77d82145c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:56.135141 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1025/2047] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:19:56.140032 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628c1f-52fd-47cc-861e-9ee623e42c9e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:56.143711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-38628c1f-52fd-47cc-861e-9ee623e42c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:56.149652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f4646-5ea0-43ee-bb5b-c77d82145c43 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:56.151184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-da5f4646-5ea0-43ee-bb5b-c77d82145c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:56.221078 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f4646-5ea0-43ee-bb5b-c77d82145c43 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:56.222877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628c1f-52fd-47cc-861e-9ee623e42c9e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:56.225960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa3e35-4e0d-477b-9d84-2081ad5a8079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:56.226776 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa3e35-4e0d-477b-9d84-2081ad5a8079 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:56.227103 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa3e35-4e0d-477b-9d84-2081ad5a8079 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:56.227378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa3e35-4e0d-477b-9d84-2081ad5a8079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:56.228763 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef798832-0336-4847-9c6e-8581588d8d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:56.229115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-eaaa3e35-4e0d-477b-9d84-2081ad5a8079 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:56.229533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef798832-0336-4847-9c6e-8581588d8d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:56.229883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef798832-0336-4847-9c6e-8581588d8d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:56.230228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef798832-0336-4847-9c6e-8581588d8d5c admin admin] PATH_INFO: `/v3/projects/1d1b3a83be874e36b4346c4adc41fe77` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:56.231487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef798832-0336-4847-9c6e-8581588d8d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1b3a83be874e36b4346c4adc41fe77)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:56.233530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef798832-0336-4847-9c6e-8581588d8d5c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:56.240715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:56.288589 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef798832-0336-4847-9c6e-8581588d8d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1b3a83be874e36b4346c4adc41fe77', 'request_id': 'req-ef798832-0336-4847-9c6e-8581588d8d5c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:56.296466 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef798832-0336-4847-9c6e-8581588d8d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1b3a83be874e36b4346c4adc41fe77', 'request_id': 'req-ef798832-0336-4847-9c6e-8581588d8d5c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:56.300278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa3e35-4e0d-477b-9d84-2081ad5a8079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:56.302310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa3e35-4e0d-477b-9d84-2081ad5a8079 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:56.303944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef798832-0336-4847-9c6e-8581588d8d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1b3a83be874e36b4346c4adc41fe77', 'request_id': 'req-ef798832-0336-4847-9c6e-8581588d8d5c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:56.313509 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1026/2048] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:19:56.315895 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef798832-0336-4847-9c6e-8581588d8d5c admin admin] The token cache is being invalidate because project 1d1b3a83be874e36b4346c4adc41fe77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:56.316190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef798832-0336-4847-9c6e-8581588d8d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:56.317698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef798832-0336-4847-9c6e-8581588d8d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:56.321244 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1023/2049] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:56 2022] DELETE /identity/v3/projects/1d1b3a83be874e36b4346c4adc41fe77 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:56.325305 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa3e35-4e0d-477b-9d84-2081ad5a8079 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:56.337578 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa3e35-4e0d-477b-9d84-2081ad5a8079 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:56.343437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:56.401458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a5838-75fd-4a14-bee7-f167b9ea881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:56.402224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a5838-75fd-4a14-bee7-f167b9ea881f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:56.402519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a5838-75fd-4a14-bee7-f167b9ea881f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:56.402855 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a5838-75fd-4a14-bee7-f167b9ea881f admin admin] PATH_INFO: `/v3/users/a28dfa7eef0c4b6098539e958284eab9` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:56.404011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a5838-75fd-4a14-bee7-f167b9ea881f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a28dfa7eef0c4b6098539e958284eab9)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:56.405936 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a5838-75fd-4a14-bee7-f167b9ea881f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:56.491769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-359a5838-75fd-4a14-bee7-f167b9ea881f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a28dfa7eef0c4b6098539e958284eab9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:56.492527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-359a5838-75fd-4a14-bee7-f167b9ea881f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a28dfa7eef0c4b6098539e958284eab9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:56.502384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-359a5838-75fd-4a14-bee7-f167b9ea881f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a28dfa7eef0c4b6098539e958284eab9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:56.516417 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-359a5838-75fd-4a14-bee7-f167b9ea881f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a28dfa7eef0c4b6098539e958284eab9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:56.517199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-359a5838-75fd-4a14-bee7-f167b9ea881f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a28dfa7eef0c4b6098539e958284eab9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:56.534163 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1027/2050] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:19:56 2022] DELETE /identity/v3/users/a28dfa7eef0c4b6098539e958284eab9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:56.839361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef798832-0336-4847-9c6e-8581588d8d5c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:56.841090 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ef798832-0336-4847-9c6e-8581588d8d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:56.863662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef798832-0336-4847-9c6e-8581588d8d5c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:56.929273 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dc6d8-133d-4504-ae87-a72c7c4f3e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:56.930060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc6d8-133d-4504-ae87-a72c7c4f3e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:56.930349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc6d8-133d-4504-ae87-a72c7c4f3e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:56.930621 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc6d8-133d-4504-ae87-a72c7c4f3e7c admin admin] PATH_INFO: `/v3/projects/d5c2cd3f8dc14de982b2b8ce77624fbf` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:56.931985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1dc6d8-133d-4504-ae87-a72c7c4f3e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5c2cd3f8dc14de982b2b8ce77624fbf)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:56.935060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1dc6d8-133d-4504-ae87-a72c7c4f3e7c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:57.008676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3d1dc6d8-133d-4504-ae87-a72c7c4f3e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c2cd3f8dc14de982b2b8ce77624fbf', 'request_id': 'req-3d1dc6d8-133d-4504-ae87-a72c7c4f3e7c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:57.020660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3d1dc6d8-133d-4504-ae87-a72c7c4f3e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c2cd3f8dc14de982b2b8ce77624fbf', 'request_id': 'req-3d1dc6d8-133d-4504-ae87-a72c7c4f3e7c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:57.034487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3d1dc6d8-133d-4504-ae87-a72c7c4f3e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c2cd3f8dc14de982b2b8ce77624fbf', 'request_id': 'req-3d1dc6d8-133d-4504-ae87-a72c7c4f3e7c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:57.067245 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3d1dc6d8-133d-4504-ae87-a72c7c4f3e7c admin admin] The token cache is being invalidate because project d5c2cd3f8dc14de982b2b8ce77624fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:19:57.067587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3d1dc6d8-133d-4504-ae87-a72c7c4f3e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:57.068883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3d1dc6d8-133d-4504-ae87-a72c7c4f3e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:19:57.074480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1024/2051] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:19:56 2022] DELETE /identity/v3/projects/d5c2cd3f8dc14de982b2b8ce77624fbf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:57.075766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293231e2-4cd8-452d-896e-59a1fbbc96e8 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:57.076203 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293231e2-4cd8-452d-896e-59a1fbbc96e8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:57.076295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293231e2-4cd8-452d-896e-59a1fbbc96e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:57.128061 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-293231e2-4cd8-452d-896e-59a1fbbc96e8 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:57.131096 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-293231e2-4cd8-452d-896e-59a1fbbc96e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:57.288226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1028/2052] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:19:57.300780 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00668d-4d89-4fec-88e1-7e285743da40 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:57.301657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00668d-4d89-4fec-88e1-7e285743da40 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:57.302285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00668d-4d89-4fec-88e1-7e285743da40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:57.324051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6b00668d-4d89-4fec-88e1-7e285743da40 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:57.325275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6b00668d-4d89-4fec-88e1-7e285743da40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:57.334516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1025/2053] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:57.338817 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293231e2-4cd8-452d-896e-59a1fbbc96e8 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:57.349071 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293231e2-4cd8-452d-896e-59a1fbbc96e8 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:57.353958 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f1c84-6696-460a-83b3-420c526947b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:57.354639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f1c84-6696-460a-83b3-420c526947b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:57.354977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f1c84-6696-460a-83b3-420c526947b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:57.355354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f1c84-6696-460a-83b3-420c526947b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:57.356069 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f1c84-6696-460a-83b3-420c526947b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:19:57.357017 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f1c84-6696-460a-83b3-420c526947b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:57.358155 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f1c84-6696-460a-83b3-420c526947b9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:57.371097 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1029/2054] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:19:57.375210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00668d-4d89-4fec-88e1-7e285743da40 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:57.395120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00668d-4d89-4fec-88e1-7e285743da40 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:57.395120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81222-a678-44c2-9c23-ca5fb0c8579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:57.395120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81222-a678-44c2-9c23-ca5fb0c8579b admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:57.395120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81222-a678-44c2-9c23-ca5fb0c8579b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:57.395542 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81222-a678-44c2-9c23-ca5fb0c8579b admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:57.396572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a81222-a678-44c2-9c23-ca5fb0c8579b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:57.398565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a81222-a678-44c2-9c23-ca5fb0c8579b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:57.429459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:57.446227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1026/2055] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:19:57 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:57.456306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f1c84-6696-460a-83b3-420c526947b9 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:57.470355 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f1c84-6696-460a-83b3-420c526947b9 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:57.482792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:57.533019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0cfe2-5a29-4e26-b1f1-f2409f0b927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:57.533631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0cfe2-5a29-4e26-b1f1-f2409f0b927a admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:57.533906 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0cfe2-5a29-4e26-b1f1-f2409f0b927a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:57.534173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0cfe2-5a29-4e26-b1f1-f2409f0b927a admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:57.534800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0cfe2-5a29-4e26-b1f1-f2409f0b927a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:57.537325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0cfe2-5a29-4e26-b1f1-f2409f0b927a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:57.561242 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1030/2056] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:19:57 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:19:57.565328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81222-a678-44c2-9c23-ca5fb0c8579b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:57.576788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81222-a678-44c2-9c23-ca5fb0c8579b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:57.582180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b16453-cb7c-431e-a88b-abaf0d20e57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:57.583195 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b16453-cb7c-431e-a88b-abaf0d20e57a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:57.583483 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b16453-cb7c-431e-a88b-abaf0d20e57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:57.583761 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b16453-cb7c-431e-a88b-abaf0d20e57a admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:57.584664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b16453-cb7c-431e-a88b-abaf0d20e57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:57.586263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b16453-cb7c-431e-a88b-abaf0d20e57a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:57.597668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1027/2057] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:57.601657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0cfe2-5a29-4e26-b1f1-f2409f0b927a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:57.611507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0cfe2-5a29-4e26-b1f1-f2409f0b927a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:57.616859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8aacc-9fea-43a4-b584-f1f26b23796b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:57.617452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8aacc-9fea-43a4-b584-f1f26b23796b admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:57.617735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8aacc-9fea-43a4-b584-f1f26b23796b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:57.618012 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8aacc-9fea-43a4-b584-f1f26b23796b admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:57.618653 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8aacc-9fea-43a4-b584-f1f26b23796b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:57.620336 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8aacc-9fea-43a4-b584-f1f26b23796b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:57.632612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1031/2058] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:19:57.637434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b16453-cb7c-431e-a88b-abaf0d20e57a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:57.649312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b16453-cb7c-431e-a88b-abaf0d20e57a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:57.656644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67aa7d-a18d-4d1c-b869-e806c7ce3e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:57.657333 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67aa7d-a18d-4d1c-b869-e806c7ce3e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:57.657614 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67aa7d-a18d-4d1c-b869-e806c7ce3e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:57.657895 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67aa7d-a18d-4d1c-b869-e806c7ce3e82 admin admin] PATH_INFO: `/v3/projects/03521b8926584e2a8eaef4c6ee5c614f/users/fbabad98b3d74e089e409b42bbeacd36/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:57.678870 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67aa7d-a18d-4d1c-b869-e806c7ce3e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03521b8926584e2a8eaef4c6ee5c614f, user_id=fbabad98b3d74e089e409b42bbeacd36, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:57.681564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67aa7d-a18d-4d1c-b869-e806c7ce3e82 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:57.694475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1028/2059] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:19:57 2022] PUT /identity/v3/projects/03521b8926584e2a8eaef4c6ee5c614f/users/fbabad98b3d74e089e409b42bbeacd36/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:19:57.704826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c7c18-a1f0-49b9-a11e-aff138eedc3d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:57.705115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c7c18-a1f0-49b9-a11e-aff138eedc3d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:57.705419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c7c18-a1f0-49b9-a11e-aff138eedc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:57.741830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f17c7c18-a1f0-49b9-a11e-aff138eedc3d None None] MFA Rules not processed for user `fbabad98b3d74e089e409b42bbeacd36`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:19:57.743192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f17c7c18-a1f0-49b9-a11e-aff138eedc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:57.820201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1032/2060] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:19:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:19:57.832008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67aa7d-a18d-4d1c-b869-e806c7ce3e82 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:19:57.834296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ee67aa7d-a18d-4d1c-b869-e806c7ce3e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:19:57.890495 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67aa7d-a18d-4d1c-b869-e806c7ce3e82 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:19:57.894086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015adec5-d3b2-40f8-bc85-ad34a7a29469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:19:57.894687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015adec5-d3b2-40f8-bc85-ad34a7a29469 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:19:57.895020 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015adec5-d3b2-40f8-bc85-ad34a7a29469 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:19:57.895608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015adec5-d3b2-40f8-bc85-ad34a7a29469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:19:57.903650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015adec5-d3b2-40f8-bc85-ad34a7a29469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:19:57.905062 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015adec5-d3b2-40f8-bc85-ad34a7a29469 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:19:57.914271 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1029/2061] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:19:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:00.108256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c7c18-a1f0-49b9-a11e-aff138eedc3d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:00.121779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c7c18-a1f0-49b9-a11e-aff138eedc3d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:00.141679 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597619d-a29f-440f-9ebf-f48f6ee6a3a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:00.142340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597619d-a29f-440f-9ebf-f48f6ee6a3a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:00.142615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597619d-a29f-440f-9ebf-f48f6ee6a3a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:00.142885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597619d-a29f-440f-9ebf-f48f6ee6a3a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:00.144758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e597619d-a29f-440f-9ebf-f48f6ee6a3a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:00.214066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597619d-a29f-440f-9ebf-f48f6ee6a3a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:00.215547 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597619d-a29f-440f-9ebf-f48f6ee6a3a4 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:00.225339 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1033/2062] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:01.365561 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015adec5-d3b2-40f8-bc85-ad34a7a29469 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:01.367168 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-015adec5-d3b2-40f8-bc85-ad34a7a29469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:01.433133 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015adec5-d3b2-40f8-bc85-ad34a7a29469 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:01.437570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e2b6a-77c6-44b6-a816-3cd91d634734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:01.438188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e2b6a-77c6-44b6-a816-3cd91d634734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:01.438462 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e2b6a-77c6-44b6-a816-3cd91d634734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:01.438732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e2b6a-77c6-44b6-a816-3cd91d634734 admin admin] PATH_INFO: `/v3/users/9dc230f77e80443d9db3bf73674f555a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:01.440260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e2b6a-77c6-44b6-a816-3cd91d634734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc230f77e80443d9db3bf73674f555a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:01.443109 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e2b6a-77c6-44b6-a816-3cd91d634734 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:01.499216 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef6e2b6a-77c6-44b6-a816-3cd91d634734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc230f77e80443d9db3bf73674f555a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:01.499954 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef6e2b6a-77c6-44b6-a816-3cd91d634734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc230f77e80443d9db3bf73674f555a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:01.509469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef6e2b6a-77c6-44b6-a816-3cd91d634734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc230f77e80443d9db3bf73674f555a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:01.517268 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:01.531851 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef6e2b6a-77c6-44b6-a816-3cd91d634734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc230f77e80443d9db3bf73674f555a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:01.532651 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef6e2b6a-77c6-44b6-a816-3cd91d634734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc230f77e80443d9db3bf73674f555a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:01.549383 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1030/2063] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:01 2022] DELETE /identity/v3/users/9dc230f77e80443d9db3bf73674f555a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:01.553683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced99d1-2036-40c7-a73e-4a1cea2dff7b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:01.554181 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced99d1-2036-40c7-a73e-4a1cea2dff7b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:01.554461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced99d1-2036-40c7-a73e-4a1cea2dff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:01.576436 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-9ced99d1-2036-40c7-a73e-4a1cea2dff7b None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:01.577866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9ced99d1-2036-40c7-a73e-4a1cea2dff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:01.593829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:01.696181 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1034/2064] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:01.710081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e2b6a-77c6-44b6-a816-3cd91d634734 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:01.711571 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ef6e2b6a-77c6-44b6-a816-3cd91d634734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:01.799563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e2b6a-77c6-44b6-a816-3cd91d634734 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:01.803747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fd480-7ce7-46e2-804c-13d7961db6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:01.804354 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fd480-7ce7-46e2-804c-13d7961db6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:01.804632 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fd480-7ce7-46e2-804c-13d7961db6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:01.804905 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fd480-7ce7-46e2-804c-13d7961db6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:01.815416 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fd480-7ce7-46e2-804c-13d7961db6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:01.817184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fd480-7ce7-46e2-804c-13d7961db6e3 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:01.828853 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1031/2065] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:02.132861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced99d1-2036-40c7-a73e-4a1cea2dff7b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:02.134480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9ced99d1-2036-40c7-a73e-4a1cea2dff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:02.149401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced99d1-2036-40c7-a73e-4a1cea2dff7b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:02.157170 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb765f-7f39-4325-a51f-22a38eb363a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:02.158969 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb765f-7f39-4325-a51f-22a38eb363a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:02.159286 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb765f-7f39-4325-a51f-22a38eb363a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:02.159918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb765f-7f39-4325-a51f-22a38eb363a2 admin admin] PATH_INFO: `/v3/projects/d021925f9d644bff816589773102cc05` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:02.162170 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb765f-7f39-4325-a51f-22a38eb363a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d021925f9d644bff816589773102cc05)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:02.165745 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb765f-7f39-4325-a51f-22a38eb363a2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:02.218969 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-64fb765f-7f39-4325-a51f-22a38eb363a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd021925f9d644bff816589773102cc05', 'request_id': 'req-64fb765f-7f39-4325-a51f-22a38eb363a2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:02.226143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-64fb765f-7f39-4325-a51f-22a38eb363a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd021925f9d644bff816589773102cc05', 'request_id': 'req-64fb765f-7f39-4325-a51f-22a38eb363a2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:02.232129 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-64fb765f-7f39-4325-a51f-22a38eb363a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd021925f9d644bff816589773102cc05', 'request_id': 'req-64fb765f-7f39-4325-a51f-22a38eb363a2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:02.248195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-64fb765f-7f39-4325-a51f-22a38eb363a2 admin admin] The token cache is being invalidate because project d021925f9d644bff816589773102cc05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:02.248482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-64fb765f-7f39-4325-a51f-22a38eb363a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:02.249117 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-64fb765f-7f39-4325-a51f-22a38eb363a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:02.250613 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1035/2066] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:02 2022] DELETE /identity/v3/projects/d021925f9d644bff816589773102cc05 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:02.254655 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fd480-7ce7-46e2-804c-13d7961db6e3 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:02.266523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fd480-7ce7-46e2-804c-13d7961db6e3 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:02.339732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a056bc-81e4-474f-903b-0bd912ced9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:02.340975 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a056bc-81e4-474f-903b-0bd912ced9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:02.341460 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a056bc-81e4-474f-903b-0bd912ced9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:02.341931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a056bc-81e4-474f-903b-0bd912ced9c8 admin admin] PATH_INFO: `/v3/users/5c53c206c8354801888b3972e18d337e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:02.343357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a056bc-81e4-474f-903b-0bd912ced9c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c53c206c8354801888b3972e18d337e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:02.345671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a056bc-81e4-474f-903b-0bd912ced9c8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:02.401616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-01a056bc-81e4-474f-903b-0bd912ced9c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c53c206c8354801888b3972e18d337e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:02.402284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-01a056bc-81e4-474f-903b-0bd912ced9c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c53c206c8354801888b3972e18d337e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:02.414699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-01a056bc-81e4-474f-903b-0bd912ced9c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c53c206c8354801888b3972e18d337e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:02.434696 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-01a056bc-81e4-474f-903b-0bd912ced9c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c53c206c8354801888b3972e18d337e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:02.435457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-01a056bc-81e4-474f-903b-0bd912ced9c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c53c206c8354801888b3972e18d337e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:02.453651 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1032/2067] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:02 2022] DELETE /identity/v3/users/5c53c206c8354801888b3972e18d337e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:02.776143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb765f-7f39-4325-a51f-22a38eb363a2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:02.782219 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-64fb765f-7f39-4325-a51f-22a38eb363a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:02.804836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb765f-7f39-4325-a51f-22a38eb363a2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:02.873320 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29977d59-e124-4379-8418-3d06cb049b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:02.873956 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29977d59-e124-4379-8418-3d06cb049b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:02.874279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29977d59-e124-4379-8418-3d06cb049b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:02.874529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29977d59-e124-4379-8418-3d06cb049b7d admin admin] PATH_INFO: `/v3/projects/baf9fc0d85ef4977b8234c9bd1cc5c8f` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:02.875718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29977d59-e124-4379-8418-3d06cb049b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=baf9fc0d85ef4977b8234c9bd1cc5c8f)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:02.877759 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29977d59-e124-4379-8418-3d06cb049b7d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:02.929760 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:02.950434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-29977d59-e124-4379-8418-3d06cb049b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baf9fc0d85ef4977b8234c9bd1cc5c8f', 'request_id': 'req-29977d59-e124-4379-8418-3d06cb049b7d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:02.974799 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-29977d59-e124-4379-8418-3d06cb049b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baf9fc0d85ef4977b8234c9bd1cc5c8f', 'request_id': 'req-29977d59-e124-4379-8418-3d06cb049b7d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:02.990747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-29977d59-e124-4379-8418-3d06cb049b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baf9fc0d85ef4977b8234c9bd1cc5c8f', 'request_id': 'req-29977d59-e124-4379-8418-3d06cb049b7d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:03.018085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-29977d59-e124-4379-8418-3d06cb049b7d admin admin] The token cache is being invalidate because project baf9fc0d85ef4977b8234c9bd1cc5c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:03.018693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-29977d59-e124-4379-8418-3d06cb049b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:03.021660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-29977d59-e124-4379-8418-3d06cb049b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:03.023566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1036/2068] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:02 2022] DELETE /identity/v3/projects/baf9fc0d85ef4977b8234c9bd1cc5c8f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:03.028236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a00048-d1c6-4b5b-9a92-35ac65781f7c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:03.029429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a00048-d1c6-4b5b-9a92-35ac65781f7c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:03.030064 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a00048-d1c6-4b5b-9a92-35ac65781f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:03.048142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:03.063328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29977d59-e124-4379-8418-3d06cb049b7d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:03.064698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-29977d59-e124-4379-8418-3d06cb049b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:03.064901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e8a00048-d1c6-4b5b-9a92-35ac65781f7c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:03.067276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e8a00048-d1c6-4b5b-9a92-35ac65781f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:03.141448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1033/2069] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:03.149693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2599c35-e3a6-4096-b8fb-63bfb4590fe0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:03.149984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2599c35-e3a6-4096-b8fb-63bfb4590fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:03.150265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2599c35-e3a6-4096-b8fb-63bfb4590fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:03.150438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29977d59-e124-4379-8418-3d06cb049b7d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:03.155825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05798bec-47dd-415f-b176-06e5a48d9201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:03.156681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05798bec-47dd-415f-b176-06e5a48d9201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:03.157126 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05798bec-47dd-415f-b176-06e5a48d9201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:03.157426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05798bec-47dd-415f-b176-06e5a48d9201 admin admin] PATH_INFO: `/v3/users/ddf20e90f78e47e7b11def93701b0eef` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:03.158599 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05798bec-47dd-415f-b176-06e5a48d9201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf20e90f78e47e7b11def93701b0eef)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:03.161528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05798bec-47dd-415f-b176-06e5a48d9201 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:03.173679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a2599c35-e3a6-4096-b8fb-63bfb4590fe0 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:03.175147 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a2599c35-e3a6-4096-b8fb-63bfb4590fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:03.186094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1034/2070] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:03.190143 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2599c35-e3a6-4096-b8fb-63bfb4590fe0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:03.200564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2599c35-e3a6-4096-b8fb-63bfb4590fe0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:03.205626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136991c7-216e-41fe-8a1a-82a7aa9b9b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:03.206358 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136991c7-216e-41fe-8a1a-82a7aa9b9b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:03.206641 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136991c7-216e-41fe-8a1a-82a7aa9b9b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:03.207875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136991c7-216e-41fe-8a1a-82a7aa9b9b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:03.208453 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136991c7-216e-41fe-8a1a-82a7aa9b9b9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:03.208737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136991c7-216e-41fe-8a1a-82a7aa9b9b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:03.210605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136991c7-216e-41fe-8a1a-82a7aa9b9b9a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:03.218225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-05798bec-47dd-415f-b176-06e5a48d9201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf20e90f78e47e7b11def93701b0eef'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:03.219058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-05798bec-47dd-415f-b176-06e5a48d9201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf20e90f78e47e7b11def93701b0eef'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:03.225776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1035/2071] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:20:03.228193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-05798bec-47dd-415f-b176-06e5a48d9201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf20e90f78e47e7b11def93701b0eef'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:03.230893 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136991c7-216e-41fe-8a1a-82a7aa9b9b9a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:03.233065 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-136991c7-216e-41fe-8a1a-82a7aa9b9b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:03.247652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-05798bec-47dd-415f-b176-06e5a48d9201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf20e90f78e47e7b11def93701b0eef'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:03.248545 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-05798bec-47dd-415f-b176-06e5a48d9201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf20e90f78e47e7b11def93701b0eef'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:03.256223 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136991c7-216e-41fe-8a1a-82a7aa9b9b9a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:03.261335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c04dd-1d32-4f70-a245-9d7d18aa11c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:03.261946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c04dd-1d32-4f70-a245-9d7d18aa11c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:03.262225 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c04dd-1d32-4f70-a245-9d7d18aa11c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:03.262333 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1037/2072] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:03 2022] DELETE /identity/v3/users/ddf20e90f78e47e7b11def93701b0eef => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:03.263292 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c04dd-1d32-4f70-a245-9d7d18aa11c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:03.264084 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c04dd-1d32-4f70-a245-9d7d18aa11c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:03.266161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c04dd-1d32-4f70-a245-9d7d18aa11c3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:03.266686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47bc34-f6f7-43da-9814-0af122485283 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:03.266974 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47bc34-f6f7-43da-9814-0af122485283 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:03.267337 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47bc34-f6f7-43da-9814-0af122485283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:03.291785 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4e47bc34-f6f7-43da-9814-0af122485283 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:03.293023 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4e47bc34-f6f7-43da-9814-0af122485283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:03.295960 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1036/2073] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:03 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:03.300154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c04dd-1d32-4f70-a245-9d7d18aa11c3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:03.340589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:03.356554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1038/2074] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:03.365224 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c04dd-1d32-4f70-a245-9d7d18aa11c3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:03.366940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47bc34-f6f7-43da-9814-0af122485283 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:03.368341 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4e47bc34-f6f7-43da-9814-0af122485283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:03.369994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dce60-761b-499d-8db3-f52713025d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:03.370610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dce60-761b-499d-8db3-f52713025d8c admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:03.370894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dce60-761b-499d-8db3-f52713025d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:03.371205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dce60-761b-499d-8db3-f52713025d8c admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:03.371845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dce60-761b-499d-8db3-f52713025d8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:03.373845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dce60-761b-499d-8db3-f52713025d8c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:03.402596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1037/2075] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:03 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:03.403902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dce60-761b-499d-8db3-f52713025d8c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:03.417135 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dce60-761b-499d-8db3-f52713025d8c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:03.422300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e29be-22f3-4f1e-beeb-74a7f8f0b444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:03.423270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e29be-22f3-4f1e-beeb-74a7f8f0b444 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:03.423567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e29be-22f3-4f1e-beeb-74a7f8f0b444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:03.423853 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e29be-22f3-4f1e-beeb-74a7f8f0b444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:03.425187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e29be-22f3-4f1e-beeb-74a7f8f0b444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:03.427316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e29be-22f3-4f1e-beeb-74a7f8f0b444 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:03.444570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1038/2076] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:03.445939 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e29be-22f3-4f1e-beeb-74a7f8f0b444 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:03.446686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47bc34-f6f7-43da-9814-0af122485283 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:03.450427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0ecdd-4a0a-46ef-9565-6c955f961acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:03.451032 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0ecdd-4a0a-46ef-9565-6c955f961acb service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:03.451346 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0ecdd-4a0a-46ef-9565-6c955f961acb service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:03.451625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0ecdd-4a0a-46ef-9565-6c955f961acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:03.456459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e29be-22f3-4f1e-beeb-74a7f8f0b444 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:03.462628 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8c373-ae10-4989-8e64-47c6456fecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:03.463292 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8c373-ae10-4989-8e64-47c6456fecbc admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:03.463576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8c373-ae10-4989-8e64-47c6456fecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:03.463871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8c373-ae10-4989-8e64-47c6456fecbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:03.464822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8c373-ae10-4989-8e64-47c6456fecbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:03.465689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0ecdd-4a0a-46ef-9565-6c955f961acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:03.466136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8c373-ae10-4989-8e64-47c6456fecbc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:03.467907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0ecdd-4a0a-46ef-9565-6c955f961acb service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:03.479258 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1039/2077] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:03.480030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1039/2078] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:03.484011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0ecdd-4a0a-46ef-9565-6c955f961acb service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:03.494631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0ecdd-4a0a-46ef-9565-6c955f961acb service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:03.500378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d85861-abbf-41f9-b3ba-b46c3c9ea435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:03.501362 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d85861-abbf-41f9-b3ba-b46c3c9ea435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:03.501743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d85861-abbf-41f9-b3ba-b46c3c9ea435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:03.502098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d85861-abbf-41f9-b3ba-b46c3c9ea435 admin admin] PATH_INFO: `/v3/projects/d31d81b792694bed92ab28baa36e9fac/users/eee38bb424014f12ae346af5bb551153/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:03.519271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d85861-abbf-41f9-b3ba-b46c3c9ea435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31d81b792694bed92ab28baa36e9fac, user_id=eee38bb424014f12ae346af5bb551153, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:03.522646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d85861-abbf-41f9-b3ba-b46c3c9ea435 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:03.537553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1040/2079] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:03 2022] PUT /identity/v3/projects/d31d81b792694bed92ab28baa36e9fac/users/eee38bb424014f12ae346af5bb551153/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:03.547515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c32a5-4ea9-41a6-8000-d86f9baad909 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:03.547851 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c32a5-4ea9-41a6-8000-d86f9baad909 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:03.548069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c32a5-4ea9-41a6-8000-d86f9baad909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:03.583313 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cd8c32a5-4ea9-41a6-8000-d86f9baad909 None None] MFA Rules not processed for user `eee38bb424014f12ae346af5bb551153`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:03.584919 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cd8c32a5-4ea9-41a6-8000-d86f9baad909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:03.607618 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:03.699846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1040/2080] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:03.700647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d85861-abbf-41f9-b3ba-b46c3c9ea435 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:03.787680 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d85861-abbf-41f9-b3ba-b46c3c9ea435 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:03.795029 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433f5ee-a476-4fb4-b331-22abd5e7b362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:03.795746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433f5ee-a476-4fb4-b331-22abd5e7b362 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:03.796029 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433f5ee-a476-4fb4-b331-22abd5e7b362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:03.797304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433f5ee-a476-4fb4-b331-22abd5e7b362 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:03.797958 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433f5ee-a476-4fb4-b331-22abd5e7b362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:03.800271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433f5ee-a476-4fb4-b331-22abd5e7b362 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:03.840678 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1041/2081] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:03 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:03.842063 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c32a5-4ea9-41a6-8000-d86f9baad909 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:03.842859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433f5ee-a476-4fb4-b331-22abd5e7b362 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:03.844060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cd8c32a5-4ea9-41a6-8000-d86f9baad909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:03.862884 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c32a5-4ea9-41a6-8000-d86f9baad909 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:03.932484 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:03.937701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fb4d8-a250-4a1c-89fd-ae859a9e8f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:03.938365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fb4d8-a250-4a1c-89fd-ae859a9e8f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:03.938611 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fb4d8-a250-4a1c-89fd-ae859a9e8f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:03.938986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fb4d8-a250-4a1c-89fd-ae859a9e8f53 admin admin] PATH_INFO: `/v3/projects/9a5b8d8b06e2436eae2d2cc24e0032a7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:03.940105 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fb4d8-a250-4a1c-89fd-ae859a9e8f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5b8d8b06e2436eae2d2cc24e0032a7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:03.942971 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433f5ee-a476-4fb4-b331-22abd5e7b362 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:03.943352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fb4d8-a250-4a1c-89fd-ae859a9e8f53 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:03.951661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0862737-800d-4a79-a534-2083a88d3c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:03.952649 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0862737-800d-4a79-a534-2083a88d3c1a admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:03.952761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0862737-800d-4a79-a534-2083a88d3c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:03.952965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0862737-800d-4a79-a534-2083a88d3c1a admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:03.953607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0862737-800d-4a79-a534-2083a88d3c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:03.956045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0862737-800d-4a79-a534-2083a88d3c1a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:03.989633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1042/2082] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:03 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:03.991739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0862737-800d-4a79-a534-2083a88d3c1a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:04.005298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0862737-800d-4a79-a534-2083a88d3c1a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:04.013853 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-175fb4d8-a250-4a1c-89fd-ae859a9e8f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5b8d8b06e2436eae2d2cc24e0032a7', 'request_id': 'req-175fb4d8-a250-4a1c-89fd-ae859a9e8f53'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:04.025188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-175fb4d8-a250-4a1c-89fd-ae859a9e8f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5b8d8b06e2436eae2d2cc24e0032a7', 'request_id': 'req-175fb4d8-a250-4a1c-89fd-ae859a9e8f53'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:04.034959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-175fb4d8-a250-4a1c-89fd-ae859a9e8f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5b8d8b06e2436eae2d2cc24e0032a7', 'request_id': 'req-175fb4d8-a250-4a1c-89fd-ae859a9e8f53'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:04.061940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-175fb4d8-a250-4a1c-89fd-ae859a9e8f53 admin admin] The token cache is being invalidate because project 9a5b8d8b06e2436eae2d2cc24e0032a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:04.062735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-175fb4d8-a250-4a1c-89fd-ae859a9e8f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:04.063513 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-175fb4d8-a250-4a1c-89fd-ae859a9e8f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:04.065773 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1041/2083] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:03 2022] DELETE /identity/v3/projects/9a5b8d8b06e2436eae2d2cc24e0032a7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:04.071625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6dd64-2daf-4fff-a0be-788dafd325db None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:04.072147 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6dd64-2daf-4fff-a0be-788dafd325db None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:04.072686 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6dd64-2daf-4fff-a0be-788dafd325db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:04.102560 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77b1ef-7b88-4dd4-bdc6-170c27d95a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:04.103695 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77b1ef-7b88-4dd4-bdc6-170c27d95a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:04.103950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77b1ef-7b88-4dd4-bdc6-170c27d95a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:04.104379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77b1ef-7b88-4dd4-bdc6-170c27d95a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:04.105048 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77b1ef-7b88-4dd4-bdc6-170c27d95a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:04.106674 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77b1ef-7b88-4dd4-bdc6-170c27d95a37 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:04.111774 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7dd6dd64-2daf-4fff-a0be-788dafd325db None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:04.115331 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7dd6dd64-2daf-4fff-a0be-788dafd325db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:04.124648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1043/2084] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:04.126568 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77b1ef-7b88-4dd4-bdc6-170c27d95a37 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:04.128169 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1042/2085] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:04.140331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ac77b1ef-7b88-4dd4-bdc6-170c27d95a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:04.144399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b4187-0a71-4279-ac20-b7a1f0334fbb None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:04.145803 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b4187-0a71-4279-ac20-b7a1f0334fbb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:04.146127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b4187-0a71-4279-ac20-b7a1f0334fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:04.167218 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77b1ef-7b88-4dd4-bdc6-170c27d95a37 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:04.173046 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11eb6ed-e955-4923-8a1b-5a5638d913a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:04.174012 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eb6ed-e955-4923-8a1b-5a5638d913a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:04.174136 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eb6ed-e955-4923-8a1b-5a5638d913a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:04.174446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eb6ed-e955-4923-8a1b-5a5638d913a0 admin admin] PATH_INFO: `/v3/projects/6ebb25f4bae3498ea56f1e5caef71be9/users/3276a8871fa54dbe95530b2e3167b066/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:04.180726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a75b4187-0a71-4279-ac20-b7a1f0334fbb None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:04.182116 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a75b4187-0a71-4279-ac20-b7a1f0334fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:04.194994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1043/2086] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:04.199369 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b4187-0a71-4279-ac20-b7a1f0334fbb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:04.209254 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b4187-0a71-4279-ac20-b7a1f0334fbb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:04.215733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3991f-ed97-4567-bc26-867f5cd0c62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:04.216445 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3991f-ed97-4567-bc26-867f5cd0c62c admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:04.216757 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3991f-ed97-4567-bc26-867f5cd0c62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:04.217364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3991f-ed97-4567-bc26-867f5cd0c62c admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:04.218086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3991f-ed97-4567-bc26-867f5cd0c62c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:04.218456 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3991f-ed97-4567-bc26-867f5cd0c62c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:04.218890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11eb6ed-e955-4923-8a1b-5a5638d913a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebb25f4bae3498ea56f1e5caef71be9, user_id=3276a8871fa54dbe95530b2e3167b066, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:04.220207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3991f-ed97-4567-bc26-867f5cd0c62c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:04.224199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11eb6ed-e955-4923-8a1b-5a5638d913a0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:04.233998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1044/2087] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:04.240941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3991f-ed97-4567-bc26-867f5cd0c62c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:04.245652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1044/2088] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:04 2022] PUT /identity/v3/projects/6ebb25f4bae3498ea56f1e5caef71be9/users/3276a8871fa54dbe95530b2e3167b066/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:04.249836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11eb6ed-e955-4923-8a1b-5a5638d913a0 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:04.261749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3991f-ed97-4567-bc26-867f5cd0c62c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:04.306141 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:04.356316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e526d-af8e-4c64-81ee-fd91f47f4cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:04.356937 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e526d-af8e-4c64-81ee-fd91f47f4cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:04.357219 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e526d-af8e-4c64-81ee-fd91f47f4cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:04.357492 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e526d-af8e-4c64-81ee-fd91f47f4cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:04.358153 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e526d-af8e-4c64-81ee-fd91f47f4cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:04.360243 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e526d-af8e-4c64-81ee-fd91f47f4cdb admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:04.382914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11eb6ed-e955-4923-8a1b-5a5638d913a0 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:04.400850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacea4b-a156-4620-8b15-e31bf6b5dcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:04.401603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacea4b-a156-4620-8b15-e31bf6b5dcee admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:04.401945 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacea4b-a156-4620-8b15-e31bf6b5dcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:04.402281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacea4b-a156-4620-8b15-e31bf6b5dcee admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:04.402997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacea4b-a156-4620-8b15-e31bf6b5dcee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:04.404680 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacea4b-a156-4620-8b15-e31bf6b5dcee admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:04.407345 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1045/2089] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:04 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:04.413343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e526d-af8e-4c64-81ee-fd91f47f4cdb admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:04.436485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1045/2090] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:20:04.440420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacea4b-a156-4620-8b15-e31bf6b5dcee admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:04.461308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacea4b-a156-4620-8b15-e31bf6b5dcee admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:04.574859 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e526d-af8e-4c64-81ee-fd91f47f4cdb admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:04.590810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b3fb8-5007-4801-8d7c-1e5d03889a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:04.591380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b3fb8-5007-4801-8d7c-1e5d03889a75 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:04.591670 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b3fb8-5007-4801-8d7c-1e5d03889a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:04.592015 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b3fb8-5007-4801-8d7c-1e5d03889a75 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:04.592843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b3fb8-5007-4801-8d7c-1e5d03889a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:04.598707 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b3fb8-5007-4801-8d7c-1e5d03889a75 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:04.630844 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:04.643124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1046/2091] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:04 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:04.644770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b3fb8-5007-4801-8d7c-1e5d03889a75 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:04.646470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb237d5f-29ae-4604-bb8f-46284631ac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:04.647285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb237d5f-29ae-4604-bb8f-46284631ac17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:04.647660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb237d5f-29ae-4604-bb8f-46284631ac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:04.648045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb237d5f-29ae-4604-bb8f-46284631ac17 admin admin] PATH_INFO: `/v3/projects/6ebb25f4bae3498ea56f1e5caef71be9/users/3276a8871fa54dbe95530b2e3167b066/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:04.650202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb237d5f-29ae-4604-bb8f-46284631ac17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebb25f4bae3498ea56f1e5caef71be9, user_id=3276a8871fa54dbe95530b2e3167b066, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:04.653415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb237d5f-29ae-4604-bb8f-46284631ac17 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:04.663116 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b3fb8-5007-4801-8d7c-1e5d03889a75 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:04.667207 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1046/2092] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:04 2022] PUT /identity/v3/projects/6ebb25f4bae3498ea56f1e5caef71be9/users/3276a8871fa54dbe95530b2e3167b066/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:04.688562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d13e4-75aa-429a-98f5-7fa9ebf1876d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:04.688851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d13e4-75aa-429a-98f5-7fa9ebf1876d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:04.690060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d13e4-75aa-429a-98f5-7fa9ebf1876d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:04.750624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e85d13e4-75aa-429a-98f5-7fa9ebf1876d None None] MFA Rules not processed for user `3276a8871fa54dbe95530b2e3167b066`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:04.750947 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e85d13e4-75aa-429a-98f5-7fa9ebf1876d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:04.794875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb829a-3b90-460d-afa6-84a41ca6ec75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:04.795725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb829a-3b90-460d-afa6-84a41ca6ec75 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:04.797683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb829a-3b90-460d-afa6-84a41ca6ec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:04.798035 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb829a-3b90-460d-afa6-84a41ca6ec75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:04.798900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb829a-3b90-460d-afa6-84a41ca6ec75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:04.806246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb829a-3b90-460d-afa6-84a41ca6ec75 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:04.842717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1047/2093] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:04.843918 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb829a-3b90-460d-afa6-84a41ca6ec75 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:04.857757 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb829a-3b90-460d-afa6-84a41ca6ec75 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:04.863910 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f28fe-820b-4475-8d48-714a3da95364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:04.866036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f28fe-820b-4475-8d48-714a3da95364 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:04.866625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f28fe-820b-4475-8d48-714a3da95364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:04.867349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f28fe-820b-4475-8d48-714a3da95364 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:04.868369 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f28fe-820b-4475-8d48-714a3da95364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:04.870508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f28fe-820b-4475-8d48-714a3da95364 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:04.886890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1048/2094] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:04.891146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f28fe-820b-4475-8d48-714a3da95364 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:04.893434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1047/2095] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:04.905405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f28fe-820b-4475-8d48-714a3da95364 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:04.905893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d13e4-75aa-429a-98f5-7fa9ebf1876d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:04.907466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e85d13e4-75aa-429a-98f5-7fa9ebf1876d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:04.912702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1684e3-16c5-4319-8cb8-4e1039aebd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:04.914040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1684e3-16c5-4319-8cb8-4e1039aebd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:04.914420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1684e3-16c5-4319-8cb8-4e1039aebd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:04.915022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1684e3-16c5-4319-8cb8-4e1039aebd2c admin admin] PATH_INFO: `/v3/projects/9bf7b0ee045d452fbe95966be044f664/users/caa6a0459a2e43298efe1bb3174f91c2/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:04.940830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1684e3-16c5-4319-8cb8-4e1039aebd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf7b0ee045d452fbe95966be044f664, user_id=caa6a0459a2e43298efe1bb3174f91c2, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:04.943587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1684e3-16c5-4319-8cb8-4e1039aebd2c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:04.958206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:04.967398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1049/2096] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:04 2022] PUT /identity/v3/projects/9bf7b0ee045d452fbe95966be044f664/users/caa6a0459a2e43298efe1bb3174f91c2/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:04.982332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dbbc6-2f22-4a7a-ab0c-d2206795b3ac None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:04.982816 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dbbc6-2f22-4a7a-ab0c-d2206795b3ac None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:04.983211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dbbc6-2f22-4a7a-ab0c-d2206795b3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:05.018281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d13e4-75aa-429a-98f5-7fa9ebf1876d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:05.020369 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-639dbbc6-2f22-4a7a-ab0c-d2206795b3ac None None] MFA Rules not processed for user `caa6a0459a2e43298efe1bb3174f91c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:05.021709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-639dbbc6-2f22-4a7a-ab0c-d2206795b3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:05.124951 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1050/2097] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:05.136964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dbbc6-2f22-4a7a-ab0c-d2206795b3ac None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:05.147210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-639dbbc6-2f22-4a7a-ab0c-d2206795b3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:05.161792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4884e1-6636-48fc-9c8f-ba61bb90f359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:05.165583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4884e1-6636-48fc-9c8f-ba61bb90f359 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:05.165742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4884e1-6636-48fc-9c8f-ba61bb90f359 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:05.165952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4884e1-6636-48fc-9c8f-ba61bb90f359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:05.173914 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dbbc6-2f22-4a7a-ab0c-d2206795b3ac None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:05.180533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a564c-26b0-4312-8406-cd3053771a5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:05.181276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a564c-26b0-4312-8406-cd3053771a5d service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:05.181783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a564c-26b0-4312-8406-cd3053771a5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:05.182229 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a564c-26b0-4312-8406-cd3053771a5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:05.195910 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a564c-26b0-4312-8406-cd3053771a5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:05.199076 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a564c-26b0-4312-8406-cd3053771a5d service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:05.215626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1051/2098] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:05.259042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:05.312833 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4884e1-6636-48fc-9c8f-ba61bb90f359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:05.314496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4884e1-6636-48fc-9c8f-ba61bb90f359 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:05.332698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1048/2099] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:04 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:05.375769 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a564c-26b0-4312-8406-cd3053771a5d service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:05.508346 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a564c-26b0-4312-8406-cd3053771a5d service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:05.522033 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccf906-749d-4002-8833-302181b74da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:05.523121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccf906-749d-4002-8833-302181b74da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:05.523511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccf906-749d-4002-8833-302181b74da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:05.523853 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccf906-749d-4002-8833-302181b74da3 admin admin] PATH_INFO: `/v3/users/eee38bb424014f12ae346af5bb551153` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:05.525645 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccf906-749d-4002-8833-302181b74da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee38bb424014f12ae346af5bb551153)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:05.528732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccf906-749d-4002-8833-302181b74da3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:05.653326 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-94ccf906-749d-4002-8833-302181b74da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee38bb424014f12ae346af5bb551153'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:05.654111 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-94ccf906-749d-4002-8833-302181b74da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee38bb424014f12ae346af5bb551153'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:05.664261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-94ccf906-749d-4002-8833-302181b74da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee38bb424014f12ae346af5bb551153'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:05.691286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-94ccf906-749d-4002-8833-302181b74da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee38bb424014f12ae346af5bb551153'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:05.693451 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-94ccf906-749d-4002-8833-302181b74da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee38bb424014f12ae346af5bb551153'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:05.701494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:05.738180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1052/2100] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:05 2022] DELETE /identity/v3/users/eee38bb424014f12ae346af5bb551153 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:05.742561 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723008ba-d5fa-4886-a0ef-9a099732a8bd None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:05.743022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723008ba-d5fa-4886-a0ef-9a099732a8bd None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:05.743372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723008ba-d5fa-4886-a0ef-9a099732a8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:05.796198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-723008ba-d5fa-4886-a0ef-9a099732a8bd None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:05.805361 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-723008ba-d5fa-4886-a0ef-9a099732a8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:05.980196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1049/2101] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:06.034426 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccf906-749d-4002-8833-302181b74da3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:06.036779 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-94ccf906-749d-4002-8833-302181b74da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:06.166058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccf906-749d-4002-8833-302181b74da3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:06.170652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6a13e-7dd4-4746-8d2e-7bbc826eb537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:06.171519 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6a13e-7dd4-4746-8d2e-7bbc826eb537 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:06.171967 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6a13e-7dd4-4746-8d2e-7bbc826eb537 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:06.172392 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6a13e-7dd4-4746-8d2e-7bbc826eb537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:06.184643 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6a13e-7dd4-4746-8d2e-7bbc826eb537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:06.186524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6a13e-7dd4-4746-8d2e-7bbc826eb537 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:06.222429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1053/2102] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:07.053783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723008ba-d5fa-4886-a0ef-9a099732a8bd None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:07.055308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-723008ba-d5fa-4886-a0ef-9a099732a8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:07.091957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723008ba-d5fa-4886-a0ef-9a099732a8bd None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:07.098634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e3f3a-12e8-4b6e-af57-70e14390b320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:07.099926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e3f3a-12e8-4b6e-af57-70e14390b320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:07.100425 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e3f3a-12e8-4b6e-af57-70e14390b320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:07.100963 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e3f3a-12e8-4b6e-af57-70e14390b320 admin admin] PATH_INFO: `/v3/projects/d31d81b792694bed92ab28baa36e9fac` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:07.102394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e3f3a-12e8-4b6e-af57-70e14390b320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31d81b792694bed92ab28baa36e9fac)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:07.105171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e3f3a-12e8-4b6e-af57-70e14390b320 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:07.179915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-716e3f3a-12e8-4b6e-af57-70e14390b320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31d81b792694bed92ab28baa36e9fac', 'request_id': 'req-716e3f3a-12e8-4b6e-af57-70e14390b320'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:07.189584 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-716e3f3a-12e8-4b6e-af57-70e14390b320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31d81b792694bed92ab28baa36e9fac', 'request_id': 'req-716e3f3a-12e8-4b6e-af57-70e14390b320'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:07.197444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-716e3f3a-12e8-4b6e-af57-70e14390b320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31d81b792694bed92ab28baa36e9fac', 'request_id': 'req-716e3f3a-12e8-4b6e-af57-70e14390b320'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:07.216119 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-716e3f3a-12e8-4b6e-af57-70e14390b320 admin admin] The token cache is being invalidate because project d31d81b792694bed92ab28baa36e9fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:07.216410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-716e3f3a-12e8-4b6e-af57-70e14390b320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:07.218010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-716e3f3a-12e8-4b6e-af57-70e14390b320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:07.224516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1050/2103] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:07 2022] DELETE /identity/v3/projects/d31d81b792694bed92ab28baa36e9fac => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:07.225911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6a13e-7dd4-4746-8d2e-7bbc826eb537 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:07.259117 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6a13e-7dd4-4746-8d2e-7bbc826eb537 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:07.519424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0e0a4-69b5-41d4-b137-e2cc0d48ce2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:07.519424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e0a4-69b5-41d4-b137-e2cc0d48ce2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:07.519424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e0a4-69b5-41d4-b137-e2cc0d48ce2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:07.519424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e0a4-69b5-41d4-b137-e2cc0d48ce2a admin admin] PATH_INFO: `/v3/users/3276a8871fa54dbe95530b2e3167b066` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:07.524742 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0e0a4-69b5-41d4-b137-e2cc0d48ce2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3276a8871fa54dbe95530b2e3167b066)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:07.526697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0e0a4-69b5-41d4-b137-e2cc0d48ce2a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:07.664572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08a0e0a4-69b5-41d4-b137-e2cc0d48ce2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3276a8871fa54dbe95530b2e3167b066'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:07.665739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08a0e0a4-69b5-41d4-b137-e2cc0d48ce2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3276a8871fa54dbe95530b2e3167b066'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:07.683856 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08a0e0a4-69b5-41d4-b137-e2cc0d48ce2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3276a8871fa54dbe95530b2e3167b066'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:07.710593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08a0e0a4-69b5-41d4-b137-e2cc0d48ce2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3276a8871fa54dbe95530b2e3167b066'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:07.712467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08a0e0a4-69b5-41d4-b137-e2cc0d48ce2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3276a8871fa54dbe95530b2e3167b066'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:07.739456 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1054/2104] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:07 2022] DELETE /identity/v3/users/3276a8871fa54dbe95530b2e3167b066 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:08.077694 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e3f3a-12e8-4b6e-af57-70e14390b320 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:08.079285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-716e3f3a-12e8-4b6e-af57-70e14390b320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:08.104203 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e3f3a-12e8-4b6e-af57-70e14390b320 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:08.281314 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb176467-db97-4e44-8cf0-2008ca285216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:08.281991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb176467-db97-4e44-8cf0-2008ca285216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:08.282275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb176467-db97-4e44-8cf0-2008ca285216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:08.282544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb176467-db97-4e44-8cf0-2008ca285216 admin admin] PATH_INFO: `/v3/projects/6ebb25f4bae3498ea56f1e5caef71be9` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:08.286858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb176467-db97-4e44-8cf0-2008ca285216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ebb25f4bae3498ea56f1e5caef71be9)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:08.288154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb176467-db97-4e44-8cf0-2008ca285216 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:08.292911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:08.438301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bb176467-db97-4e44-8cf0-2008ca285216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ebb25f4bae3498ea56f1e5caef71be9', 'request_id': 'req-bb176467-db97-4e44-8cf0-2008ca285216'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:08.461923 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bb176467-db97-4e44-8cf0-2008ca285216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ebb25f4bae3498ea56f1e5caef71be9', 'request_id': 'req-bb176467-db97-4e44-8cf0-2008ca285216'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:08.473699 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bb176467-db97-4e44-8cf0-2008ca285216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ebb25f4bae3498ea56f1e5caef71be9', 'request_id': 'req-bb176467-db97-4e44-8cf0-2008ca285216'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:08.525561 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bb176467-db97-4e44-8cf0-2008ca285216 admin admin] The token cache is being invalidate because project 6ebb25f4bae3498ea56f1e5caef71be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:08.525561 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bb176467-db97-4e44-8cf0-2008ca285216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:08.537236 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bb176467-db97-4e44-8cf0-2008ca285216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:08.539603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1051/2105] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:08 2022] DELETE /identity/v3/projects/6ebb25f4bae3498ea56f1e5caef71be9 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:08.544764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc007ca3-4918-4faf-87ed-b9a9a81dbdfb None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:08.546586 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc007ca3-4918-4faf-87ed-b9a9a81dbdfb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:08.547507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc007ca3-4918-4faf-87ed-b9a9a81dbdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:08.583657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cc007ca3-4918-4faf-87ed-b9a9a81dbdfb None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:08.585393 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cc007ca3-4918-4faf-87ed-b9a9a81dbdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:08.616490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:08.730642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1055/2106] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:08.738917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be40d8-a55d-4d2b-adbd-f3076dfa7715 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:08.739309 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be40d8-a55d-4d2b-adbd-f3076dfa7715 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:08.739783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be40d8-a55d-4d2b-adbd-f3076dfa7715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:08.776870 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-d3be40d8-a55d-4d2b-adbd-f3076dfa7715 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:08.778208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d3be40d8-a55d-4d2b-adbd-f3076dfa7715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:08.793729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc007ca3-4918-4faf-87ed-b9a9a81dbdfb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:08.794508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1052/2107] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:08.811099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc007ca3-4918-4faf-87ed-b9a9a81dbdfb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:08.824814 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f114a1-ba09-4a7f-984f-be0dc7cb4460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:08.825811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f114a1-ba09-4a7f-984f-be0dc7cb4460 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:08.827424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f114a1-ba09-4a7f-984f-be0dc7cb4460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:08.827932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f114a1-ba09-4a7f-984f-be0dc7cb4460 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:08.829784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f114a1-ba09-4a7f-984f-be0dc7cb4460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:08.829916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f114a1-ba09-4a7f-984f-be0dc7cb4460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:08.831804 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f114a1-ba09-4a7f-984f-be0dc7cb4460 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:08.852759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1056/2108] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:08.857795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be40d8-a55d-4d2b-adbd-f3076dfa7715 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:08.872461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be40d8-a55d-4d2b-adbd-f3076dfa7715 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:08.878787 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa2f7e-c81f-4169-a148-d0e72f1f1e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:08.879795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa2f7e-c81f-4169-a148-d0e72f1f1e27 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:08.880151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa2f7e-c81f-4169-a148-d0e72f1f1e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:08.880423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa2f7e-c81f-4169-a148-d0e72f1f1e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:08.881134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa2f7e-c81f-4169-a148-d0e72f1f1e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:08.883127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa2f7e-c81f-4169-a148-d0e72f1f1e27 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:08.930423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1053/2109] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:08 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:08.930799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f114a1-ba09-4a7f-984f-be0dc7cb4460 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:08.942258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f114a1-ba09-4a7f-984f-be0dc7cb4460 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:09.030132 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3520e-2587-4afd-921b-7e10ffe123d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:09.031237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3520e-2587-4afd-921b-7e10ffe123d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:09.031771 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3520e-2587-4afd-921b-7e10ffe123d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:09.032170 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3520e-2587-4afd-921b-7e10ffe123d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:09.032915 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3520e-2587-4afd-921b-7e10ffe123d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:09.034981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3520e-2587-4afd-921b-7e10ffe123d4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:09.072284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1057/2110] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:08 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:09.076581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa2f7e-c81f-4169-a148-d0e72f1f1e27 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:09.090868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa2f7e-c81f-4169-a148-d0e72f1f1e27 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:09.100504 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093ca36-6164-4c5c-86b0-29f318283fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:09.101481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093ca36-6164-4c5c-86b0-29f318283fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:09.101940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093ca36-6164-4c5c-86b0-29f318283fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:09.103769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093ca36-6164-4c5c-86b0-29f318283fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:09.103769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093ca36-6164-4c5c-86b0-29f318283fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:09.114936 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093ca36-6164-4c5c-86b0-29f318283fe6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:09.129825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1054/2111] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:09.140106 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3520e-2587-4afd-921b-7e10ffe123d4 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:09.164402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3520e-2587-4afd-921b-7e10ffe123d4 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:09.179975 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fd9ca-7531-4107-a271-5b3383862a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:09.181427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fd9ca-7531-4107-a271-5b3383862a72 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:09.181670 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fd9ca-7531-4107-a271-5b3383862a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:09.182367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fd9ca-7531-4107-a271-5b3383862a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:09.183256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fd9ca-7531-4107-a271-5b3383862a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:09.185499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fd9ca-7531-4107-a271-5b3383862a72 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:09.215116 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1058/2112] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:09.218803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093ca36-6164-4c5c-86b0-29f318283fe6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:09.233606 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093ca36-6164-4c5c-86b0-29f318283fe6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:09.252068 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3682d-7f05-4db6-893e-b4cbf01dda49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:09.252759 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3682d-7f05-4db6-893e-b4cbf01dda49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:09.253090 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3682d-7f05-4db6-893e-b4cbf01dda49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:09.253375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3682d-7f05-4db6-893e-b4cbf01dda49 admin admin] PATH_INFO: `/v3/projects/2095bb6e65044d99adad712beeef67b1/users/3cbc58abb24d45a699c61d10080ba52d/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:09.290631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3682d-7f05-4db6-893e-b4cbf01dda49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2095bb6e65044d99adad712beeef67b1, user_id=3cbc58abb24d45a699c61d10080ba52d, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:09.293398 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3682d-7f05-4db6-893e-b4cbf01dda49 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:09.309782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1055/2113] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:09 2022] PUT /identity/v3/projects/2095bb6e65044d99adad712beeef67b1/users/3cbc58abb24d45a699c61d10080ba52d/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:09.321749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76966407-01b2-4a7c-9655-6013cf9adf82 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:09.322343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76966407-01b2-4a7c-9655-6013cf9adf82 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:09.322824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76966407-01b2-4a7c-9655-6013cf9adf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:09.362524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-76966407-01b2-4a7c-9655-6013cf9adf82 None None] MFA Rules not processed for user `3cbc58abb24d45a699c61d10080ba52d`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:09.364487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-76966407-01b2-4a7c-9655-6013cf9adf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:09.466427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1059/2114] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:09.472093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3682d-7f05-4db6-893e-b4cbf01dda49 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:09.538692 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3682d-7f05-4db6-893e-b4cbf01dda49 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:09.543580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7f0ee-0c9e-48a4-9f39-4b47c3fdd9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:09.544239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7f0ee-0c9e-48a4-9f39-4b47c3fdd9ff admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:09.544520 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7f0ee-0c9e-48a4-9f39-4b47c3fdd9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:09.544792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7f0ee-0c9e-48a4-9f39-4b47c3fdd9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:09.545478 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7f0ee-0c9e-48a4-9f39-4b47c3fdd9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:09.547418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7f0ee-0c9e-48a4-9f39-4b47c3fdd9ff admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:09.578152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1056/2115] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:09 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:09.581811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76966407-01b2-4a7c-9655-6013cf9adf82 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:09.593977 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76966407-01b2-4a7c-9655-6013cf9adf82 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:09.604019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:09.653384 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea207c3b-07e6-4543-8822-83c30f22d2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:09.653984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea207c3b-07e6-4543-8822-83c30f22d2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:09.654259 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea207c3b-07e6-4543-8822-83c30f22d2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:09.654531 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea207c3b-07e6-4543-8822-83c30f22d2c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:09.655301 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea207c3b-07e6-4543-8822-83c30f22d2c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:09.657199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea207c3b-07e6-4543-8822-83c30f22d2c5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:09.682567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1060/2116] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:09 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:09.683853 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7f0ee-0c9e-48a4-9f39-4b47c3fdd9ff admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:09.694746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7f0ee-0c9e-48a4-9f39-4b47c3fdd9ff admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:09.699660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5936b2e-3511-4e99-bbe1-40d57c6f9b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:09.700276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5936b2e-3511-4e99-bbe1-40d57c6f9b08 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:09.700559 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5936b2e-3511-4e99-bbe1-40d57c6f9b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:09.700837 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5936b2e-3511-4e99-bbe1-40d57c6f9b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:09.701481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5936b2e-3511-4e99-bbe1-40d57c6f9b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:09.703107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5936b2e-3511-4e99-bbe1-40d57c6f9b08 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:09.714691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1057/2117] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:09.718808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea207c3b-07e6-4543-8822-83c30f22d2c5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:09.730246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea207c3b-07e6-4543-8822-83c30f22d2c5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:09.735889 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e15a9-0a5e-497f-87c4-e44b3c2ef3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:09.736762 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e15a9-0a5e-497f-87c4-e44b3c2ef3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:09.737047 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e15a9-0a5e-497f-87c4-e44b3c2ef3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:09.737322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e15a9-0a5e-497f-87c4-e44b3c2ef3b2 admin admin] PATH_INFO: `/v3/projects/d53c8f39ae8b430290166213ef56e748/users/6f494ecdf1ee40eeb10ccd28fc7b0dcf/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:09.753650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e15a9-0a5e-497f-87c4-e44b3c2ef3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53c8f39ae8b430290166213ef56e748, user_id=6f494ecdf1ee40eeb10ccd28fc7b0dcf, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:09.756915 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e15a9-0a5e-497f-87c4-e44b3c2ef3b2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:09.771967 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1061/2118] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:09 2022] PUT /identity/v3/projects/d53c8f39ae8b430290166213ef56e748/users/6f494ecdf1ee40eeb10ccd28fc7b0dcf/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:09.776079 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5936b2e-3511-4e99-bbe1-40d57c6f9b08 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:09.781312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:09.787660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5936b2e-3511-4e99-bbe1-40d57c6f9b08 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:09.859228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783e8ed-0e09-4b8c-82f7-8d0e0fd4ca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:09.859743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e8ed-0e09-4b8c-82f7-8d0e0fd4ca07 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:09.860033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e8ed-0e09-4b8c-82f7-8d0e0fd4ca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:09.860453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e8ed-0e09-4b8c-82f7-8d0e0fd4ca07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:09.861057 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783e8ed-0e09-4b8c-82f7-8d0e0fd4ca07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:09.862689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783e8ed-0e09-4b8c-82f7-8d0e0fd4ca07 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:09.875286 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1058/2119] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:09.878704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e15a9-0a5e-497f-87c4-e44b3c2ef3b2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:09.891462 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e15a9-0a5e-497f-87c4-e44b3c2ef3b2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:09.901096 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa6f26-20a8-435e-8074-052e30ca88c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:09.901096 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa6f26-20a8-435e-8074-052e30ca88c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:09.902393 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa6f26-20a8-435e-8074-052e30ca88c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:09.902643 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa6f26-20a8-435e-8074-052e30ca88c0 admin admin] PATH_INFO: `/v3/projects/d53c8f39ae8b430290166213ef56e748/users/6f494ecdf1ee40eeb10ccd28fc7b0dcf/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:09.905330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa6f26-20a8-435e-8074-052e30ca88c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53c8f39ae8b430290166213ef56e748, user_id=6f494ecdf1ee40eeb10ccd28fc7b0dcf, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:09.908735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa6f26-20a8-435e-8074-052e30ca88c0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:09.929688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1062/2120] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:09 2022] PUT /identity/v3/projects/d53c8f39ae8b430290166213ef56e748/users/6f494ecdf1ee40eeb10ccd28fc7b0dcf/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:09.940490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378cb03-122e-4152-9c9b-12640bbef0de None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:09.940830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378cb03-122e-4152-9c9b-12640bbef0de None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:09.941204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378cb03-122e-4152-9c9b-12640bbef0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:09.981561 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6378cb03-122e-4152-9c9b-12640bbef0de None None] MFA Rules not processed for user `6f494ecdf1ee40eeb10ccd28fc7b0dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:09.983102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6378cb03-122e-4152-9c9b-12640bbef0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:10.061471 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1059/2121] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:10.072744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa6f26-20a8-435e-8074-052e30ca88c0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:10.074428 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6efa6f26-20a8-435e-8074-052e30ca88c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:10.137100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa6f26-20a8-435e-8074-052e30ca88c0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:10.140883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf138e5-7ec8-449d-95d2-750a79b9d59e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:10.141831 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf138e5-7ec8-449d-95d2-750a79b9d59e service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:10.142130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf138e5-7ec8-449d-95d2-750a79b9d59e service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:10.142404 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf138e5-7ec8-449d-95d2-750a79b9d59e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:10.154990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf138e5-7ec8-449d-95d2-750a79b9d59e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:10.156520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf138e5-7ec8-449d-95d2-750a79b9d59e service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:10.168089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1063/2122] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:10.282743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378cb03-122e-4152-9c9b-12640bbef0de None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:10.293842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378cb03-122e-4152-9c9b-12640bbef0de None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:10.297555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d89b05-f710-4e0c-802f-fb722e1ac334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:10.298168 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d89b05-f710-4e0c-802f-fb722e1ac334 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:10.298447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d89b05-f710-4e0c-802f-fb722e1ac334 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:10.298720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d89b05-f710-4e0c-802f-fb722e1ac334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:10.390993 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d89b05-f710-4e0c-802f-fb722e1ac334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:10.392494 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d89b05-f710-4e0c-802f-fb722e1ac334 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:10.403396 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1060/2123] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:11.901293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf138e5-7ec8-449d-95d2-750a79b9d59e service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:11.902843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fbf138e5-7ec8-449d-95d2-750a79b9d59e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:12.088514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf138e5-7ec8-449d-95d2-750a79b9d59e service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:12.094243 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761fee8-c379-45d6-aca8-402d4a9a438c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:12.095587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761fee8-c379-45d6-aca8-402d4a9a438c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:12.096092 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761fee8-c379-45d6-aca8-402d4a9a438c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:12.103840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761fee8-c379-45d6-aca8-402d4a9a438c admin admin] PATH_INFO: `/v3/users/caa6a0459a2e43298efe1bb3174f91c2` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:12.105892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761fee8-c379-45d6-aca8-402d4a9a438c admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa6a0459a2e43298efe1bb3174f91c2)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:12.108725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761fee8-c379-45d6-aca8-402d4a9a438c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:12.122561 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:12.232609 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b761fee8-c379-45d6-aca8-402d4a9a438c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa6a0459a2e43298efe1bb3174f91c2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:12.233864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b761fee8-c379-45d6-aca8-402d4a9a438c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa6a0459a2e43298efe1bb3174f91c2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:12.255766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b761fee8-c379-45d6-aca8-402d4a9a438c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa6a0459a2e43298efe1bb3174f91c2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:12.298211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b761fee8-c379-45d6-aca8-402d4a9a438c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa6a0459a2e43298efe1bb3174f91c2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:12.299296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b761fee8-c379-45d6-aca8-402d4a9a438c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa6a0459a2e43298efe1bb3174f91c2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:12.327548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1064/2124] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:11 2022] DELETE /identity/v3/users/caa6a0459a2e43298efe1bb3174f91c2 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:12.333593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c236442-2f43-4ea7-9044-971989de5572 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:12.334307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c236442-2f43-4ea7-9044-971989de5572 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:12.334487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c236442-2f43-4ea7-9044-971989de5572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:12.389777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0c236442-2f43-4ea7-9044-971989de5572 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:12.392666 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0c236442-2f43-4ea7-9044-971989de5572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:12.463566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:12.593868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1061/2125] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:12.627191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761fee8-c379-45d6-aca8-402d4a9a438c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:12.630825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b761fee8-c379-45d6-aca8-402d4a9a438c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:12.797585 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761fee8-c379-45d6-aca8-402d4a9a438c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:12.803241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693541d-6a19-44b0-914d-8982675adaf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:12.804715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693541d-6a19-44b0-914d-8982675adaf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:12.805294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693541d-6a19-44b0-914d-8982675adaf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:12.805928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693541d-6a19-44b0-914d-8982675adaf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:12.828537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693541d-6a19-44b0-914d-8982675adaf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:12.830437 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693541d-6a19-44b0-914d-8982675adaf1 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:12.850130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1065/2126] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:13.525598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c236442-2f43-4ea7-9044-971989de5572 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:13.527058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0c236442-2f43-4ea7-9044-971989de5572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:13.540502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c236442-2f43-4ea7-9044-971989de5572 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:13.545596 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca281330-c081-4185-8dd5-38b0db831e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:13.546333 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca281330-c081-4185-8dd5-38b0db831e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:13.546690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca281330-c081-4185-8dd5-38b0db831e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:13.546965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca281330-c081-4185-8dd5-38b0db831e3e admin admin] PATH_INFO: `/v3/users/3cbc58abb24d45a699c61d10080ba52d` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:13.548227 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca281330-c081-4185-8dd5-38b0db831e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cbc58abb24d45a699c61d10080ba52d)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:13.550243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca281330-c081-4185-8dd5-38b0db831e3e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:13.604393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ca281330-c081-4185-8dd5-38b0db831e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cbc58abb24d45a699c61d10080ba52d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:13.605149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ca281330-c081-4185-8dd5-38b0db831e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cbc58abb24d45a699c61d10080ba52d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:13.614195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ca281330-c081-4185-8dd5-38b0db831e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cbc58abb24d45a699c61d10080ba52d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:13.628415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ca281330-c081-4185-8dd5-38b0db831e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cbc58abb24d45a699c61d10080ba52d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:13.629925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ca281330-c081-4185-8dd5-38b0db831e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cbc58abb24d45a699c61d10080ba52d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:13.643827 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1062/2127] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:13 2022] DELETE /identity/v3/users/3cbc58abb24d45a699c61d10080ba52d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:13.649048 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016fee1-0c83-4977-9e89-89f3e970fb67 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:13.649550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016fee1-0c83-4977-9e89-89f3e970fb67 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:13.649639 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016fee1-0c83-4977-9e89-89f3e970fb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:13.669970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f016fee1-0c83-4977-9e89-89f3e970fb67 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:13.671510 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f016fee1-0c83-4977-9e89-89f3e970fb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:13.733922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca281330-c081-4185-8dd5-38b0db831e3e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:13.735933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ca281330-c081-4185-8dd5-38b0db831e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:13.782201 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1066/2128] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:13.804529 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016fee1-0c83-4977-9e89-89f3e970fb67 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:13.806719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f016fee1-0c83-4977-9e89-89f3e970fb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:13.858172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:13.908987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca281330-c081-4185-8dd5-38b0db831e3e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:13.915399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016fee1-0c83-4977-9e89-89f3e970fb67 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:13.915547 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e4238-b1cb-4720-ba65-67a61083c883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:13.916153 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e4238-b1cb-4720-ba65-67a61083c883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:13.916434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e4238-b1cb-4720-ba65-67a61083c883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:13.916709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e4238-b1cb-4720-ba65-67a61083c883 admin admin] PATH_INFO: `/v3/projects/9bf7b0ee045d452fbe95966be044f664` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:13.917862 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e4238-b1cb-4720-ba65-67a61083c883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf7b0ee045d452fbe95966be044f664)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:13.927370 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e4238-b1cb-4720-ba65-67a61083c883 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:13.927772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcdb60-2b2c-4a46-aea2-6ffcfa85520d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:13.931718 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcdb60-2b2c-4a46-aea2-6ffcfa85520d service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:13.932270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcdb60-2b2c-4a46-aea2-6ffcfa85520d service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:13.932798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcdb60-2b2c-4a46-aea2-6ffcfa85520d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:13.959631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcdb60-2b2c-4a46-aea2-6ffcfa85520d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:13.961184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcdb60-2b2c-4a46-aea2-6ffcfa85520d service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:13.980855 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:13.983101 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1067/2129] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:14.010519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d38e4238-b1cb-4720-ba65-67a61083c883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf7b0ee045d452fbe95966be044f664', 'request_id': 'req-d38e4238-b1cb-4720-ba65-67a61083c883'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.025519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d38e4238-b1cb-4720-ba65-67a61083c883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf7b0ee045d452fbe95966be044f664', 'request_id': 'req-d38e4238-b1cb-4720-ba65-67a61083c883'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.032919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d38e4238-b1cb-4720-ba65-67a61083c883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf7b0ee045d452fbe95966be044f664', 'request_id': 'req-d38e4238-b1cb-4720-ba65-67a61083c883'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.059208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d38e4238-b1cb-4720-ba65-67a61083c883 admin admin] The token cache is being invalidate because project 9bf7b0ee045d452fbe95966be044f664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:14.059401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d38e4238-b1cb-4720-ba65-67a61083c883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.060041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d38e4238-b1cb-4720-ba65-67a61083c883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.062167 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1063/2130] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:13 2022] DELETE /identity/v3/projects/9bf7b0ee045d452fbe95966be044f664 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:14.067450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3412c3b-9ff1-4dbd-b5c6-9341aced2431 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:14.067745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3412c3b-9ff1-4dbd-b5c6-9341aced2431 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:14.068028 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3412c3b-9ff1-4dbd-b5c6-9341aced2431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:14.097670 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f3412c3b-9ff1-4dbd-b5c6-9341aced2431 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:14.101495 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f3412c3b-9ff1-4dbd-b5c6-9341aced2431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:14.233041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1068/2131] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:14.237448 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519a9c6-67cf-4bda-bb8e-dbf3e4b8883a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:14.237746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519a9c6-67cf-4bda-bb8e-dbf3e4b8883a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:14.238026 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519a9c6-67cf-4bda-bb8e-dbf3e4b8883a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:14.270584 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2519a9c6-67cf-4bda-bb8e-dbf3e4b8883a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:14.273765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2519a9c6-67cf-4bda-bb8e-dbf3e4b8883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:14.293167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3412c3b-9ff1-4dbd-b5c6-9341aced2431 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:14.311783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1064/2132] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:14.313383 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3412c3b-9ff1-4dbd-b5c6-9341aced2431 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:14.321308 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a2eb6-377b-4361-b83a-71d8a583d500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:14.322336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a2eb6-377b-4361-b83a-71d8a583d500 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:14.322825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a2eb6-377b-4361-b83a-71d8a583d500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:14.323140 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a2eb6-377b-4361-b83a-71d8a583d500 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:14.324283 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a2eb6-377b-4361-b83a-71d8a583d500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:14.324647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a2eb6-377b-4361-b83a-71d8a583d500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:14.326615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a2eb6-377b-4361-b83a-71d8a583d500 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:14.353641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519a9c6-67cf-4bda-bb8e-dbf3e4b8883a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:14.366900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1069/2133] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:14.375400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519a9c6-67cf-4bda-bb8e-dbf3e4b8883a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:14.388700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007af41-54af-4d09-ba3b-de7768069786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:14.389667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007af41-54af-4d09-ba3b-de7768069786 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:14.389952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007af41-54af-4d09-ba3b-de7768069786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:14.390668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007af41-54af-4d09-ba3b-de7768069786 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:14.391758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007af41-54af-4d09-ba3b-de7768069786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:14.395274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007af41-54af-4d09-ba3b-de7768069786 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:14.464480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a2eb6-377b-4361-b83a-71d8a583d500 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:14.474643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1065/2134] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:14 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:14.481995 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a2eb6-377b-4361-b83a-71d8a583d500 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:14.589986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79eaea-7000-4609-8138-85237c9cfce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:14.590628 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79eaea-7000-4609-8138-85237c9cfce0 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:14.590905 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79eaea-7000-4609-8138-85237c9cfce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:14.591582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79eaea-7000-4609-8138-85237c9cfce0 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:14.592308 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79eaea-7000-4609-8138-85237c9cfce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:14.594408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79eaea-7000-4609-8138-85237c9cfce0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:14.632130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1070/2135] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:14 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:14.636097 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007af41-54af-4d09-ba3b-de7768069786 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:14.653608 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007af41-54af-4d09-ba3b-de7768069786 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:14.657172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79eaea-7000-4609-8138-85237c9cfce0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:14.660049 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6b79eaea-7000-4609-8138-85237c9cfce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:14.672048 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc2200-217c-4039-9541-878117344a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:14.672702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc2200-217c-4039-9541-878117344a27 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:14.672987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc2200-217c-4039-9541-878117344a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:14.673260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc2200-217c-4039-9541-878117344a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:14.673922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc2200-217c-4039-9541-878117344a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:14.677143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc2200-217c-4039-9541-878117344a27 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:14.681237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79eaea-7000-4609-8138-85237c9cfce0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:14.695213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1ff7d-5247-49b1-858d-434d1bc69293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:14.695849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1ff7d-5247-49b1-858d-434d1bc69293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:14.696133 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1ff7d-5247-49b1-858d-434d1bc69293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:14.696412 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1ff7d-5247-49b1-858d-434d1bc69293 admin admin] PATH_INFO: `/v3/users/fbabad98b3d74e089e409b42bbeacd36` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:14.697699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1ff7d-5247-49b1-858d-434d1bc69293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbabad98b3d74e089e409b42bbeacd36)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:14.699663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1ff7d-5247-49b1-858d-434d1bc69293 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:14.704845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1066/2136] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:14.705779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc2200-217c-4039-9541-878117344a27 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:14.709021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1cbc2200-217c-4039-9541-878117344a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:14.732189 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc2200-217c-4039-9541-878117344a27 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:14.737053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45e871-38ee-4d49-91e2-f7a498bbe1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:14.737705 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45e871-38ee-4d49-91e2-f7a498bbe1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:14.737975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45e871-38ee-4d49-91e2-f7a498bbe1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:14.738809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45e871-38ee-4d49-91e2-f7a498bbe1ff admin admin] PATH_INFO: `/v3/projects/2095bb6e65044d99adad712beeef67b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:14.740059 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45e871-38ee-4d49-91e2-f7a498bbe1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2095bb6e65044d99adad712beeef67b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:14.741962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45e871-38ee-4d49-91e2-f7a498bbe1ff admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:14.755273 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:14.757302 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8bf1ff7d-5247-49b1-858d-434d1bc69293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbabad98b3d74e089e409b42bbeacd36'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.758335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8bf1ff7d-5247-49b1-858d-434d1bc69293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbabad98b3d74e089e409b42bbeacd36'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.768232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8bf1ff7d-5247-49b1-858d-434d1bc69293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbabad98b3d74e089e409b42bbeacd36'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.783091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8bf1ff7d-5247-49b1-858d-434d1bc69293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbabad98b3d74e089e409b42bbeacd36'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.783840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8bf1ff7d-5247-49b1-858d-434d1bc69293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbabad98b3d74e089e409b42bbeacd36'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.798136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1071/2137] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:14 2022] DELETE /identity/v3/users/fbabad98b3d74e089e409b42bbeacd36 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:14.799534 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1ff7d-5247-49b1-858d-434d1bc69293 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:14.804123 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8bf1ff7d-5247-49b1-858d-434d1bc69293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:14.805940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4b45e871-38ee-4d49-91e2-f7a498bbe1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2095bb6e65044d99adad712beeef67b1', 'request_id': 'req-4b45e871-38ee-4d49-91e2-f7a498bbe1ff'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.814861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4b45e871-38ee-4d49-91e2-f7a498bbe1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2095bb6e65044d99adad712beeef67b1', 'request_id': 'req-4b45e871-38ee-4d49-91e2-f7a498bbe1ff'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.824887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4b45e871-38ee-4d49-91e2-f7a498bbe1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2095bb6e65044d99adad712beeef67b1', 'request_id': 'req-4b45e871-38ee-4d49-91e2-f7a498bbe1ff'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.840036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4b45e871-38ee-4d49-91e2-f7a498bbe1ff admin admin] The token cache is being invalidate because project 2095bb6e65044d99adad712beeef67b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:14.840684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4b45e871-38ee-4d49-91e2-f7a498bbe1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.841520 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4b45e871-38ee-4d49-91e2-f7a498bbe1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.844110 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1067/2138] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:14 2022] DELETE /identity/v3/projects/2095bb6e65044d99adad712beeef67b1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:14.845942 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf056980-3e8c-4674-9212-cabea0430564 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:14.845942 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf056980-3e8c-4674-9212-cabea0430564 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:14.845942 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf056980-3e8c-4674-9212-cabea0430564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:14.871060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bf056980-3e8c-4674-9212-cabea0430564 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:14.872963 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bf056980-3e8c-4674-9212-cabea0430564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:14.884630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1068/2139] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:14.884806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1ff7d-5247-49b1-858d-434d1bc69293 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:14.884943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf056980-3e8c-4674-9212-cabea0430564 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:14.886318 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bf056980-3e8c-4674-9212-cabea0430564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:14.892240 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb0f2a-874a-405c-a444-cdfe02cae9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:14.893973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb0f2a-874a-405c-a444-cdfe02cae9da admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:14.895434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb0f2a-874a-405c-a444-cdfe02cae9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:14.896056 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb0f2a-874a-405c-a444-cdfe02cae9da admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:14.896766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb0f2a-874a-405c-a444-cdfe02cae9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:14.898416 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb0f2a-874a-405c-a444-cdfe02cae9da admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:14.899331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf056980-3e8c-4674-9212-cabea0430564 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:14.905399 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e68c7e-a465-44f5-bd1e-62998e57cee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:14.906395 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e68c7e-a465-44f5-bd1e-62998e57cee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:14.906750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e68c7e-a465-44f5-bd1e-62998e57cee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:14.907129 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e68c7e-a465-44f5-bd1e-62998e57cee4 admin admin] PATH_INFO: `/v3/users/6f494ecdf1ee40eeb10ccd28fc7b0dcf` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:14.908357 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e68c7e-a465-44f5-bd1e-62998e57cee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f494ecdf1ee40eeb10ccd28fc7b0dcf)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:14.909284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1072/2140] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:14.911304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e03e2-a91d-4814-b9e0-df7e3a3d6183 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:14.911533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e03e2-a91d-4814-b9e0-df7e3a3d6183 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:14.911806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e03e2-a91d-4814-b9e0-df7e3a3d6183 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:14.913379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1073/2141] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 13 01:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:20:14.913949 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e03e2-a91d-4814-b9e0-df7e3a3d6183 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:14.914558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e68c7e-a465-44f5-bd1e-62998e57cee4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:14.915642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-814e03e2-a91d-4814-b9e0-df7e3a3d6183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:14.983776 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62e68c7e-a465-44f5-bd1e-62998e57cee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f494ecdf1ee40eeb10ccd28fc7b0dcf'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.984476 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62e68c7e-a465-44f5-bd1e-62998e57cee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f494ecdf1ee40eeb10ccd28fc7b0dcf'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.992019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62e68c7e-a465-44f5-bd1e-62998e57cee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f494ecdf1ee40eeb10ccd28fc7b0dcf'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:14.993902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=79,keystone:DELETE=18,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:14.997397 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e03e2-a91d-4814-b9e0-df7e3a3d6183 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:15.002226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e27424-2172-4fe5-a60b-319d70b9b85d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:15.002840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e27424-2172-4fe5-a60b-319d70b9b85d service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:15.003157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e27424-2172-4fe5-a60b-319d70b9b85d service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:15.003440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e27424-2172-4fe5-a60b-319d70b9b85d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:15.005935 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b6e27424-2172-4fe5-a60b-319d70b9b85d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:15.008185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62e68c7e-a465-44f5-bd1e-62998e57cee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f494ecdf1ee40eeb10ccd28fc7b0dcf'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.008987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62e68c7e-a465-44f5-bd1e-62998e57cee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f494ecdf1ee40eeb10ccd28fc7b0dcf'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.023292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1069/2142] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:14 2022] DELETE /identity/v3/users/6f494ecdf1ee40eeb10ccd28fc7b0dcf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:15.023545 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e27424-2172-4fe5-a60b-319d70b9b85d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:15.024322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e68c7e-a465-44f5-bd1e-62998e57cee4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:15.024985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e27424-2172-4fe5-a60b-319d70b9b85d service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:15.025739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-62e68c7e-a465-44f5-bd1e-62998e57cee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:15.035624 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1074/2143] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:15.036833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f0f02-65e4-4e68-b1e4-3ec2bb5fb3f5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:15.037137 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f0f02-65e4-4e68-b1e4-3ec2bb5fb3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:15.037409 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f0f02-65e4-4e68-b1e4-3ec2bb5fb3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:15.058897 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fc0f0f02-65e4-4e68-b1e4-3ec2bb5fb3f5 None None] MFA Rules not processed for user `0c5e6dae854a44a0ad6628e7dd69dfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:15.060199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fc0f0f02-65e4-4e68-b1e4-3ec2bb5fb3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:15.117655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e68c7e-a465-44f5-bd1e-62998e57cee4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:15.122846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:15.127652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022efd4-e1ab-4942-b176-9bde0f88c887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:15.128594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022efd4-e1ab-4942-b176-9bde0f88c887 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:15.129074 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022efd4-e1ab-4942-b176-9bde0f88c887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:15.130184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022efd4-e1ab-4942-b176-9bde0f88c887 admin admin] PATH_INFO: `/v3/projects/c984c87febd8474082f0eb6e02000d3b/users/d2faa9cea8f14990877f342a490938ad/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:15.139176 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1075/2144] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 13 01:20:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:15.140137 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f0f02-65e4-4e68-b1e4-3ec2bb5fb3f5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:15.142705 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fc0f0f02-65e4-4e68-b1e4-3ec2bb5fb3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:15.162528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022efd4-e1ab-4942-b176-9bde0f88c887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c984c87febd8474082f0eb6e02000d3b, user_id=d2faa9cea8f14990877f342a490938ad, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:15.165948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f0f02-65e4-4e68-b1e4-3ec2bb5fb3f5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:15.167461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022efd4-e1ab-4942-b176-9bde0f88c887 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:15.172062 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e91c2b-09f0-4494-ae7e-b392f0fede62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:15.172657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91c2b-09f0-4494-ae7e-b392f0fede62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:15.173060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91c2b-09f0-4494-ae7e-b392f0fede62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:15.173309 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91c2b-09f0-4494-ae7e-b392f0fede62 admin admin] PATH_INFO: `/v3/users/9a0a16f3770a433f8ef98af2fbd4b1c7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:15.174652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e91c2b-09f0-4494-ae7e-b392f0fede62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0a16f3770a433f8ef98af2fbd4b1c7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:15.177874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e91c2b-09f0-4494-ae7e-b392f0fede62 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:15.188050 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1070/2145] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:15 2022] PUT /identity/v3/projects/c984c87febd8474082f0eb6e02000d3b/users/d2faa9cea8f14990877f342a490938ad/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:15.189228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022efd4-e1ab-4942-b176-9bde0f88c887 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:15.197814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a022efd4-e1ab-4942-b176-9bde0f88c887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:15.252256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-73e91c2b-09f0-4494-ae7e-b392f0fede62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0a16f3770a433f8ef98af2fbd4b1c7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.253005 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-73e91c2b-09f0-4494-ae7e-b392f0fede62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0a16f3770a433f8ef98af2fbd4b1c7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.266538 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-73e91c2b-09f0-4494-ae7e-b392f0fede62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0a16f3770a433f8ef98af2fbd4b1c7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.290418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022efd4-e1ab-4942-b176-9bde0f88c887 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:15.291709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-73e91c2b-09f0-4494-ae7e-b392f0fede62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0a16f3770a433f8ef98af2fbd4b1c7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.292584 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-73e91c2b-09f0-4494-ae7e-b392f0fede62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0a16f3770a433f8ef98af2fbd4b1c7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.302411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e7cac-5ab4-49b9-9176-d0bb514ddb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:15.303797 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e7cac-5ab4-49b9-9176-d0bb514ddb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:15.303797 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e7cac-5ab4-49b9-9176-d0bb514ddb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:15.303797 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e7cac-5ab4-49b9-9176-d0bb514ddb67 admin admin] PATH_INFO: `/v3/users/01c40b7a6c934d7581b86d09b4f226c9` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:15.305177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e7cac-5ab4-49b9-9176-d0bb514ddb67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01c40b7a6c934d7581b86d09b4f226c9)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:15.313558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e7cac-5ab4-49b9-9176-d0bb514ddb67 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:15.314066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1076/2146] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:15 2022] DELETE /identity/v3/users/9a0a16f3770a433f8ef98af2fbd4b1c7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:15.315150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e91c2b-09f0-4494-ae7e-b392f0fede62 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:15.317118 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-73e91c2b-09f0-4494-ae7e-b392f0fede62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:15.462535 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-446e7cac-5ab4-49b9-9176-d0bb514ddb67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c40b7a6c934d7581b86d09b4f226c9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.465381 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-446e7cac-5ab4-49b9-9176-d0bb514ddb67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c40b7a6c934d7581b86d09b4f226c9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.475684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e91c2b-09f0-4494-ae7e-b392f0fede62 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:15.476776 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-446e7cac-5ab4-49b9-9176-d0bb514ddb67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c40b7a6c934d7581b86d09b4f226c9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.479458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:15.481885 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740a76b-dabb-4f34-afa2-c066c35dd6e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c5e6dae854a44a0ad6628e7dd69dfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:15.482642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740a76b-dabb-4f34-afa2-c066c35dd6e7 service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:15.483054 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740a76b-dabb-4f34-afa2-c066c35dd6e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:15.483413 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740a76b-dabb-4f34-afa2-c066c35dd6e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:15.486246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2740a76b-dabb-4f34-afa2-c066c35dd6e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:15.498665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-446e7cac-5ab4-49b9-9176-d0bb514ddb67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c40b7a6c934d7581b86d09b4f226c9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.499658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-446e7cac-5ab4-49b9-9176-d0bb514ddb67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c40b7a6c934d7581b86d09b4f226c9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.513423 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740a76b-dabb-4f34-afa2-c066c35dd6e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:15.521446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740a76b-dabb-4f34-afa2-c066c35dd6e7 service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:15.525190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1071/2147] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:15 2022] DELETE /identity/v3/users/01c40b7a6c934d7581b86d09b4f226c9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:15.528649 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4910273-fb58-4de5-863c-dae97a66d93f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:15.528880 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4910273-fb58-4de5-863c-dae97a66d93f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:15.530561 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4910273-fb58-4de5-863c-dae97a66d93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:15.552760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1077/2148] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:15.555553 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53974e2b-7650-4fd4-8060-d5e11a1c7e00 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:15.555941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53974e2b-7650-4fd4-8060-d5e11a1c7e00 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:15.556231 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53974e2b-7650-4fd4-8060-d5e11a1c7e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:15.582618 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-53974e2b-7650-4fd4-8060-d5e11a1c7e00 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:15.584615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-53974e2b-7650-4fd4-8060-d5e11a1c7e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:15.627732 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a4910273-fb58-4de5-863c-dae97a66d93f None None] MFA Rules not processed for user `d2faa9cea8f14990877f342a490938ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:15.630611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a4910273-fb58-4de5-863c-dae97a66d93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:15.714378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:15.726938 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1078/2149] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:15.728258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53974e2b-7650-4fd4-8060-d5e11a1c7e00 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:15.730550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-53974e2b-7650-4fd4-8060-d5e11a1c7e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:15.744858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53974e2b-7650-4fd4-8060-d5e11a1c7e00 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:15.748357 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1072/2150] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:15.749748 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4910273-fb58-4de5-863c-dae97a66d93f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:15.751758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a4910273-fb58-4de5-863c-dae97a66d93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:15.760285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e6710-4f99-47a2-99e7-279feaeff10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:15.760877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e6710-4f99-47a2-99e7-279feaeff10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:15.763425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e6710-4f99-47a2-99e7-279feaeff10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:15.764031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e6710-4f99-47a2-99e7-279feaeff10c admin admin] PATH_INFO: `/v3/projects/06dfbafff70b46c696c9655707c23ddb` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:15.765726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e6710-4f99-47a2-99e7-279feaeff10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=06dfbafff70b46c696c9655707c23ddb)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:15.769238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e6710-4f99-47a2-99e7-279feaeff10c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:15.780320 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4910273-fb58-4de5-863c-dae97a66d93f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:15.789636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c367a-b4f3-4a1a-8b66-34b958881344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:15.790465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c367a-b4f3-4a1a-8b66-34b958881344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:15.790788 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c367a-b4f3-4a1a-8b66-34b958881344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:15.791056 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c367a-b4f3-4a1a-8b66-34b958881344 admin admin] PATH_INFO: `/v3/projects/03521b8926584e2a8eaef4c6ee5c614f` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:15.794427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c367a-b4f3-4a1a-8b66-34b958881344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03521b8926584e2a8eaef4c6ee5c614f)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:15.797505 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c367a-b4f3-4a1a-8b66-34b958881344 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:15.860274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5d4c367a-b4f3-4a1a-8b66-34b958881344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03521b8926584e2a8eaef4c6ee5c614f', 'request_id': 'req-5d4c367a-b4f3-4a1a-8b66-34b958881344'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.869140 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5d4c367a-b4f3-4a1a-8b66-34b958881344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03521b8926584e2a8eaef4c6ee5c614f', 'request_id': 'req-5d4c367a-b4f3-4a1a-8b66-34b958881344'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.885811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b54e6710-4f99-47a2-99e7-279feaeff10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06dfbafff70b46c696c9655707c23ddb', 'request_id': 'req-b54e6710-4f99-47a2-99e7-279feaeff10c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.888304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5d4c367a-b4f3-4a1a-8b66-34b958881344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03521b8926584e2a8eaef4c6ee5c614f', 'request_id': 'req-5d4c367a-b4f3-4a1a-8b66-34b958881344'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.898648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b54e6710-4f99-47a2-99e7-279feaeff10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06dfbafff70b46c696c9655707c23ddb', 'request_id': 'req-b54e6710-4f99-47a2-99e7-279feaeff10c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.906837 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5d4c367a-b4f3-4a1a-8b66-34b958881344 admin admin] The token cache is being invalidate because project 03521b8926584e2a8eaef4c6ee5c614f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:15.907237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5d4c367a-b4f3-4a1a-8b66-34b958881344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.907706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b54e6710-4f99-47a2-99e7-279feaeff10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06dfbafff70b46c696c9655707c23ddb', 'request_id': 'req-b54e6710-4f99-47a2-99e7-279feaeff10c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.908024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5d4c367a-b4f3-4a1a-8b66-34b958881344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.913528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1073/2151] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:15 2022] DELETE /identity/v3/projects/03521b8926584e2a8eaef4c6ee5c614f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:15.914506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c367a-b4f3-4a1a-8b66-34b958881344 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:15.915991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5d4c367a-b4f3-4a1a-8b66-34b958881344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:15.924715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b54e6710-4f99-47a2-99e7-279feaeff10c admin admin] The token cache is being invalidate because project 06dfbafff70b46c696c9655707c23ddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:15.925210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b54e6710-4f99-47a2-99e7-279feaeff10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.926941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b54e6710-4f99-47a2-99e7-279feaeff10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:15.931743 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1079/2152] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:15 2022] DELETE /identity/v3/projects/06dfbafff70b46c696c9655707c23ddb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:15.931743 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e6710-4f99-47a2-99e7-279feaeff10c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:15.932338 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b54e6710-4f99-47a2-99e7-279feaeff10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:15.984874 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:15.991283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c367a-b4f3-4a1a-8b66-34b958881344 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:16.003159 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e6710-4f99-47a2-99e7-279feaeff10c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:16.008573 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a845b-02a4-49d2-965d-56bb87695bf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:16.009735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a845b-02a4-49d2-965d-56bb87695bf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.010016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a845b-02a4-49d2-965d-56bb87695bf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.010290 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a845b-02a4-49d2-965d-56bb87695bf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.012069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d69a845b-02a4-49d2-965d-56bb87695bf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:16.060684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096500fc-018d-434f-ac6b-6665d5c93c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:16.061357 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096500fc-018d-434f-ac6b-6665d5c93c7b service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.061714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096500fc-018d-434f-ac6b-6665d5c93c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.062086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096500fc-018d-434f-ac6b-6665d5c93c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.064715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-096500fc-018d-434f-ac6b-6665d5c93c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:16.088067 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a845b-02a4-49d2-965d-56bb87695bf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:16.089560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a845b-02a4-49d2-965d-56bb87695bf2 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:16.099424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1080/2153] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:16.100144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a845b-02a4-49d2-965d-56bb87695bf2 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:16.101554 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d69a845b-02a4-49d2-965d-56bb87695bf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:16.151244 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:16.172108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096500fc-018d-434f-ac6b-6665d5c93c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:16.173565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096500fc-018d-434f-ac6b-6665d5c93c7b service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:16.186430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1074/2154] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:16.198147 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a845b-02a4-49d2-965d-56bb87695bf2 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:16.202359 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d883bb-66a2-4823-8050-32de524447fb None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.202826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d883bb-66a2-4823-8050-32de524447fb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.203317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d883bb-66a2-4823-8050-32de524447fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.204162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d72ce-72d6-487a-bb9f-d40efa9541cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:16.205102 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d72ce-72d6-487a-bb9f-d40efa9541cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.205392 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d72ce-72d6-487a-bb9f-d40efa9541cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.205673 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d72ce-72d6-487a-bb9f-d40efa9541cc admin admin] PATH_INFO: `/v3/projects/d53c8f39ae8b430290166213ef56e748` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.207645 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d72ce-72d6-487a-bb9f-d40efa9541cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d53c8f39ae8b430290166213ef56e748)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:16.211151 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d72ce-72d6-487a-bb9f-d40efa9541cc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:16.256361 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-12d883bb-66a2-4823-8050-32de524447fb None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:16.257693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-12d883bb-66a2-4823-8050-32de524447fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:16.277918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1075/2155] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:16.287857 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec54c9-23dc-4cae-8b85-4fee212b8371 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.288342 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec54c9-23dc-4cae-8b85-4fee212b8371 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.288620 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec54c9-23dc-4cae-8b85-4fee212b8371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.291319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-158d72ce-72d6-487a-bb9f-d40efa9541cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd53c8f39ae8b430290166213ef56e748', 'request_id': 'req-158d72ce-72d6-487a-bb9f-d40efa9541cc'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:16.303694 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-158d72ce-72d6-487a-bb9f-d40efa9541cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd53c8f39ae8b430290166213ef56e748', 'request_id': 'req-158d72ce-72d6-487a-bb9f-d40efa9541cc'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:16.311974 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-158d72ce-72d6-487a-bb9f-d40efa9541cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd53c8f39ae8b430290166213ef56e748', 'request_id': 'req-158d72ce-72d6-487a-bb9f-d40efa9541cc'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:16.313500 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e9ec54c9-23dc-4cae-8b85-4fee212b8371 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:16.315038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e9ec54c9-23dc-4cae-8b85-4fee212b8371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:16.323332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-158d72ce-72d6-487a-bb9f-d40efa9541cc admin admin] The token cache is being invalidate because project d53c8f39ae8b430290166213ef56e748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:16.324433 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-158d72ce-72d6-487a-bb9f-d40efa9541cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:16.325244 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-158d72ce-72d6-487a-bb9f-d40efa9541cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:16.327869 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1081/2156] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:16 2022] DELETE /identity/v3/projects/d53c8f39ae8b430290166213ef56e748 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:16.329284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dd398-c9eb-4c9b-839a-c441cca393dd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.329576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dd398-c9eb-4c9b-839a-c441cca393dd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.329962 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dd398-c9eb-4c9b-839a-c441cca393dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.356237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8d1dd398-c9eb-4c9b-839a-c441cca393dd None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:16.357481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8d1dd398-c9eb-4c9b-839a-c441cca393dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:16.409816 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1076/2157] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:16.412205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b76c9-64a2-4d23-8cd9-24663ca384e4 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.412473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b76c9-64a2-4d23-8cd9-24663ca384e4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.412764 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b76c9-64a2-4d23-8cd9-24663ca384e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.442605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a56b76c9-64a2-4d23-8cd9-24663ca384e4 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:16.443923 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a56b76c9-64a2-4d23-8cd9-24663ca384e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:16.449374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1082/2158] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:16.451341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52a6aa-bc8b-4a8c-9655-4b51250d26c2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.451851 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52a6aa-bc8b-4a8c-9655-4b51250d26c2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.452272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52a6aa-bc8b-4a8c-9655-4b51250d26c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.478143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1077/2159] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:16.478395 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6d52a6aa-bc8b-4a8c-9655-4b51250d26c2 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:16.478996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b76c9-64a2-4d23-8cd9-24663ca384e4 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:16.479931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6d52a6aa-bc8b-4a8c-9655-4b51250d26c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:16.492496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b76c9-64a2-4d23-8cd9-24663ca384e4 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:16.494229 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1083/2160] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:16.496116 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bce5f-30c0-4f7b-8ef3-655ca4a7c0b1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.496608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bce5f-30c0-4f7b-8ef3-655ca4a7c0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.497314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bce5f-30c0-4f7b-8ef3-655ca4a7c0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.497698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d34949-3794-4fe7-8f52-3e4b06c8c16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:16.498311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d34949-3794-4fe7-8f52-3e4b06c8c16b admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.498586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d34949-3794-4fe7-8f52-3e4b06c8c16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.498859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d34949-3794-4fe7-8f52-3e4b06c8c16b admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.499626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d34949-3794-4fe7-8f52-3e4b06c8c16b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:16.499933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d34949-3794-4fe7-8f52-3e4b06c8c16b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:16.501543 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d34949-3794-4fe7-8f52-3e4b06c8c16b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:16.515909 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1078/2161] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:16.516968 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d34949-3794-4fe7-8f52-3e4b06c8c16b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:16.528843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f51bce5f-30c0-4f7b-8ef3-655ca4a7c0b1 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:16.530053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d34949-3794-4fe7-8f52-3e4b06c8c16b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:16.530917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f51bce5f-30c0-4f7b-8ef3-655ca4a7c0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:16.536451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f0d3b-5fa5-47f0-ba59-484b65d555c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:16.537519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f0d3b-5fa5-47f0-ba59-484b65d555c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.537519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f0d3b-5fa5-47f0-ba59-484b65d555c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.538066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f0d3b-5fa5-47f0-ba59-484b65d555c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.538866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f0d3b-5fa5-47f0-ba59-484b65d555c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:16.539371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f0d3b-5fa5-47f0-ba59-484b65d555c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:16.541139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f0d3b-5fa5-47f0-ba59-484b65d555c7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:16.541716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1084/2162] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:16.542541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bce5f-30c0-4f7b-8ef3-655ca4a7c0b1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:16.560163 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1079/2163] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:16.560326 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bce5f-30c0-4f7b-8ef3-655ca4a7c0b1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:16.560416 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f0d3b-5fa5-47f0-ba59-484b65d555c7 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:16.564064 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eec30-5b0f-45b2-afc9-fc9a9a5e27bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:16.564946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eec30-5b0f-45b2-afc9-fc9a9a5e27bf admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.565228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eec30-5b0f-45b2-afc9-fc9a9a5e27bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.565696 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eec30-5b0f-45b2-afc9-fc9a9a5e27bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.567492 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2eec30-5b0f-45b2-afc9-fc9a9a5e27bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:16.569845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2eec30-5b0f-45b2-afc9-fc9a9a5e27bf admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:16.577649 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f0d3b-5fa5-47f0-ba59-484b65d555c7 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:16.589148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34131f1-e24b-41f2-8a76-82133cf4a446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:16.589887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34131f1-e24b-41f2-8a76-82133cf4a446 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.590158 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34131f1-e24b-41f2-8a76-82133cf4a446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.590465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34131f1-e24b-41f2-8a76-82133cf4a446 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.591300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34131f1-e24b-41f2-8a76-82133cf4a446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:16.591744 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34131f1-e24b-41f2-8a76-82133cf4a446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:16.593402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34131f1-e24b-41f2-8a76-82133cf4a446 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:16.609325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1080/2164] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:16.610228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34131f1-e24b-41f2-8a76-82133cf4a446 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:16.617094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:16.623919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34131f1-e24b-41f2-8a76-82133cf4a446 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:16.635251 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1085/2165] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:16 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:16.636481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eec30-5b0f-45b2-afc9-fc9a9a5e27bf admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:16.638709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fe2eec30-5b0f-45b2-afc9-fc9a9a5e27bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:16.675693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:16.702848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e95acf-fd39-44ad-bd6e-230a822e6623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:16.703498 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e95acf-fd39-44ad-bd6e-230a822e6623 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.703774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e95acf-fd39-44ad-bd6e-230a822e6623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.704045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e95acf-fd39-44ad-bd6e-230a822e6623 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.704699 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e95acf-fd39-44ad-bd6e-230a822e6623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:16.706590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e95acf-fd39-44ad-bd6e-230a822e6623 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:16.711037 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eec30-5b0f-45b2-afc9-fc9a9a5e27bf admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:16.716268 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00d9ea-a915-41ff-8abc-52d919857321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:16.716944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00d9ea-a915-41ff-8abc-52d919857321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.717230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00d9ea-a915-41ff-8abc-52d919857321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.717500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00d9ea-a915-41ff-8abc-52d919857321 admin admin] PATH_INFO: `/v3/projects/4c4e61217b46465c8eb2fdfe88f48ca0` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.718681 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00d9ea-a915-41ff-8abc-52d919857321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4e61217b46465c8eb2fdfe88f48ca0)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:16.720706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00d9ea-a915-41ff-8abc-52d919857321 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:16.735841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1081/2166] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:16 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:16.736735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e95acf-fd39-44ad-bd6e-230a822e6623 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:16.774314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff00d9ea-a915-41ff-8abc-52d919857321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4e61217b46465c8eb2fdfe88f48ca0', 'request_id': 'req-ff00d9ea-a915-41ff-8abc-52d919857321'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:16.782341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff00d9ea-a915-41ff-8abc-52d919857321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4e61217b46465c8eb2fdfe88f48ca0', 'request_id': 'req-ff00d9ea-a915-41ff-8abc-52d919857321'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:16.789458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff00d9ea-a915-41ff-8abc-52d919857321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4e61217b46465c8eb2fdfe88f48ca0', 'request_id': 'req-ff00d9ea-a915-41ff-8abc-52d919857321'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:16.799816 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff00d9ea-a915-41ff-8abc-52d919857321 admin admin] The token cache is being invalidate because project 4c4e61217b46465c8eb2fdfe88f48ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:16.800106 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff00d9ea-a915-41ff-8abc-52d919857321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:16.801486 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff00d9ea-a915-41ff-8abc-52d919857321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:16.801697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e95acf-fd39-44ad-bd6e-230a822e6623 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:16.803493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1086/2167] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:16 2022] DELETE /identity/v3/projects/4c4e61217b46465c8eb2fdfe88f48ca0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:16.804312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00d9ea-a915-41ff-8abc-52d919857321 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:16.805610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ff00d9ea-a915-41ff-8abc-52d919857321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:16.865701 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae60b4-50ba-498c-ac20-e55ed5e739d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:16.866260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae60b4-50ba-498c-ac20-e55ed5e739d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.866538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae60b4-50ba-498c-ac20-e55ed5e739d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.866809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae60b4-50ba-498c-ac20-e55ed5e739d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.867503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae60b4-50ba-498c-ac20-e55ed5e739d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:16.869650 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae60b4-50ba-498c-ac20-e55ed5e739d1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:16.876525 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00d9ea-a915-41ff-8abc-52d919857321 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:16.882382 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794a7bd-2072-4df5-aa91-31a4eedb66bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:16.883445 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794a7bd-2072-4df5-aa91-31a4eedb66bb admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.883765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794a7bd-2072-4df5-aa91-31a4eedb66bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.884178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794a7bd-2072-4df5-aa91-31a4eedb66bb admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.884834 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794a7bd-2072-4df5-aa91-31a4eedb66bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:16.886771 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794a7bd-2072-4df5-aa91-31a4eedb66bb admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:16.904066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1082/2168] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:16 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:16.909437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae60b4-50ba-498c-ac20-e55ed5e739d1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:16.911211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1087/2169] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:16 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:16.911790 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-93ae60b4-50ba-498c-ac20-e55ed5e739d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:16.911898 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794a7bd-2072-4df5-aa91-31a4eedb66bb admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:16.913598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d794a7bd-2072-4df5-aa91-31a4eedb66bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:16.926292 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794a7bd-2072-4df5-aa91-31a4eedb66bb admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:16.935883 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:16.981054 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:16.990374 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae60b4-50ba-498c-ac20-e55ed5e739d1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:16.993884 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff67a2-6bba-4145-8dfc-a769d0ef3a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:16.994707 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff67a2-6bba-4145-8dfc-a769d0ef3a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.995021 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff67a2-6bba-4145-8dfc-a769d0ef3a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.995514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9dad-0b89-424d-8e3d-1625b316b6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:16.995631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff67a2-6bba-4145-8dfc-a769d0ef3a99 admin admin] PATH_INFO: `/v3/users/e3d3ba1c57264067b9e1214553b3c482` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.996130 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9dad-0b89-424d-8e3d-1625b316b6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:16.996405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9dad-0b89-424d-8e3d-1625b316b6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:16.996673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9dad-0b89-424d-8e3d-1625b316b6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:16.997546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff67a2-6bba-4145-8dfc-a769d0ef3a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d3ba1c57264067b9e1214553b3c482)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:16.997655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9dad-0b89-424d-8e3d-1625b316b6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:16.999232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9dad-0b89-424d-8e3d-1625b316b6d8 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:16.999345 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff67a2-6bba-4145-8dfc-a769d0ef3a99 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:17.028323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1083/2170] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:16 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:17.028323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9dad-0b89-424d-8e3d-1625b316b6d8 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:17.030343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e94f9dad-0b89-424d-8e3d-1625b316b6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:17.044991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9dad-0b89-424d-8e3d-1625b316b6d8 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:17.050089 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bd5c7-15b0-4449-9e60-4caceb2962e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:17.051248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bd5c7-15b0-4449-9e60-4caceb2962e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.051646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bd5c7-15b0-4449-9e60-4caceb2962e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.052103 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bd5c7-15b0-4449-9e60-4caceb2962e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.052869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bd5c7-15b0-4449-9e60-4caceb2962e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:17.054769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bd5c7-15b0-4449-9e60-4caceb2962e9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:17.055849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59ff67a2-6bba-4145-8dfc-a769d0ef3a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d3ba1c57264067b9e1214553b3c482'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:17.056552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59ff67a2-6bba-4145-8dfc-a769d0ef3a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d3ba1c57264067b9e1214553b3c482'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:17.071183 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59ff67a2-6bba-4145-8dfc-a769d0ef3a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d3ba1c57264067b9e1214553b3c482'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:17.078034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1084/2171] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:17 2022] POST /identity/v3/users => generated 292 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:17.078959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bd5c7-15b0-4449-9e60-4caceb2962e9 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:17.080672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a61bd5c7-15b0-4449-9e60-4caceb2962e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:17.088151 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59ff67a2-6bba-4145-8dfc-a769d0ef3a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d3ba1c57264067b9e1214553b3c482'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:17.088906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59ff67a2-6bba-4145-8dfc-a769d0ef3a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d3ba1c57264067b9e1214553b3c482'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:17.094279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bd5c7-15b0-4449-9e60-4caceb2962e9 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:17.099336 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac705152-ad85-4e1e-9b2c-cda34356ae30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:17.099938 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac705152-ad85-4e1e-9b2c-cda34356ae30 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.100308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac705152-ad85-4e1e-9b2c-cda34356ae30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.100705 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac705152-ad85-4e1e-9b2c-cda34356ae30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.101353 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac705152-ad85-4e1e-9b2c-cda34356ae30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:17.102196 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1088/2172] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:16 2022] DELETE /identity/v3/users/e3d3ba1c57264067b9e1214553b3c482 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:17.102951 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac705152-ad85-4e1e-9b2c-cda34356ae30 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:17.103220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff67a2-6bba-4145-8dfc-a769d0ef3a99 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:17.104626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-59ff67a2-6bba-4145-8dfc-a769d0ef3a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:17.119060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1085/2173] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:17.120344 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac705152-ad85-4e1e-9b2c-cda34356ae30 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:17.124979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ac705152-ad85-4e1e-9b2c-cda34356ae30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:17.142599 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac705152-ad85-4e1e-9b2c-cda34356ae30 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:17.193582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff67a2-6bba-4145-8dfc-a769d0ef3a99 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:17.201809 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99999c60-6376-45d9-8f53-8e1a1f68ed77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:17.202434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99999c60-6376-45d9-8f53-8e1a1f68ed77 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.202716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99999c60-6376-45d9-8f53-8e1a1f68ed77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.202994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99999c60-6376-45d9-8f53-8e1a1f68ed77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.203726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99999c60-6376-45d9-8f53-8e1a1f68ed77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:17.205395 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99999c60-6376-45d9-8f53-8e1a1f68ed77 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:17.210527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c037f16-8521-4f66-a7e7-0588d31ac978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:17.211258 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c037f16-8521-4f66-a7e7-0588d31ac978 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.211599 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c037f16-8521-4f66-a7e7-0588d31ac978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.211944 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c037f16-8521-4f66-a7e7-0588d31ac978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.212715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c037f16-8521-4f66-a7e7-0588d31ac978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:17.214347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c037f16-8521-4f66-a7e7-0588d31ac978 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:17.219095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1089/2174] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:17.220044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99999c60-6376-45d9-8f53-8e1a1f68ed77 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:17.227478 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1086/2175] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:17.228523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c037f16-8521-4f66-a7e7-0588d31ac978 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:17.236384 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99999c60-6376-45d9-8f53-8e1a1f68ed77 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:17.240237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c037f16-8521-4f66-a7e7-0588d31ac978 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:17.242094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866c9f9-f53e-4990-b501-e6e153e57779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:17.242699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866c9f9-f53e-4990-b501-e6e153e57779 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.242982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866c9f9-f53e-4990-b501-e6e153e57779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.243282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866c9f9-f53e-4990-b501-e6e153e57779 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.243970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866c9f9-f53e-4990-b501-e6e153e57779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:17.245702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866c9f9-f53e-4990-b501-e6e153e57779 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:17.246177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92135e-a6d1-42d0-8e14-2beaab2b183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:17.246919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92135e-a6d1-42d0-8e14-2beaab2b183f admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.247040 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92135e-a6d1-42d0-8e14-2beaab2b183f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.247360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92135e-a6d1-42d0-8e14-2beaab2b183f admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.248004 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92135e-a6d1-42d0-8e14-2beaab2b183f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:17.249632 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92135e-a6d1-42d0-8e14-2beaab2b183f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:17.258458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1090/2176] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:17.263457 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1087/2177] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:17.266688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92135e-a6d1-42d0-8e14-2beaab2b183f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:17.267207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866c9f9-f53e-4990-b501-e6e153e57779 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:17.278917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866c9f9-f53e-4990-b501-e6e153e57779 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:17.279358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92135e-a6d1-42d0-8e14-2beaab2b183f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:17.286319 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f69aa-4455-47be-bf08-594c656b1439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:17.286319 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f69aa-4455-47be-bf08-594c656b1439 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.286562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f69aa-4455-47be-bf08-594c656b1439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.286733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cf197-9c42-4076-92be-8fc4371012c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:17.286851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f69aa-4455-47be-bf08-594c656b1439 admin admin] PATH_INFO: `/v3/projects/28192929d869488f9d16b845b3bc0ca9/users/bb889ce5000a46e2b4e9d37dbb5c9b0b/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.287494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cf197-9c42-4076-92be-8fc4371012c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.287772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cf197-9c42-4076-92be-8fc4371012c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.288041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cf197-9c42-4076-92be-8fc4371012c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.288687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cf197-9c42-4076-92be-8fc4371012c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:17.291364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cf197-9c42-4076-92be-8fc4371012c9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:17.305765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f69aa-4455-47be-bf08-594c656b1439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28192929d869488f9d16b845b3bc0ca9, user_id=bb889ce5000a46e2b4e9d37dbb5c9b0b, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:17.308671 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f69aa-4455-47be-bf08-594c656b1439 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:17.308790 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1091/2178] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:17.309627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cf197-9c42-4076-92be-8fc4371012c9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:17.321820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cf197-9c42-4076-92be-8fc4371012c9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:17.333100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1088/2179] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:17 2022] PUT /identity/v3/projects/28192929d869488f9d16b845b3bc0ca9/users/bb889ce5000a46e2b4e9d37dbb5c9b0b/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:17.333100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f69aa-4455-47be-bf08-594c656b1439 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:17.375207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:17.393749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a55787-fe76-4cd4-8c93-69a3bee018f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:17.395003 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a55787-fe76-4cd4-8c93-69a3bee018f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.396430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a55787-fe76-4cd4-8c93-69a3bee018f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.396928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a55787-fe76-4cd4-8c93-69a3bee018f5 admin admin] PATH_INFO: `/v3/projects/69b8cc86889b43659cbd4fe01b578643/users/26aad3a8d2fa462e9bedcd2a1203571c/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.400129 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:17.427171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f69aa-4455-47be-bf08-594c656b1439 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:17.432065 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a55787-fe76-4cd4-8c93-69a3bee018f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b8cc86889b43659cbd4fe01b578643, user_id=26aad3a8d2fa462e9bedcd2a1203571c, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:17.434800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a55787-fe76-4cd4-8c93-69a3bee018f5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:17.439757 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc8067-8f22-48e7-9b48-c67c726a6e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:17.440661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc8067-8f22-48e7-9b48-c67c726a6e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.440996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc8067-8f22-48e7-9b48-c67c726a6e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.441625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc8067-8f22-48e7-9b48-c67c726a6e43 admin admin] PATH_INFO: `/v3/projects/f0728ae2878a4f419e3db654b35f7add/users/6dd4e23fd6d74aceb0f3dced2cf4bda3/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.453891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1092/2180] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:17 2022] PUT /identity/v3/projects/69b8cc86889b43659cbd4fe01b578643/users/26aad3a8d2fa462e9bedcd2a1203571c/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:17.456093 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf4b96-53f9-4533-9fc1-3c99914d85c1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.456597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf4b96-53f9-4533-9fc1-3c99914d85c1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.457115 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf4b96-53f9-4533-9fc1-3c99914d85c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.460947 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc8067-8f22-48e7-9b48-c67c726a6e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0728ae2878a4f419e3db654b35f7add, user_id=6dd4e23fd6d74aceb0f3dced2cf4bda3, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:17.464100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc8067-8f22-48e7-9b48-c67c726a6e43 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:17.481330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1089/2181] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:17 2022] PUT /identity/v3/projects/f0728ae2878a4f419e3db654b35f7add/users/6dd4e23fd6d74aceb0f3dced2cf4bda3/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:17.483411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e924956-be09-4009-97f8-a0fd80a94b4f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.483411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e924956-be09-4009-97f8-a0fd80a94b4f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.483411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e924956-be09-4009-97f8-a0fd80a94b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.510962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7e924956-be09-4009-97f8-a0fd80a94b4f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:17.512228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7e924956-be09-4009-97f8-a0fd80a94b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:17.517654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e7cf4b96-53f9-4533-9fc1-3c99914d85c1 None None] MFA Rules not processed for user `bb889ce5000a46e2b4e9d37dbb5c9b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:17.518955 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e7cf4b96-53f9-4533-9fc1-3c99914d85c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:17.580493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1090/2182] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:17.583175 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dd2da-2d03-40ce-be4a-02de01a61986 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.583468 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dd2da-2d03-40ce-be4a-02de01a61986 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.583750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dd2da-2d03-40ce-be4a-02de01a61986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.607646 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1093/2183] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:17.608658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf4b96-53f9-4533-9fc1-3c99914d85c1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:17.613017 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e7cf4b96-53f9-4533-9fc1-3c99914d85c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:17.618462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8e5dd2da-2d03-40ce-be4a-02de01a61986 None None] MFA Rules not processed for user `6dd4e23fd6d74aceb0f3dced2cf4bda3`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:17.619863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8e5dd2da-2d03-40ce-be4a-02de01a61986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:17.627898 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf4b96-53f9-4533-9fc1-3c99914d85c1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:17.634686 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a6659-1575-4001-94d6-afe694908e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:17.635348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a6659-1575-4001-94d6-afe694908e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.635626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a6659-1575-4001-94d6-afe694908e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.635898 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a6659-1575-4001-94d6-afe694908e03 admin admin] PATH_INFO: `/v3/projects/d27014998bba47f180dc1634aaaa3470` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.637037 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a6659-1575-4001-94d6-afe694908e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27014998bba47f180dc1634aaaa3470)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:17.640603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a6659-1575-4001-94d6-afe694908e03 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:17.695138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1091/2184] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:17.695138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dd2da-2d03-40ce-be4a-02de01a61986 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:17.696729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8e5dd2da-2d03-40ce-be4a-02de01a61986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:17.709995 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f39a6659-1575-4001-94d6-afe694908e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27014998bba47f180dc1634aaaa3470', 'request_id': 'req-f39a6659-1575-4001-94d6-afe694908e03'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:17.726127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f39a6659-1575-4001-94d6-afe694908e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27014998bba47f180dc1634aaaa3470', 'request_id': 'req-f39a6659-1575-4001-94d6-afe694908e03'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:17.733071 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f39a6659-1575-4001-94d6-afe694908e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27014998bba47f180dc1634aaaa3470', 'request_id': 'req-f39a6659-1575-4001-94d6-afe694908e03'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:17.747652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f39a6659-1575-4001-94d6-afe694908e03 admin admin] The token cache is being invalidate because project d27014998bba47f180dc1634aaaa3470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:17.747940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f39a6659-1575-4001-94d6-afe694908e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:17.749077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f39a6659-1575-4001-94d6-afe694908e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:17.755344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1094/2185] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:17 2022] DELETE /identity/v3/projects/d27014998bba47f180dc1634aaaa3470 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:17.756439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a6659-1575-4001-94d6-afe694908e03 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:17.760725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f39a6659-1575-4001-94d6-afe694908e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:17.774856 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dd2da-2d03-40ce-be4a-02de01a61986 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:17.789605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:17.836801 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:17.842547 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72e50-5e99-4975-990c-c7d9d3610b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:17.843194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72e50-5e99-4975-990c-c7d9d3610b24 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.843539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72e50-5e99-4975-990c-c7d9d3610b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.843821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72e50-5e99-4975-990c-c7d9d3610b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.846925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-93b72e50-5e99-4975-990c-c7d9d3610b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:17.852266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a6659-1575-4001-94d6-afe694908e03 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:17.856731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0eea0-2017-49c4-9db3-c1bec4dcadbf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c78d95e6774755b11508fc1954ad5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:17.857569 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0eea0-2017-49c4-9db3-c1bec4dcadbf service glance] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.858248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0eea0-2017-49c4-9db3-c1bec4dcadbf service glance] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.858248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0eea0-2017-49c4-9db3-c1bec4dcadbf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.860927 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-52a0eea0-2017-49c4-9db3-c1bec4dcadbf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:17.929489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b72e50-5e99-4975-990c-c7d9d3610b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:17.931002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b72e50-5e99-4975-990c-c7d9d3610b24 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:17.931186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0eea0-2017-49c4-9db3-c1bec4dcadbf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:17.932950 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0eea0-2017-49c4-9db3-c1bec4dcadbf service glance] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:17.941779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1092/2186] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:17.942877 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72e50-5e99-4975-990c-c7d9d3610b24 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:17.944312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-93b72e50-5e99-4975-990c-c7d9d3610b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:17.945784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1095/2187] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:17.947424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fb740-04c0-4ea7-ba7c-2d705afbc7b7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.947893 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fb740-04c0-4ea7-ba7c-2d705afbc7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.948426 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fb740-04c0-4ea7-ba7c-2d705afbc7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.958194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72e50-5e99-4975-990c-c7d9d3610b24 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:17.964722 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59753ae5-1aca-4640-a18b-d2129eea5eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:17.965589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59753ae5-1aca-4640-a18b-d2129eea5eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:17.965736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59753ae5-1aca-4640-a18b-d2129eea5eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:17.965990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59753ae5-1aca-4640-a18b-d2129eea5eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:17.966637 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59753ae5-1aca-4640-a18b-d2129eea5eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:17.969006 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59753ae5-1aca-4640-a18b-d2129eea5eb7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:17.974219 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e90fb740-04c0-4ea7-ba7c-2d705afbc7b7 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:17.975988 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e90fb740-04c0-4ea7-ba7c-2d705afbc7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:17.990550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1096/2188] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:17.999582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d8c25-6182-4834-b3d0-925a51fadf37 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:18.000253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d8c25-6182-4834-b3d0-925a51fadf37 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:18.000670 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d8c25-6182-4834-b3d0-925a51fadf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:18.016697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1093/2189] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:17 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:18.020868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59753ae5-1aca-4640-a18b-d2129eea5eb7 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:18.046485 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7b6d8c25-6182-4834-b3d0-925a51fadf37 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:18.048055 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7b6d8c25-6182-4834-b3d0-925a51fadf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:18.156222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59753ae5-1aca-4640-a18b-d2129eea5eb7 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:18.162506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e13cb1-44d4-4484-993f-4956e6339c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:18.163206 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e13cb1-44d4-4484-993f-4956e6339c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:18.163574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e13cb1-44d4-4484-993f-4956e6339c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:18.163759 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e13cb1-44d4-4484-993f-4956e6339c75 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:18.164557 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e13cb1-44d4-4484-993f-4956e6339c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:18.166520 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e13cb1-44d4-4484-993f-4956e6339c75 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:18.168469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1097/2190] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:18.177005 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d8c25-6182-4834-b3d0-925a51fadf37 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:18.189946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d8c25-6182-4834-b3d0-925a51fadf37 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:18.194084 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1094/2191] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:18 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:18.196668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33946a0d-2a28-492a-a134-dbe24721e25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:18.197619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33946a0d-2a28-492a-a134-dbe24721e25d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:18.197944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33946a0d-2a28-492a-a134-dbe24721e25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:18.198226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33946a0d-2a28-492a-a134-dbe24721e25d admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:18.198717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e13cb1-44d4-4484-993f-4956e6339c75 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:18.199178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33946a0d-2a28-492a-a134-dbe24721e25d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:18.199588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33946a0d-2a28-492a-a134-dbe24721e25d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:18.201246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33946a0d-2a28-492a-a134-dbe24721e25d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:18.227500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1098/2192] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:18.228978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33946a0d-2a28-492a-a134-dbe24721e25d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:18.230699 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e13cb1-44d4-4484-993f-4956e6339c75 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:18.242546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1dc67-3cfa-4433-9b89-99d5e430af3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:18.243310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1dc67-3cfa-4433-9b89-99d5e430af3f admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:18.243809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1dc67-3cfa-4433-9b89-99d5e430af3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:18.244214 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1dc67-3cfa-4433-9b89-99d5e430af3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:18.248413 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33946a0d-2a28-492a-a134-dbe24721e25d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:18.251646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1dc67-3cfa-4433-9b89-99d5e430af3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:18.253507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1dc67-3cfa-4433-9b89-99d5e430af3f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:18.257388 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544af157-0a4e-4dfa-98a4-c873d9d36582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:18.258156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544af157-0a4e-4dfa-98a4-c873d9d36582 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:18.258445 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544af157-0a4e-4dfa-98a4-c873d9d36582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:18.258727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544af157-0a4e-4dfa-98a4-c873d9d36582 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:18.259409 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544af157-0a4e-4dfa-98a4-c873d9d36582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:18.262026 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544af157-0a4e-4dfa-98a4-c873d9d36582 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:18.282278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1095/2193] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:18.287465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1dc67-3cfa-4433-9b89-99d5e430af3f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:18.303255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1dc67-3cfa-4433-9b89-99d5e430af3f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:18.310446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29727e-6846-4782-bf29-e46ce62dc096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:18.311201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29727e-6846-4782-bf29-e46ce62dc096 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:18.311481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29727e-6846-4782-bf29-e46ce62dc096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:18.312065 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29727e-6846-4782-bf29-e46ce62dc096 admin admin] PATH_INFO: `/v3/projects/ad06f88c249945ecbd782a998c4ab79a/users/eeedbae558014981bfd71d6a3027e803/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:18.326591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1099/2194] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:18 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:18.328025 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544af157-0a4e-4dfa-98a4-c873d9d36582 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:18.343581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29727e-6846-4782-bf29-e46ce62dc096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad06f88c249945ecbd782a998c4ab79a, user_id=eeedbae558014981bfd71d6a3027e803, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:18.348654 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29727e-6846-4782-bf29-e46ce62dc096 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:18.351918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:18.385302 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1096/2195] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:18 2022] PUT /identity/v3/projects/ad06f88c249945ecbd782a998c4ab79a/users/eeedbae558014981bfd71d6a3027e803/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:18.389522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29727e-6846-4782-bf29-e46ce62dc096 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:18.459735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:18.470575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544af157-0a4e-4dfa-98a4-c873d9d36582 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:18.543554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29727e-6846-4782-bf29-e46ce62dc096 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:18.550276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb4637-0308-4548-b0ca-7cb2b657e21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:18.552319 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb4637-0308-4548-b0ca-7cb2b657e21e admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:18.552597 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb4637-0308-4548-b0ca-7cb2b657e21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:18.553095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb4637-0308-4548-b0ca-7cb2b657e21e admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:18.553996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb4637-0308-4548-b0ca-7cb2b657e21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:18.557570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb4637-0308-4548-b0ca-7cb2b657e21e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:18.600812 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1097/2196] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:20:18.602435 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb4637-0308-4548-b0ca-7cb2b657e21e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:18.612226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b8835-1d37-43d0-9734-8b37c70bd0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:18.614350 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b8835-1d37-43d0-9734-8b37c70bd0bc admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:18.614657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b8835-1d37-43d0-9734-8b37c70bd0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:18.614936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b8835-1d37-43d0-9734-8b37c70bd0bc admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:18.616798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b8835-1d37-43d0-9734-8b37c70bd0bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:18.620039 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b8835-1d37-43d0-9734-8b37c70bd0bc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:18.632176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb4637-0308-4548-b0ca-7cb2b657e21e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:18.649066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299cfda-c1c2-4362-987f-b31ee2c92fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:18.649956 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299cfda-c1c2-4362-987f-b31ee2c92fef admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:18.650244 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299cfda-c1c2-4362-987f-b31ee2c92fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:18.651853 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299cfda-c1c2-4362-987f-b31ee2c92fef admin admin] PATH_INFO: `/v3/projects/ad06f88c249945ecbd782a998c4ab79a/users/eeedbae558014981bfd71d6a3027e803/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:18.658491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299cfda-c1c2-4362-987f-b31ee2c92fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad06f88c249945ecbd782a998c4ab79a, user_id=eeedbae558014981bfd71d6a3027e803, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:18.664439 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299cfda-c1c2-4362-987f-b31ee2c92fef admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:18.688237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1098/2197] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:18 2022] PUT /identity/v3/projects/ad06f88c249945ecbd782a998c4ab79a/users/eeedbae558014981bfd71d6a3027e803/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:18.691018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1100/2198] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:18 2022] POST /identity/v3/users => generated 285 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:18.696192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299cfda-c1c2-4362-987f-b31ee2c92fef admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:18.704440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f4ea2-850e-412a-b790-966dd9ed4833 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:18.704953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f4ea2-850e-412a-b790-966dd9ed4833 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:18.705431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f4ea2-850e-412a-b790-966dd9ed4833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:18.788301 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e64f4ea2-850e-412a-b790-966dd9ed4833 None None] MFA Rules not processed for user `eeedbae558014981bfd71d6a3027e803`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:18.789868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299cfda-c1c2-4362-987f-b31ee2c92fef admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:18.791268 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e64f4ea2-850e-412a-b790-966dd9ed4833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:18.806375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a04018-7765-47b5-b8df-9c2dd4038c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:18.807056 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a04018-7765-47b5-b8df-9c2dd4038c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:18.807470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a04018-7765-47b5-b8df-9c2dd4038c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:18.807758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a04018-7765-47b5-b8df-9c2dd4038c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:18.808462 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a04018-7765-47b5-b8df-9c2dd4038c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:18.813325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a04018-7765-47b5-b8df-9c2dd4038c2f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:18.831711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1099/2199] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:18.835933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a04018-7765-47b5-b8df-9c2dd4038c2f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:18.848219 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a04018-7765-47b5-b8df-9c2dd4038c2f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:18.866892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4758d-2c35-4688-a6f5-132b332bdbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:18.867547 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4758d-2c35-4688-a6f5-132b332bdbcf admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:18.867826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4758d-2c35-4688-a6f5-132b332bdbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:18.868093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4758d-2c35-4688-a6f5-132b332bdbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:18.868735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4758d-2c35-4688-a6f5-132b332bdbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:18.870335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4758d-2c35-4688-a6f5-132b332bdbcf admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:18.889048 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1100/2200] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:18.890523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4758d-2c35-4688-a6f5-132b332bdbcf admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:18.895908 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1101/2201] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:18.903488 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4758d-2c35-4688-a6f5-132b332bdbcf admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:18.908122 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb1781-8239-436f-ab7e-c62afaa63c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:18.908784 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb1781-8239-436f-ab7e-c62afaa63c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:18.909062 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb1781-8239-436f-ab7e-c62afaa63c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:18.909334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb1781-8239-436f-ab7e-c62afaa63c23 admin admin] PATH_INFO: `/v3/projects/71ccff6cef1b4e629cafddb4931b7a28/users/75a3be749bb64863abf1fdb9c4fef268/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:18.911850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f4ea2-850e-412a-b790-966dd9ed4833 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:18.913454 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e64f4ea2-850e-412a-b790-966dd9ed4833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:18.930376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb1781-8239-436f-ab7e-c62afaa63c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ccff6cef1b4e629cafddb4931b7a28, user_id=75a3be749bb64863abf1fdb9c4fef268, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:18.936655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb1781-8239-436f-ab7e-c62afaa63c23 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:18.963579 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1101/2202] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:18 2022] PUT /identity/v3/projects/71ccff6cef1b4e629cafddb4931b7a28/users/75a3be749bb64863abf1fdb9c4fef268/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:18.977377 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb64079-0ca1-497d-bd1a-51e572c9d2f7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:18.977886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb64079-0ca1-497d-bd1a-51e572c9d2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:18.978252 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb64079-0ca1-497d-bd1a-51e572c9d2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:19.020075 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f4ea2-850e-412a-b790-966dd9ed4833 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:19.041405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-fbb64079-0ca1-497d-bd1a-51e572c9d2f7 None None] MFA Rules not processed for user `75a3be749bb64863abf1fdb9c4fef268`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:19.042667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fbb64079-0ca1-497d-bd1a-51e572c9d2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:19.066841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:19.094458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:19.102330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dfd43-8cc3-42db-84a7-5dd2133001fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:19.104198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dfd43-8cc3-42db-84a7-5dd2133001fe service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:19.105076 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dfd43-8cc3-42db-84a7-5dd2133001fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:19.105683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dfd43-8cc3-42db-84a7-5dd2133001fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:19.157440 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1102/2203] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:19.162211 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb64079-0ca1-497d-bd1a-51e572c9d2f7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:19.214580 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dfd43-8cc3-42db-84a7-5dd2133001fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:19.215921 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dfd43-8cc3-42db-84a7-5dd2133001fe service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:19.239602 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1102/2204] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:19.275953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb64079-0ca1-497d-bd1a-51e572c9d2f7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:19.288723 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e69775-d9fb-4d34-a084-e525d086fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:19.289712 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e69775-d9fb-4d34-a084-e525d086fdca admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:19.290125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e69775-d9fb-4d34-a084-e525d086fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:19.290529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e69775-d9fb-4d34-a084-e525d086fdca admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:19.291318 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e69775-d9fb-4d34-a084-e525d086fdca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:19.294011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e69775-d9fb-4d34-a084-e525d086fdca admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:19.368062 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dfd43-8cc3-42db-84a7-5dd2133001fe service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:19.377856 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dfd43-8cc3-42db-84a7-5dd2133001fe service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:19.385647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1103/2205] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:19 2022] POST /identity/v3/projects => generated 369 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:19.387148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e69775-d9fb-4d34-a084-e525d086fdca admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:19.391173 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a452f2e-9df0-4bae-9c56-aca03edc7028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:19.391813 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a452f2e-9df0-4bae-9c56-aca03edc7028 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:19.392099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a452f2e-9df0-4bae-9c56-aca03edc7028 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:19.392365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a452f2e-9df0-4bae-9c56-aca03edc7028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:19.397132 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5a452f2e-9df0-4bae-9c56-aca03edc7028 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:19.531902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a452f2e-9df0-4bae-9c56-aca03edc7028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:19.533829 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a452f2e-9df0-4bae-9c56-aca03edc7028 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:19.546216 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1103/2206] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:19.554354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e69775-d9fb-4d34-a084-e525d086fdca admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:19.560662 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e336b87-9f79-4798-835f-a2fd5a598fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:19.561894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e336b87-9f79-4798-835f-a2fd5a598fcd admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:19.562079 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e336b87-9f79-4798-835f-a2fd5a598fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:19.562339 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e336b87-9f79-4798-835f-a2fd5a598fcd admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:19.563393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e336b87-9f79-4798-835f-a2fd5a598fcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:19.566055 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e336b87-9f79-4798-835f-a2fd5a598fcd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:19.619830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a452f2e-9df0-4bae-9c56-aca03edc7028 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:19.630526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1104/2207] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:19 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:19.647768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a452f2e-9df0-4bae-9c56-aca03edc7028 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:19.676317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef22f8e-e6fe-437e-b1a4-527f5568edf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:19.676947 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef22f8e-e6fe-437e-b1a4-527f5568edf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:19.677450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef22f8e-e6fe-437e-b1a4-527f5568edf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:19.699928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef22f8e-e6fe-437e-b1a4-527f5568edf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:19.700739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef22f8e-e6fe-437e-b1a4-527f5568edf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:19.702407 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef22f8e-e6fe-437e-b1a4-527f5568edf4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:19.739920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1104/2208] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:19.742325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e336b87-9f79-4798-835f-a2fd5a598fcd admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:19.752603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef22f8e-e6fe-437e-b1a4-527f5568edf4 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:19.758840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3ef22f8e-e6fe-437e-b1a4-527f5568edf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:19.759393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e336b87-9f79-4798-835f-a2fd5a598fcd admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:19.771881 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085cb91-568c-4eb1-a8af-4ab037bfc345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:19.772720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085cb91-568c-4eb1-a8af-4ab037bfc345 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:19.773156 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085cb91-568c-4eb1-a8af-4ab037bfc345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:19.773450 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085cb91-568c-4eb1-a8af-4ab037bfc345 admin admin] PATH_INFO: `/v3/projects/61c692c769bf4a98a98cc662b99756e2/users/508e7cac4a834c478b6d9fea21d4aec1/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:19.791430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef22f8e-e6fe-437e-b1a4-527f5568edf4 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:19.793123 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085cb91-568c-4eb1-a8af-4ab037bfc345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c692c769bf4a98a98cc662b99756e2, user_id=508e7cac4a834c478b6d9fea21d4aec1, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:19.803457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0b950-b0f8-4381-a6d9-80a88fe09f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:19.810665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085cb91-568c-4eb1-a8af-4ab037bfc345 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:19.818596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0b950-b0f8-4381-a6d9-80a88fe09f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:19.820438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0b950-b0f8-4381-a6d9-80a88fe09f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:19.820712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0b950-b0f8-4381-a6d9-80a88fe09f86 admin admin] PATH_INFO: `/v3/users/d2faa9cea8f14990877f342a490938ad` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:19.822846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0b950-b0f8-4381-a6d9-80a88fe09f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2faa9cea8f14990877f342a490938ad)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:19.830258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0b950-b0f8-4381-a6d9-80a88fe09f86 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:19.857424 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1105/2209] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:19 2022] PUT /identity/v3/projects/61c692c769bf4a98a98cc662b99756e2/users/508e7cac4a834c478b6d9fea21d4aec1/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:19.862836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085cb91-568c-4eb1-a8af-4ab037bfc345 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:19.932886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:19.935312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-55f0b950-b0f8-4381-a6d9-80a88fe09f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2faa9cea8f14990877f342a490938ad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:19.937669 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-55f0b950-b0f8-4381-a6d9-80a88fe09f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2faa9cea8f14990877f342a490938ad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:19.949110 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-55f0b950-b0f8-4381-a6d9-80a88fe09f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2faa9cea8f14990877f342a490938ad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:19.961598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:19.990824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-55f0b950-b0f8-4381-a6d9-80a88fe09f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2faa9cea8f14990877f342a490938ad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:19.993123 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-55f0b950-b0f8-4381-a6d9-80a88fe09f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2faa9cea8f14990877f342a490938ad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:20.012128 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1105/2210] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:19 2022] DELETE /identity/v3/users/d2faa9cea8f14990877f342a490938ad => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:20.017630 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380d48f-f621-4582-b59d-4205ee596185 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:20.018140 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380d48f-f621-4582-b59d-4205ee596185 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:20.018518 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380d48f-f621-4582-b59d-4205ee596185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:20.064739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085cb91-568c-4eb1-a8af-4ab037bfc345 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:20.080486 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f380d48f-f621-4582-b59d-4205ee596185 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:20.086419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f380d48f-f621-4582-b59d-4205ee596185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:20.221723 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ffa3d-dfe2-42c8-b456-c66cae0a8733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:20.223914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ffa3d-dfe2-42c8-b456-c66cae0a8733 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:20.224306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ffa3d-dfe2-42c8-b456-c66cae0a8733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:20.224687 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ffa3d-dfe2-42c8-b456-c66cae0a8733 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:20.225497 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ffa3d-dfe2-42c8-b456-c66cae0a8733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:20.227505 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ffa3d-dfe2-42c8-b456-c66cae0a8733 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:20.228349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1106/2211] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:20.229306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380d48f-f621-4582-b59d-4205ee596185 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:20.230654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f380d48f-f621-4582-b59d-4205ee596185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:20.250550 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1106/2212] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:20.250550 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ffa3d-dfe2-42c8-b456-c66cae0a8733 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:20.256988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c48ffa3d-dfe2-42c8-b456-c66cae0a8733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:20.260748 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380d48f-f621-4582-b59d-4205ee596185 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:20.267189 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e3584-63ed-470c-8a9b-405f28c8567a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:20.268472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e3584-63ed-470c-8a9b-405f28c8567a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:20.269040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e3584-63ed-470c-8a9b-405f28c8567a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:20.269740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e3584-63ed-470c-8a9b-405f28c8567a admin admin] PATH_INFO: `/v3/users/6dd4e23fd6d74aceb0f3dced2cf4bda3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:20.271464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e3584-63ed-470c-8a9b-405f28c8567a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dd4e23fd6d74aceb0f3dced2cf4bda3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:20.274749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e3584-63ed-470c-8a9b-405f28c8567a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:20.355472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d56e3584-63ed-470c-8a9b-405f28c8567a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dd4e23fd6d74aceb0f3dced2cf4bda3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:20.358690 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d56e3584-63ed-470c-8a9b-405f28c8567a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dd4e23fd6d74aceb0f3dced2cf4bda3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:20.367592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d56e3584-63ed-470c-8a9b-405f28c8567a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dd4e23fd6d74aceb0f3dced2cf4bda3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:20.383899 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d56e3584-63ed-470c-8a9b-405f28c8567a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dd4e23fd6d74aceb0f3dced2cf4bda3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:20.384640 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d56e3584-63ed-470c-8a9b-405f28c8567a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dd4e23fd6d74aceb0f3dced2cf4bda3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:20.396552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ffa3d-dfe2-42c8-b456-c66cae0a8733 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:20.402801 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1107/2213] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:20 2022] DELETE /identity/v3/users/6dd4e23fd6d74aceb0f3dced2cf4bda3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:20.403461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa4cca-20d6-4bdb-a3b6-3e74a56a55a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:20.403819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e3584-63ed-470c-8a9b-405f28c8567a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:20.404699 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa4cca-20d6-4bdb-a3b6-3e74a56a55a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:20.404985 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa4cca-20d6-4bdb-a3b6-3e74a56a55a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:20.405477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa4cca-20d6-4bdb-a3b6-3e74a56a55a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:20.406538 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d56e3584-63ed-470c-8a9b-405f28c8567a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:20.408239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bdaa4cca-20d6-4bdb-a3b6-3e74a56a55a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:20.434121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa4cca-20d6-4bdb-a3b6-3e74a56a55a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:20.435861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa4cca-20d6-4bdb-a3b6-3e74a56a55a4 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:20.460704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1107/2214] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:20.463103 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef327-49eb-445a-9b15-45e084f4729b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:20.463778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef327-49eb-445a-9b15-45e084f4729b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:20.464237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef327-49eb-445a-9b15-45e084f4729b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:20.489578 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-11aef327-49eb-445a-9b15-45e084f4729b None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:20.491366 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-11aef327-49eb-445a-9b15-45e084f4729b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:20.561310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:20.590465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e3584-63ed-470c-8a9b-405f28c8567a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:20.603269 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b908b-3215-4cee-b6b3-511f3ce3966e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:20.605045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b908b-3215-4cee-b6b3-511f3ce3966e admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:20.605045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b908b-3215-4cee-b6b3-511f3ce3966e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:20.605045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b908b-3215-4cee-b6b3-511f3ce3966e admin admin] PATH_INFO: `/v3/projects/61c692c769bf4a98a98cc662b99756e2/users/508e7cac4a834c478b6d9fea21d4aec1/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:20.611037 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b908b-3215-4cee-b6b3-511f3ce3966e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c692c769bf4a98a98cc662b99756e2, user_id=508e7cac4a834c478b6d9fea21d4aec1, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:20.614373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b908b-3215-4cee-b6b3-511f3ce3966e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:20.655376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1108/2215] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:20 2022] PUT /identity/v3/projects/61c692c769bf4a98a98cc662b99756e2/users/508e7cac4a834c478b6d9fea21d4aec1/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:20.655564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1108/2216] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:20.670336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83b915-1d8b-40f6-aa44-fe973b7ede96 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:20.670648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83b915-1d8b-40f6-aa44-fe973b7ede96 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:20.670977 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83b915-1d8b-40f6-aa44-fe973b7ede96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:20.675994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aef327-49eb-445a-9b15-45e084f4729b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:20.678388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-11aef327-49eb-445a-9b15-45e084f4729b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:20.691589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:20.739104 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4a83b915-1d8b-40f6-aa44-fe973b7ede96 None None] MFA Rules not processed for user `508e7cac4a834c478b6d9fea21d4aec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:20.740581 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4a83b915-1d8b-40f6-aa44-fe973b7ede96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:20.840713 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aef327-49eb-445a-9b15-45e084f4729b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:20.875235 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1109/2217] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:20.891487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83b915-1d8b-40f6-aa44-fe973b7ede96 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:20.893994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4a83b915-1d8b-40f6-aa44-fe973b7ede96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:20.934894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c814f20-5aef-45ae-a129-54cd1369c758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:20.935508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c814f20-5aef-45ae-a129-54cd1369c758 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:20.935508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c814f20-5aef-45ae-a129-54cd1369c758 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:20.936024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c814f20-5aef-45ae-a129-54cd1369c758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:21.023889 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c814f20-5aef-45ae-a129-54cd1369c758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:21.026041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c814f20-5aef-45ae-a129-54cd1369c758 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:21.046347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1109/2218] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:21.063706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83b915-1d8b-40f6-aa44-fe973b7ede96 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:21.089557 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27733ee-9ebe-41f7-95f3-0b6d8b04ea2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:21.091250 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27733ee-9ebe-41f7-95f3-0b6d8b04ea2c service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:21.091701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27733ee-9ebe-41f7-95f3-0b6d8b04ea2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:21.092189 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27733ee-9ebe-41f7-95f3-0b6d8b04ea2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:21.119516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27733ee-9ebe-41f7-95f3-0b6d8b04ea2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:21.122178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27733ee-9ebe-41f7-95f3-0b6d8b04ea2c service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:21.138074 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c814f20-5aef-45ae-a129-54cd1369c758 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:21.141354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3c814f20-5aef-45ae-a129-54cd1369c758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:21.149797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1110/2219] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:21.173373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c814f20-5aef-45ae-a129-54cd1369c758 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:21.187988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdbfd0-c262-4a80-bd3b-d055802ed104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:21.188676 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdbfd0-c262-4a80-bd3b-d055802ed104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:21.188956 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdbfd0-c262-4a80-bd3b-d055802ed104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:21.189232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdbfd0-c262-4a80-bd3b-d055802ed104 admin admin] PATH_INFO: `/v3/projects/c984c87febd8474082f0eb6e02000d3b` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:21.193361 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdbfd0-c262-4a80-bd3b-d055802ed104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c984c87febd8474082f0eb6e02000d3b)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:21.195486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdbfd0-c262-4a80-bd3b-d055802ed104 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:21.265488 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27733ee-9ebe-41f7-95f3-0b6d8b04ea2c service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:21.267274 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b27733ee-9ebe-41f7-95f3-0b6d8b04ea2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:21.308022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27733ee-9ebe-41f7-95f3-0b6d8b04ea2c service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:21.355026 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2bcdbfd0-c262-4a80-bd3b-d055802ed104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c984c87febd8474082f0eb6e02000d3b', 'request_id': 'req-2bcdbfd0-c262-4a80-bd3b-d055802ed104'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:21.372949 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2bcdbfd0-c262-4a80-bd3b-d055802ed104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c984c87febd8474082f0eb6e02000d3b', 'request_id': 'req-2bcdbfd0-c262-4a80-bd3b-d055802ed104'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:21.389641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2bcdbfd0-c262-4a80-bd3b-d055802ed104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c984c87febd8474082f0eb6e02000d3b', 'request_id': 'req-2bcdbfd0-c262-4a80-bd3b-d055802ed104'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:21.393866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:21.415056 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2bcdbfd0-c262-4a80-bd3b-d055802ed104 admin admin] The token cache is being invalidate because project c984c87febd8474082f0eb6e02000d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:21.415475 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2bcdbfd0-c262-4a80-bd3b-d055802ed104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:21.416530 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2bcdbfd0-c262-4a80-bd3b-d055802ed104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:21.418650 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1110/2220] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:21 2022] DELETE /identity/v3/projects/c984c87febd8474082f0eb6e02000d3b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:21.430613 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edc741-5e97-4471-9c77-610a638e1a2c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:21.431021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edc741-5e97-4471-9c77-610a638e1a2c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:21.431529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edc741-5e97-4471-9c77-610a638e1a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:21.433215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23436968-3d9b-4556-b153-e48c01f73359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:21.433876 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23436968-3d9b-4556-b153-e48c01f73359 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:21.437121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23436968-3d9b-4556-b153-e48c01f73359 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:21.437408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23436968-3d9b-4556-b153-e48c01f73359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:21.440402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-23436968-3d9b-4556-b153-e48c01f73359 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:21.464586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-46edc741-5e97-4471-9c77-610a638e1a2c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:21.466106 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-46edc741-5e97-4471-9c77-610a638e1a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:21.547178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:21.597019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23436968-3d9b-4556-b153-e48c01f73359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:21.598759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23436968-3d9b-4556-b153-e48c01f73359 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:21.628157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1111/2221] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:21.637011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1111/2222] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:21.646432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec4e38-3239-4db4-8b86-891206a92f77 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:21.646858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec4e38-3239-4db4-8b86-891206a92f77 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:21.647281 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec4e38-3239-4db4-8b86-891206a92f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:21.682729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c4ec4e38-3239-4db4-8b86-891206a92f77 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:21.684462 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c4ec4e38-3239-4db4-8b86-891206a92f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:21.735905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edc741-5e97-4471-9c77-610a638e1a2c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:21.741597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1112/2223] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:21.751977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edc741-5e97-4471-9c77-610a638e1a2c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:21.767213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c17ec-7899-4dd2-a6a2-5e7f6cf1e2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:21.768209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c17ec-7899-4dd2-a6a2-5e7f6cf1e2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:21.773543 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c17ec-7899-4dd2-a6a2-5e7f6cf1e2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:21.774010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c17ec-7899-4dd2-a6a2-5e7f6cf1e2b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:21.774991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c17ec-7899-4dd2-a6a2-5e7f6cf1e2b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:21.775490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c17ec-7899-4dd2-a6a2-5e7f6cf1e2b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:21.777391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c17ec-7899-4dd2-a6a2-5e7f6cf1e2b8 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:21.804392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1112/2224] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:21.808903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec4e38-3239-4db4-8b86-891206a92f77 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:21.823279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec4e38-3239-4db4-8b86-891206a92f77 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:21.831201 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0aa31e-6169-4aab-9d93-2efcada88943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:21.834841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0aa31e-6169-4aab-9d93-2efcada88943 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:21.835547 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0aa31e-6169-4aab-9d93-2efcada88943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:21.836248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0aa31e-6169-4aab-9d93-2efcada88943 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:21.837246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0aa31e-6169-4aab-9d93-2efcada88943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:21.840385 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0aa31e-6169-4aab-9d93-2efcada88943 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:21.887263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a20c28-c5a4-45b2-8d3a-7e8c4295b51f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:21.887551 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a20c28-c5a4-45b2-8d3a-7e8c4295b51f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:21.887876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a20c28-c5a4-45b2-8d3a-7e8c4295b51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:21.916220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1113/2225] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:21 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:21.920056 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0aa31e-6169-4aab-9d93-2efcada88943 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:21.943022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-21a20c28-c5a4-45b2-8d3a-7e8c4295b51f None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:21.944980 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-21a20c28-c5a4-45b2-8d3a-7e8c4295b51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:22.141086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0aa31e-6169-4aab-9d93-2efcada88943 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:22.144295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1113/2226] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 13 01:20:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:22.148442 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a366bd-915b-4ae2-9a1f-550c7e65becc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:22.149064 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a366bd-915b-4ae2-9a1f-550c7e65becc admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:22.149346 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a366bd-915b-4ae2-9a1f-550c7e65becc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:22.149765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a366bd-915b-4ae2-9a1f-550c7e65becc admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:22.150410 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a366bd-915b-4ae2-9a1f-550c7e65becc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:22.152600 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a366bd-915b-4ae2-9a1f-550c7e65becc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:22.218929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a20c28-c5a4-45b2-8d3a-7e8c4295b51f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:22.222213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-21a20c28-c5a4-45b2-8d3a-7e8c4295b51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:22.236558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1114/2227] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:21 2022] POST /identity/v3/users => generated 292 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:22.237553 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a366bd-915b-4ae2-9a1f-550c7e65becc admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:22.278463 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a366bd-915b-4ae2-9a1f-550c7e65becc admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:22.305174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1b7b8-d68a-4f8b-8da1-83b0729c8ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:22.305914 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1b7b8-d68a-4f8b-8da1-83b0729c8ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:22.306201 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1b7b8-d68a-4f8b-8da1-83b0729c8ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:22.306475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1b7b8-d68a-4f8b-8da1-83b0729c8ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:22.307231 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1b7b8-d68a-4f8b-8da1-83b0729c8ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:22.308845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1b7b8-d68a-4f8b-8da1-83b0729c8ea2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:22.339911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1115/2228] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:22.340756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1b7b8-d68a-4f8b-8da1-83b0729c8ea2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:22.368789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1b7b8-d68a-4f8b-8da1-83b0729c8ea2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:22.383089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ae06e-7c88-498a-aebc-794dd0d5ac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:22.383729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ae06e-7c88-498a-aebc-794dd0d5ac58 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:22.384218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ae06e-7c88-498a-aebc-794dd0d5ac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:22.385822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ae06e-7c88-498a-aebc-794dd0d5ac58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:22.386501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ae06e-7c88-498a-aebc-794dd0d5ac58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:22.397811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ae06e-7c88-498a-aebc-794dd0d5ac58 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:22.434710 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1116/2229] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:22.439181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ae06e-7c88-498a-aebc-794dd0d5ac58 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:22.443109 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fa5ae06e-7c88-498a-aebc-794dd0d5ac58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:22.450104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a20c28-c5a4-45b2-8d3a-7e8c4295b51f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:22.466662 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b286e37-f41e-4607-acb8-59b8ba1561d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:22.467711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286e37-f41e-4607-acb8-59b8ba1561d7 service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:22.468139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286e37-f41e-4607-acb8-59b8ba1561d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:22.471973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286e37-f41e-4607-acb8-59b8ba1561d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:22.474777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ae06e-7c88-498a-aebc-794dd0d5ac58 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:22.480752 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939281-c3be-41d2-9170-e1dc83bcb07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:22.481736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939281-c3be-41d2-9170-e1dc83bcb07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:22.482126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939281-c3be-41d2-9170-e1dc83bcb07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:22.482547 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939281-c3be-41d2-9170-e1dc83bcb07f admin admin] PATH_INFO: `/v3/projects/f0728ae2878a4f419e3db654b35f7add` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:22.484086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c939281-c3be-41d2-9170-e1dc83bcb07f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0728ae2878a4f419e3db654b35f7add)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:22.486316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c939281-c3be-41d2-9170-e1dc83bcb07f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:22.508593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b286e37-f41e-4607-acb8-59b8ba1561d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:22.511729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b286e37-f41e-4607-acb8-59b8ba1561d7 service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:22.533057 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1114/2230] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:20:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 01:20:22.534384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b286e37-f41e-4607-acb8-59b8ba1561d7 service swift] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:22.554525 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b286e37-f41e-4607-acb8-59b8ba1561d7 service swift] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:22.569564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c939281-c3be-41d2-9170-e1dc83bcb07f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0728ae2878a4f419e3db654b35f7add', 'request_id': 'req-7c939281-c3be-41d2-9170-e1dc83bcb07f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:22.594905 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c939281-c3be-41d2-9170-e1dc83bcb07f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0728ae2878a4f419e3db654b35f7add', 'request_id': 'req-7c939281-c3be-41d2-9170-e1dc83bcb07f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:22.599869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:22.608152 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c939281-c3be-41d2-9170-e1dc83bcb07f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0728ae2878a4f419e3db654b35f7add', 'request_id': 'req-7c939281-c3be-41d2-9170-e1dc83bcb07f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:22.613568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:22.623945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c939281-c3be-41d2-9170-e1dc83bcb07f admin admin] The token cache is being invalidate because project f0728ae2878a4f419e3db654b35f7add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:22.624644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c939281-c3be-41d2-9170-e1dc83bcb07f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:22.625422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c939281-c3be-41d2-9170-e1dc83bcb07f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:22.631992 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1117/2231] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:22 2022] DELETE /identity/v3/projects/f0728ae2878a4f419e3db654b35f7add => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:22.632985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939281-c3be-41d2-9170-e1dc83bcb07f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:22.634440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7c939281-c3be-41d2-9170-e1dc83bcb07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:22.696086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe11c-872a-4cb8-a16e-563f23a36e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:22.696773 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe11c-872a-4cb8-a16e-563f23a36e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:22.697053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe11c-872a-4cb8-a16e-563f23a36e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:22.697422 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe11c-872a-4cb8-a16e-563f23a36e01 admin admin] PATH_INFO: `/v3/projects/5cb6bfdebc484ae8a01e1e91faacbb2a/users/764be6e1a12f4931a08d01ad32c8b8ef/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:22.730438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fe11c-872a-4cb8-a16e-563f23a36e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cb6bfdebc484ae8a01e1e91faacbb2a, user_id=764be6e1a12f4931a08d01ad32c8b8ef, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:22.736870 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939281-c3be-41d2-9170-e1dc83bcb07f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:22.738388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fe11c-872a-4cb8-a16e-563f23a36e01 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:22.743001 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9982591-28fb-4472-a7df-88d6813dd80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:22.743716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9982591-28fb-4472-a7df-88d6813dd80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:22.743998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9982591-28fb-4472-a7df-88d6813dd80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:22.744317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9982591-28fb-4472-a7df-88d6813dd80d admin admin] PATH_INFO: `/v3/users/eeedbae558014981bfd71d6a3027e803` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:22.745766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9982591-28fb-4472-a7df-88d6813dd80d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeedbae558014981bfd71d6a3027e803)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:22.748492 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9982591-28fb-4472-a7df-88d6813dd80d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:22.786761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1115/2232] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:22 2022] PUT /identity/v3/projects/5cb6bfdebc484ae8a01e1e91faacbb2a/users/764be6e1a12f4931a08d01ad32c8b8ef/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:22.788287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98de49-8599-47e1-b8c8-8f66c4747f12 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:22.788578 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98de49-8599-47e1-b8c8-8f66c4747f12 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:22.788858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98de49-8599-47e1-b8c8-8f66c4747f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:22.855627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6b98de49-8599-47e1-b8c8-8f66c4747f12 None None] MFA Rules not processed for user `764be6e1a12f4931a08d01ad32c8b8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:22.857133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6b98de49-8599-47e1-b8c8-8f66c4747f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:22.903278 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b9982591-28fb-4472-a7df-88d6813dd80d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeedbae558014981bfd71d6a3027e803'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:22.904665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b9982591-28fb-4472-a7df-88d6813dd80d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeedbae558014981bfd71d6a3027e803'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:22.920058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b9982591-28fb-4472-a7df-88d6813dd80d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeedbae558014981bfd71d6a3027e803'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:22.969919 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b9982591-28fb-4472-a7df-88d6813dd80d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeedbae558014981bfd71d6a3027e803'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:22.970814 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b9982591-28fb-4472-a7df-88d6813dd80d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeedbae558014981bfd71d6a3027e803'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:22.999857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1118/2233] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:22 2022] DELETE /identity/v3/users/eeedbae558014981bfd71d6a3027e803 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:23.027710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1116/2234] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:23.033665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9982591-28fb-4472-a7df-88d6813dd80d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:23.035987 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b9982591-28fb-4472-a7df-88d6813dd80d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:23.178512 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9982591-28fb-4472-a7df-88d6813dd80d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:23.183752 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fc29c-cfe9-4f63-9cba-386526c0b121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:23.185868 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fc29c-cfe9-4f63-9cba-386526c0b121 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:23.186332 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fc29c-cfe9-4f63-9cba-386526c0b121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:23.186994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fc29c-cfe9-4f63-9cba-386526c0b121 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:23.187847 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fc29c-cfe9-4f63-9cba-386526c0b121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:23.190891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fc29c-cfe9-4f63-9cba-386526c0b121 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:23.236006 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:23.248245 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1119/2235] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:23 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:23.251698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98de49-8599-47e1-b8c8-8f66c4747f12 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:23.391571 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98de49-8599-47e1-b8c8-8f66c4747f12 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:23.497113 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:23.576270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680933e5-4037-442e-8c8d-25ca85883411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:23.577293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680933e5-4037-442e-8c8d-25ca85883411 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:23.577293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680933e5-4037-442e-8c8d-25ca85883411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:23.577508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680933e5-4037-442e-8c8d-25ca85883411 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:23.578156 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680933e5-4037-442e-8c8d-25ca85883411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:23.586227 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680933e5-4037-442e-8c8d-25ca85883411 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:23.641366 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1117/2236] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:23 2022] POST /identity/v3/users => generated 293 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:23.645050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fc29c-cfe9-4f63-9cba-386526c0b121 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:23.680414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680933e5-4037-442e-8c8d-25ca85883411 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:23.685365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fc29c-cfe9-4f63-9cba-386526c0b121 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:23.687390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-680933e5-4037-442e-8c8d-25ca85883411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:23.706256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3f218-916f-4565-9300-e364335e4955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:23.707600 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3f218-916f-4565-9300-e364335e4955 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:23.707880 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3f218-916f-4565-9300-e364335e4955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:23.708250 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3f218-916f-4565-9300-e364335e4955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:23.709926 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3f218-916f-4565-9300-e364335e4955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:23.713324 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3f218-916f-4565-9300-e364335e4955 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:23.717490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680933e5-4037-442e-8c8d-25ca85883411 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:23.734397 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:23.735371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:23.735501 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:23.735755 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1120/2237] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:23.735906 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e admin admin] PATH_INFO: `/v3/projects/ad06f88c249945ecbd782a998c4ab79a` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:23.737373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc2df-a640-4ab8-afb8-d632c748a97a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:23.738695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc2df-a640-4ab8-afb8-d632c748a97a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:23.739384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad06f88c249945ecbd782a998c4ab79a)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:23.741192 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc2df-a640-4ab8-afb8-d632c748a97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:23.743944 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:23.787903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-be5cc2df-a640-4ab8-afb8-d632c748a97a None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:23.789187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-be5cc2df-a640-4ab8-afb8-d632c748a97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:23.840538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad06f88c249945ecbd782a998c4ab79a', 'request_id': 'req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:23.849254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad06f88c249945ecbd782a998c4ab79a', 'request_id': 'req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:23.858527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad06f88c249945ecbd782a998c4ab79a', 'request_id': 'req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:23.876354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e admin admin] The token cache is being invalidate because project ad06f88c249945ecbd782a998c4ab79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:23.877117 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:23.877991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:23.880864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1118/2238] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:23 2022] DELETE /identity/v3/projects/ad06f88c249945ecbd782a998c4ab79a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:23.886643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:23.889967 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:23.894861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1121/2239] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 13 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:23.898147 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e858d7-288f-4b67-b088-a93315bbe21a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:23.898380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e858d7-288f-4b67-b088-a93315bbe21a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:23.898657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e858d7-288f-4b67-b088-a93315bbe21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:23.951849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e6e858d7-288f-4b67-b088-a93315bbe21a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:23.954297 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e6e858d7-288f-4b67-b088-a93315bbe21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:23.992844 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecd5e3-024c-4089-9b04-6d2bfc15b25e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:23.999674 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc7c66-4045-4965-b8d8-8685989627e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:24.000648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc7c66-4045-4965-b8d8-8685989627e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:24.001131 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc7c66-4045-4965-b8d8-8685989627e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:24.001483 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc7c66-4045-4965-b8d8-8685989627e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:24.002215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc7c66-4045-4965-b8d8-8685989627e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:24.004660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc7c66-4045-4965-b8d8-8685989627e0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:24.016249 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1119/2240] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:24.017208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc7c66-4045-4965-b8d8-8685989627e0 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:24.026854 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-75fc7c66-4045-4965-b8d8-8685989627e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:24.107257 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1122/2241] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:24.108702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e858d7-288f-4b67-b088-a93315bbe21a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:24.110177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:24.131183 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e858d7-288f-4b67-b088-a93315bbe21a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:24.138092 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f314e-73b3-4818-9e29-5959680cf951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:24.138950 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f314e-73b3-4818-9e29-5959680cf951 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:24.139089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f314e-73b3-4818-9e29-5959680cf951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:24.139348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f314e-73b3-4818-9e29-5959680cf951 admin admin] PATH_INFO: `/v3/projects/7cce4a478c6a468b903b3346358cdea5/users/79e6d67e49dc4d82a7449b37b5a5d07c/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:24.178455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f314e-73b3-4818-9e29-5959680cf951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cce4a478c6a468b903b3346358cdea5, user_id=79e6d67e49dc4d82a7449b37b5a5d07c, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:24.181991 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f314e-73b3-4818-9e29-5959680cf951 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:24.187790 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc7c66-4045-4965-b8d8-8685989627e0 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:24.200059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1123/2242] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:24 2022] PUT /identity/v3/projects/7cce4a478c6a468b903b3346358cdea5/users/79e6d67e49dc4d82a7449b37b5a5d07c/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:24.201776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9017d7d-a95b-4ef5-8eb8-2da143c3fee5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:24.202289 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9017d7d-a95b-4ef5-8eb8-2da143c3fee5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:24.202942 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9017d7d-a95b-4ef5-8eb8-2da143c3fee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:24.242963 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b9017d7d-a95b-4ef5-8eb8-2da143c3fee5 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:24.245564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b9017d7d-a95b-4ef5-8eb8-2da143c3fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:24.346596 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdf260-7c83-48eb-b2fc-740f516a3b09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:24.347166 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdf260-7c83-48eb-b2fc-740f516a3b09 service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:24.347560 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdf260-7c83-48eb-b2fc-740f516a3b09 service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:24.347831 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdf260-7c83-48eb-b2fc-740f516a3b09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:24.366203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1124/2243] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:24.371355 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960d5b1-2775-4f78-a07f-5d701eda0566 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:24.371742 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960d5b1-2775-4f78-a07f-5d701eda0566 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:24.372105 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960d5b1-2775-4f78-a07f-5d701eda0566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:24.432675 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:24.444496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdf260-7c83-48eb-b2fc-740f516a3b09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:24.455098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdf260-7c83-48eb-b2fc-740f516a3b09 service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:24.465907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1120/2244] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:20:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 01:20:24.466829 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e960d5b1-2775-4f78-a07f-5d701eda0566 None None] MFA Rules not processed for user `79e6d67e49dc4d82a7449b37b5a5d07c`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:24.467540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdf260-7c83-48eb-b2fc-740f516a3b09 service swift] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:24.469003 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e960d5b1-2775-4f78-a07f-5d701eda0566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:24.482544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdf260-7c83-48eb-b2fc-740f516a3b09 service swift] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:24.490569 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a5156-37f1-48e0-81ba-538e8c9a79ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:24.491386 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a5156-37f1-48e0-81ba-538e8c9a79ae admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:24.491812 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a5156-37f1-48e0-81ba-538e8c9a79ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:24.492147 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a5156-37f1-48e0-81ba-538e8c9a79ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:24.492954 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a5156-37f1-48e0-81ba-538e8c9a79ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:24.493379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a5156-37f1-48e0-81ba-538e8c9a79ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:24.495399 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a5156-37f1-48e0-81ba-538e8c9a79ae admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:24.512400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1121/2245] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:24.517536 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a5156-37f1-48e0-81ba-538e8c9a79ae admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:24.565000 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a5156-37f1-48e0-81ba-538e8c9a79ae admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:24.576779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea033797-2a12-49c7-97ff-b593928d6a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:24.577419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea033797-2a12-49c7-97ff-b593928d6a8f admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:24.579763 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea033797-2a12-49c7-97ff-b593928d6a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:24.580142 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea033797-2a12-49c7-97ff-b593928d6a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:24.580821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea033797-2a12-49c7-97ff-b593928d6a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:24.583836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea033797-2a12-49c7-97ff-b593928d6a8f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:24.639632 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1125/2246] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:24.647537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960d5b1-2775-4f78-a07f-5d701eda0566 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:24.664823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1122/2247] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:24 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:24.667570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea033797-2a12-49c7-97ff-b593928d6a8f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:24.677285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960d5b1-2775-4f78-a07f-5d701eda0566 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:24.766447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:24.783176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea033797-2a12-49c7-97ff-b593928d6a8f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:24.789321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c479080-0c6b-495b-8a18-8f3b673d01f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:24.790021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c479080-0c6b-495b-8a18-8f3b673d01f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:24.790303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c479080-0c6b-495b-8a18-8f3b673d01f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:24.790574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c479080-0c6b-495b-8a18-8f3b673d01f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:24.791364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c479080-0c6b-495b-8a18-8f3b673d01f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:24.793433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c479080-0c6b-495b-8a18-8f3b673d01f2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:24.817984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73166f3a-2df7-473e-8ddd-d0f09dc2e0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:24.818739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166f3a-2df7-473e-8ddd-d0f09dc2e0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:24.819038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166f3a-2df7-473e-8ddd-d0f09dc2e0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:24.819344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166f3a-2df7-473e-8ddd-d0f09dc2e0b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:24.820037 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73166f3a-2df7-473e-8ddd-d0f09dc2e0b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:24.823375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73166f3a-2df7-473e-8ddd-d0f09dc2e0b7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:24.832377 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1123/2248] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:24 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:24.836472 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c479080-0c6b-495b-8a18-8f3b673d01f2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:24.855776 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c479080-0c6b-495b-8a18-8f3b673d01f2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:24.887390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1126/2249] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:24 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:24.892139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73166f3a-2df7-473e-8ddd-d0f09dc2e0b7 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:24.892371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd8d45-103d-4342-bad4-ddc9a7d162b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:24.893002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8d45-103d-4342-bad4-ddc9a7d162b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:24.893286 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8d45-103d-4342-bad4-ddc9a7d162b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:24.893561 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8d45-103d-4342-bad4-ddc9a7d162b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:24.894263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd8d45-103d-4342-bad4-ddc9a7d162b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:24.896225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd8d45-103d-4342-bad4-ddc9a7d162b9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:24.918539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1124/2250] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:24.922574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd8d45-103d-4342-bad4-ddc9a7d162b9 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:24.951889 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd8d45-103d-4342-bad4-ddc9a7d162b9 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:25.049923 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73166f3a-2df7-473e-8ddd-d0f09dc2e0b7 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:25.058410 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79231ca-1a52-4087-b315-bd805cad61aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:25.059165 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79231ca-1a52-4087-b315-bd805cad61aa admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:25.059520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79231ca-1a52-4087-b315-bd805cad61aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:25.059955 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79231ca-1a52-4087-b315-bd805cad61aa admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:25.060756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79231ca-1a52-4087-b315-bd805cad61aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:25.062800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79231ca-1a52-4087-b315-bd805cad61aa admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:25.063846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b120ddf-3847-4da8-849e-b7b4e78e48e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:25.065874 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b120ddf-3847-4da8-849e-b7b4e78e48e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:25.066669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b120ddf-3847-4da8-849e-b7b4e78e48e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:25.067428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b120ddf-3847-4da8-849e-b7b4e78e48e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:25.068491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b120ddf-3847-4da8-849e-b7b4e78e48e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:25.070384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b120ddf-3847-4da8-849e-b7b4e78e48e7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:25.084889 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1125/2251] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:25.086488 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31995945-c7de-416b-b20d-a43691274089 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:25.087125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31995945-c7de-416b-b20d-a43691274089 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:25.087557 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31995945-c7de-416b-b20d-a43691274089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:25.104550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1127/2252] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:24 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:25.105606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79231ca-1a52-4087-b315-bd805cad61aa admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:25.119941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79231ca-1a52-4087-b315-bd805cad61aa admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:25.121788 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-31995945-c7de-416b-b20d-a43691274089 None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:25.123241 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-31995945-c7de-416b-b20d-a43691274089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:25.126250 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1b38b-7a18-4c91-bba8-3de5872dd023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:25.127253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1b38b-7a18-4c91-bba8-3de5872dd023 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:25.127880 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1b38b-7a18-4c91-bba8-3de5872dd023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:25.140121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1b38b-7a18-4c91-bba8-3de5872dd023 admin admin] PATH_INFO: `/v3/projects/a0848b0c065f452bac7936bc951272a7/users/d199ea943e094b579f123383709e8d7e/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:25.161998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:25.168307 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1b38b-7a18-4c91-bba8-3de5872dd023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0848b0c065f452bac7936bc951272a7, user_id=d199ea943e094b579f123383709e8d7e, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:25.172328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1b38b-7a18-4c91-bba8-3de5872dd023 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:25.190388 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1128/2253] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:25 2022] PUT /identity/v3/projects/a0848b0c065f452bac7936bc951272a7/users/d199ea943e094b579f123383709e8d7e/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:25.191691 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1b38b-7a18-4c91-bba8-3de5872dd023 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:25.219773 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1126/2254] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 13 01:20:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:25.221528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43925e9-a046-4ccc-bd99-dcf67f8fc010 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:25.222041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43925e9-a046-4ccc-bd99-dcf67f8fc010 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:25.222738 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43925e9-a046-4ccc-bd99-dcf67f8fc010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:25.259252 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f43925e9-a046-4ccc-bd99-dcf67f8fc010 None None] MFA Rules not processed for user `d199ea943e094b579f123383709e8d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:25.260824 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f43925e9-a046-4ccc-bd99-dcf67f8fc010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:25.297313 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1b38b-7a18-4c91-bba8-3de5872dd023 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:25.309121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f18f69-4692-4d79-adaa-49eef5ac4a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:25.309959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f18f69-4692-4d79-adaa-49eef5ac4a25 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:25.310348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f18f69-4692-4d79-adaa-49eef5ac4a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:25.310726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f18f69-4692-4d79-adaa-49eef5ac4a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:25.311536 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f18f69-4692-4d79-adaa-49eef5ac4a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:25.314709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f18f69-4692-4d79-adaa-49eef5ac4a25 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:25.331152 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1129/2255] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:25.331152 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f18f69-4692-4d79-adaa-49eef5ac4a25 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:25.382378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1127/2256] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:25.383298 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43925e9-a046-4ccc-bd99-dcf67f8fc010 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:25.391187 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:25.399176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43925e9-a046-4ccc-bd99-dcf67f8fc010 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:25.408943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3f147-bda0-4799-b146-07c27d65212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:25.410257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3f147-bda0-4799-b146-07c27d65212f admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:25.410979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3f147-bda0-4799-b146-07c27d65212f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:25.411331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3f147-bda0-4799-b146-07c27d65212f admin admin] PATH_INFO: `/v3/projects/fb6fab0b451f4d86833796993e4fa614/users/ead797ad933c451695e56da3d55bb546/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:25.439010 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f18f69-4692-4d79-adaa-49eef5ac4a25 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:25.447723 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3f147-bda0-4799-b146-07c27d65212f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6fab0b451f4d86833796993e4fa614, user_id=ead797ad933c451695e56da3d55bb546, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:25.449131 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d15af5-0766-4e15-a17a-9773e38f7444 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:25.449762 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d15af5-0766-4e15-a17a-9773e38f7444 service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:25.450045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d15af5-0766-4e15-a17a-9773e38f7444 service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:25.450314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d15af5-0766-4e15-a17a-9773e38f7444 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:25.451822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3f147-bda0-4799-b146-07c27d65212f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:25.475887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1128/2257] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:25 2022] PUT /identity/v3/projects/fb6fab0b451f4d86833796993e4fa614/users/ead797ad933c451695e56da3d55bb546/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:25.477247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3f147-bda0-4799-b146-07c27d65212f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:25.585117 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d15af5-0766-4e15-a17a-9773e38f7444 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:25.586881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d15af5-0766-4e15-a17a-9773e38f7444 service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:25.609618 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1130/2258] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:20:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 01:20:25.616592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d15af5-0766-4e15-a17a-9773e38f7444 service swift] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:25.623566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3f147-bda0-4799-b146-07c27d65212f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:25.631317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d15af5-0766-4e15-a17a-9773e38f7444 service swift] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:25.646220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdf188-5493-4f67-a35d-5bbdca9ddde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:25.646862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdf188-5493-4f67-a35d-5bbdca9ddde8 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:25.647183 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdf188-5493-4f67-a35d-5bbdca9ddde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:25.647465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdf188-5493-4f67-a35d-5bbdca9ddde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:25.649221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdf188-5493-4f67-a35d-5bbdca9ddde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:25.652125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c77565-3aa4-46a6-99a8-50beca66cc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:25.652814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c77565-3aa4-46a6-99a8-50beca66cc93 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:25.653104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c77565-3aa4-46a6-99a8-50beca66cc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:25.653380 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c77565-3aa4-46a6-99a8-50beca66cc93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:25.653687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdf188-5493-4f67-a35d-5bbdca9ddde8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:25.655720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c77565-3aa4-46a6-99a8-50beca66cc93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:25.664274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c77565-3aa4-46a6-99a8-50beca66cc93 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:25.675973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1131/2259] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:25.684367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdf188-5493-4f67-a35d-5bbdca9ddde8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:25.703674 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdf188-5493-4f67-a35d-5bbdca9ddde8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:25.711192 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1d86c-a7b9-42a9-8c8b-124016a4127c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:25.711882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d86c-a7b9-42a9-8c8b-124016a4127c admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:25.712169 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d86c-a7b9-42a9-8c8b-124016a4127c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:25.712449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d86c-a7b9-42a9-8c8b-124016a4127c admin admin] PATH_INFO: `/v3/projects/fb6fab0b451f4d86833796993e4fa614/users/ead797ad933c451695e56da3d55bb546/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:25.714517 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1d86c-a7b9-42a9-8c8b-124016a4127c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6fab0b451f4d86833796993e4fa614, user_id=ead797ad933c451695e56da3d55bb546, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:25.717327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1d86c-a7b9-42a9-8c8b-124016a4127c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:25.735752 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1132/2260] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:25 2022] PUT /identity/v3/projects/fb6fab0b451f4d86833796993e4fa614/users/ead797ad933c451695e56da3d55bb546/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:25.739605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1129/2261] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:25 2022] POST /identity/v3/projects => generated 383 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:25.752055 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dd0ef-314d-4195-8b43-22042f1b6a64 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:25.752552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1d86c-a7b9-42a9-8c8b-124016a4127c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:25.755503 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dd0ef-314d-4195-8b43-22042f1b6a64 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:25.756519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dd0ef-314d-4195-8b43-22042f1b6a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:25.768301 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:25.865983 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-313dd0ef-314d-4195-8b43-22042f1b6a64 None None] MFA Rules not processed for user `ead797ad933c451695e56da3d55bb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:25.865983 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-313dd0ef-314d-4195-8b43-22042f1b6a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:25.988384 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1d86c-a7b9-42a9-8c8b-124016a4127c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:26.098575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1130/2262] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:26.098575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c989ee7-f23a-46c0-a947-f516c007867e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:26.098575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c989ee7-f23a-46c0-a947-f516c007867e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:26.098575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c989ee7-f23a-46c0-a947-f516c007867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:26.152620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545029f-b2f8-48b9-bbe3-cf83fa1318db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:26.153313 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545029f-b2f8-48b9-bbe3-cf83fa1318db admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:26.153526 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545029f-b2f8-48b9-bbe3-cf83fa1318db admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:26.153795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545029f-b2f8-48b9-bbe3-cf83fa1318db admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:26.154437 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545029f-b2f8-48b9-bbe3-cf83fa1318db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:26.161552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545029f-b2f8-48b9-bbe3-cf83fa1318db admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:26.172975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1c989ee7-f23a-46c0-a947-f516c007867e None None] MFA Rules not processed for user `26aad3a8d2fa462e9bedcd2a1203571c`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:26.174390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1c989ee7-f23a-46c0-a947-f516c007867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:26.210311 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1133/2263] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:25 2022] POST /identity/v3/users => generated 298 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:26.211688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545029f-b2f8-48b9-bbe3-cf83fa1318db admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:26.214641 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2545029f-b2f8-48b9-bbe3-cf83fa1318db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:26.255628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:26.295275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1131/2264] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:26.296735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c989ee7-f23a-46c0-a947-f516c007867e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:26.326873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c989ee7-f23a-46c0-a947-f516c007867e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:26.351304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4dda42-e516-45d1-a909-aea71d685a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:26.352038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dda42-e516-45d1-a909-aea71d685a08 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:26.352343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545029f-b2f8-48b9-bbe3-cf83fa1318db admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:26.352725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dda42-e516-45d1-a909-aea71d685a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:26.353932 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dda42-e516-45d1-a909-aea71d685a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:26.354698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4dda42-e516-45d1-a909-aea71d685a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:26.356865 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4dda42-e516-45d1-a909-aea71d685a08 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:26.367259 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce13edf-fab8-4ce5-9f11-7f7a3c5c6672 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:26.368139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce13edf-fab8-4ce5-9f11-7f7a3c5c6672 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:26.368620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce13edf-fab8-4ce5-9f11-7f7a3c5c6672 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:26.369091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce13edf-fab8-4ce5-9f11-7f7a3c5c6672 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:26.371368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1ce13edf-fab8-4ce5-9f11-7f7a3c5c6672 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:26.374302 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1132/2265] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:26.375571 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4dda42-e516-45d1-a909-aea71d685a08 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:26.377386 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3e4dda42-e516-45d1-a909-aea71d685a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:26.469799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:26.473924 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce13edf-fab8-4ce5-9f11-7f7a3c5c6672 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:26.476285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce13edf-fab8-4ce5-9f11-7f7a3c5c6672 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:26.491772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1134/2266] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:26.492833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce13edf-fab8-4ce5-9f11-7f7a3c5c6672 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:26.526498 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4dda42-e516-45d1-a909-aea71d685a08 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:26.543683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8015536-228c-470c-8ccd-b337c48f83fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:26.544648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8015536-228c-470c-8ccd-b337c48f83fa service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:26.545224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8015536-228c-470c-8ccd-b337c48f83fa service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:26.545693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8015536-228c-470c-8ccd-b337c48f83fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:26.548203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce13edf-fab8-4ce5-9f11-7f7a3c5c6672 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:26.558133 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fd400-d238-47cd-b249-f8e08093f029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:26.558935 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fd400-d238-47cd-b249-f8e08093f029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:26.559341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fd400-d238-47cd-b249-f8e08093f029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:26.559717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fd400-d238-47cd-b249-f8e08093f029 admin admin] PATH_INFO: `/v3/projects/2710d3c18db2451cb8d4736174885b89/users/21fc5dc5f33549eb984972935deca94a/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:26.567657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8015536-228c-470c-8ccd-b337c48f83fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:26.593406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8015536-228c-470c-8ccd-b337c48f83fa service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:26.618912 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1133/2267] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:26.620548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad890ddd-7591-4e4a-a33d-9098f648f8b6 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:26.621107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad890ddd-7591-4e4a-a33d-9098f648f8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:26.621943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad890ddd-7591-4e4a-a33d-9098f648f8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:26.655615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fd400-d238-47cd-b249-f8e08093f029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2710d3c18db2451cb8d4736174885b89, user_id=21fc5dc5f33549eb984972935deca94a, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:26.661113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fd400-d238-47cd-b249-f8e08093f029 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:26.661861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ad890ddd-7591-4e4a-a33d-9098f648f8b6 None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:26.664591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ad890ddd-7591-4e4a-a33d-9098f648f8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:26.703791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1135/2268] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:26 2022] PUT /identity/v3/projects/2710d3c18db2451cb8d4736174885b89/users/21fc5dc5f33549eb984972935deca94a/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:26.708217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fd400-d238-47cd-b249-f8e08093f029 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:26.807729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1134/2269] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 13 01:20:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:26.807729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad890ddd-7591-4e4a-a33d-9098f648f8b6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:26.820712 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ad890ddd-7591-4e4a-a33d-9098f648f8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:26.849863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad890ddd-7591-4e4a-a33d-9098f648f8b6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:26.863819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fd400-d238-47cd-b249-f8e08093f029 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:26.870780 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ab856-3fe5-422c-9e6b-8a394181c01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:26.871949 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ab856-3fe5-422c-9e6b-8a394181c01d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:26.872206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ab856-3fe5-422c-9e6b-8a394181c01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:26.872470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ab856-3fe5-422c-9e6b-8a394181c01d admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:26.873291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ab856-3fe5-422c-9e6b-8a394181c01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:26.874946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ab856-3fe5-422c-9e6b-8a394181c01d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:26.891125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1136/2270] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:20:26.892471 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ab856-3fe5-422c-9e6b-8a394181c01d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:26.957665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:26.974332 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b95da5-040c-40fe-b3b9-2b7cab07b5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:26.975718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95da5-040c-40fe-b3b9-2b7cab07b5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:26.976794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95da5-040c-40fe-b3b9-2b7cab07b5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:26.978565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95da5-040c-40fe-b3b9-2b7cab07b5ee admin admin] PATH_INFO: `/v3/users/75a3be749bb64863abf1fdb9c4fef268` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:26.980939 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b95da5-040c-40fe-b3b9-2b7cab07b5ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a3be749bb64863abf1fdb9c4fef268)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:26.987405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b95da5-040c-40fe-b3b9-2b7cab07b5ee admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:27.067450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ab856-3fe5-422c-9e6b-8a394181c01d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:27.074492 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451275bc-a572-45c3-a677-036dd9028371 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:27.076678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451275bc-a572-45c3-a677-036dd9028371 service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:27.102923 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-09b95da5-040c-40fe-b3b9-2b7cab07b5ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a3be749bb64863abf1fdb9c4fef268'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:27.103257 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451275bc-a572-45c3-a677-036dd9028371 service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:27.103970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451275bc-a572-45c3-a677-036dd9028371 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:27.104145 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-09b95da5-040c-40fe-b3b9-2b7cab07b5ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a3be749bb64863abf1fdb9c4fef268'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:27.107632 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-451275bc-a572-45c3-a677-036dd9028371 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:27.125544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-09b95da5-040c-40fe-b3b9-2b7cab07b5ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a3be749bb64863abf1fdb9c4fef268'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:27.147248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-09b95da5-040c-40fe-b3b9-2b7cab07b5ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a3be749bb64863abf1fdb9c4fef268'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:27.148529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-09b95da5-040c-40fe-b3b9-2b7cab07b5ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a3be749bb64863abf1fdb9c4fef268'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:27.195588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1135/2271] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:26 2022] DELETE /identity/v3/users/75a3be749bb64863abf1fdb9c4fef268 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:27.196783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b95da5-040c-40fe-b3b9-2b7cab07b5ee admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:27.199133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-09b95da5-040c-40fe-b3b9-2b7cab07b5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:27.249641 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451275bc-a572-45c3-a677-036dd9028371 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:27.251322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451275bc-a572-45c3-a677-036dd9028371 service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:27.268869 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1137/2272] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:20:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 01:20:27.271423 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b84106-17f5-44bf-a15f-344b6b9d4cdd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:27.271742 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b84106-17f5-44bf-a15f-344b6b9d4cdd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:27.271972 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b84106-17f5-44bf-a15f-344b6b9d4cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:27.301549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:27.335059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-67b84106-17f5-44bf-a15f-344b6b9d4cdd None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:27.336401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-67b84106-17f5-44bf-a15f-344b6b9d4cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:27.345061 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b95da5-040c-40fe-b3b9-2b7cab07b5ee admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:27.352441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eb0b9-904f-462b-b10c-3fa51855d81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:27.353089 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eb0b9-904f-462b-b10c-3fa51855d81b admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:27.353450 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eb0b9-904f-462b-b10c-3fa51855d81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:27.353841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eb0b9-904f-462b-b10c-3fa51855d81b admin admin] PATH_INFO: `/v3/projects/2710d3c18db2451cb8d4736174885b89/users/21fc5dc5f33549eb984972935deca94a/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:27.359275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1138/2273] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:27.360270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4eb0b9-904f-462b-b10c-3fa51855d81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2710d3c18db2451cb8d4736174885b89, user_id=21fc5dc5f33549eb984972935deca94a, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:27.363701 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4eb0b9-904f-462b-b10c-3fa51855d81b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:27.377674 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1136/2274] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:27 2022] PUT /identity/v3/projects/2710d3c18db2451cb8d4736174885b89/users/21fc5dc5f33549eb984972935deca94a/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:27.388004 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c18e1-5413-4718-8f63-1f9f892ce859 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:27.388414 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c18e1-5413-4718-8f63-1f9f892ce859 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:27.388915 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c18e1-5413-4718-8f63-1f9f892ce859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:27.393261 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eb0b9-904f-462b-b10c-3fa51855d81b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:27.402203 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8f4eb0b9-904f-462b-b10c-3fa51855d81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:27.466313 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-867c18e1-5413-4718-8f63-1f9f892ce859 None None] MFA Rules not processed for user `21fc5dc5f33549eb984972935deca94a`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:27.467888 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-867c18e1-5413-4718-8f63-1f9f892ce859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:27.595016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eb0b9-904f-462b-b10c-3fa51855d81b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:27.611572 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76326f-dc91-421a-8d21-33f82bacd5cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:27.612138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76326f-dc91-421a-8d21-33f82bacd5cf service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:27.612595 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76326f-dc91-421a-8d21-33f82bacd5cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:27.618034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76326f-dc91-421a-8d21-33f82bacd5cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:27.686973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1139/2275] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:27.696875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c18e1-5413-4718-8f63-1f9f892ce859 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:27.698474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-867c18e1-5413-4718-8f63-1f9f892ce859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:27.700468 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:27.808464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c18e1-5413-4718-8f63-1f9f892ce859 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:27.822844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafee2f-054c-4c1e-be42-8e23791a40db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:27.822844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafee2f-054c-4c1e-be42-8e23791a40db service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:27.822844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafee2f-054c-4c1e-be42-8e23791a40db service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:27.822844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafee2f-054c-4c1e-be42-8e23791a40db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:27.828820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5eafee2f-054c-4c1e-be42-8e23791a40db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:27.851855 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76326f-dc91-421a-8d21-33f82bacd5cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:27.853455 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76326f-dc91-421a-8d21-33f82bacd5cf service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:27.865321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1137/2276] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:27.920882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafee2f-054c-4c1e-be42-8e23791a40db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:27.922516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafee2f-054c-4c1e-be42-8e23791a40db service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:27.947290 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1140/2277] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:28.419344 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76326f-dc91-421a-8d21-33f82bacd5cf service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:28.421605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-dc76326f-dc91-421a-8d21-33f82bacd5cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:28.451006 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76326f-dc91-421a-8d21-33f82bacd5cf service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:28.481513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be835f7-0d56-470e-a4a5-833f890f0a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:28.484451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be835f7-0d56-470e-a4a5-833f890f0a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:28.486209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be835f7-0d56-470e-a4a5-833f890f0a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:28.494073 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be835f7-0d56-470e-a4a5-833f890f0a95 admin admin] PATH_INFO: `/v3/projects/71ccff6cef1b4e629cafddb4931b7a28` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:28.496948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be835f7-0d56-470e-a4a5-833f890f0a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ccff6cef1b4e629cafddb4931b7a28)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:28.499050 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be835f7-0d56-470e-a4a5-833f890f0a95 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:28.598774 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafee2f-054c-4c1e-be42-8e23791a40db service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:28.629402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafee2f-054c-4c1e-be42-8e23791a40db service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:28.639689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4be835f7-0d56-470e-a4a5-833f890f0a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ccff6cef1b4e629cafddb4931b7a28', 'request_id': 'req-4be835f7-0d56-470e-a4a5-833f890f0a95'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:28.659234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4be835f7-0d56-470e-a4a5-833f890f0a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ccff6cef1b4e629cafddb4931b7a28', 'request_id': 'req-4be835f7-0d56-470e-a4a5-833f890f0a95'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:28.670946 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4be835f7-0d56-470e-a4a5-833f890f0a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ccff6cef1b4e629cafddb4931b7a28', 'request_id': 'req-4be835f7-0d56-470e-a4a5-833f890f0a95'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:28.698957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4be835f7-0d56-470e-a4a5-833f890f0a95 admin admin] The token cache is being invalidate because project 71ccff6cef1b4e629cafddb4931b7a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:28.699590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4be835f7-0d56-470e-a4a5-833f890f0a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:28.700357 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4be835f7-0d56-470e-a4a5-833f890f0a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:28.703730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1138/2278] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:28 2022] DELETE /identity/v3/projects/71ccff6cef1b4e629cafddb4931b7a28 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:28.708365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be835f7-0d56-470e-a4a5-833f890f0a95 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:28.711910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4be835f7-0d56-470e-a4a5-833f890f0a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:28.715208 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:28.741830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d4602-92a6-4316-b545-d5b967d9366d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:28.742617 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d4602-92a6-4316-b545-d5b967d9366d service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:28.742993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d4602-92a6-4316-b545-d5b967d9366d service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:28.743444 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d4602-92a6-4316-b545-d5b967d9366d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:28.745761 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b14d4602-92a6-4316-b545-d5b967d9366d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:28.884870 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be835f7-0d56-470e-a4a5-833f890f0a95 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:28.886748 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d4602-92a6-4316-b545-d5b967d9366d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:28.888365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d4602-92a6-4316-b545-d5b967d9366d service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:28.891850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dba12-08eb-447e-a6e2-41c6dac92288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:28.892668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dba12-08eb-447e-a6e2-41c6dac92288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:28.896096 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dba12-08eb-447e-a6e2-41c6dac92288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:28.896508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dba12-08eb-447e-a6e2-41c6dac92288 admin admin] PATH_INFO: `/v3/users/508e7cac4a834c478b6d9fea21d4aec1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:28.897888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dba12-08eb-447e-a6e2-41c6dac92288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=508e7cac4a834c478b6d9fea21d4aec1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:28.900321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dba12-08eb-447e-a6e2-41c6dac92288 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:28.900819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1141/2279] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:29.015480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:29.021003 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6f4dba12-08eb-447e-a6e2-41c6dac92288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '508e7cac4a834c478b6d9fea21d4aec1'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:29.021272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6f4dba12-08eb-447e-a6e2-41c6dac92288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '508e7cac4a834c478b6d9fea21d4aec1'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:29.039295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6f4dba12-08eb-447e-a6e2-41c6dac92288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '508e7cac4a834c478b6d9fea21d4aec1'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:29.074391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6f4dba12-08eb-447e-a6e2-41c6dac92288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '508e7cac4a834c478b6d9fea21d4aec1'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:29.077393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6f4dba12-08eb-447e-a6e2-41c6dac92288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '508e7cac4a834c478b6d9fea21d4aec1'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:29.110091 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1139/2280] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:28 2022] DELETE /identity/v3/users/508e7cac4a834c478b6d9fea21d4aec1 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:29.569527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d4602-92a6-4316-b545-d5b967d9366d service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:29.589697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d4602-92a6-4316-b545-d5b967d9366d service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:29.594808 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6dd5d-e80e-429e-a21d-1d63421146b5 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:29.598103 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6dd5d-e80e-429e-a21d-1d63421146b5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:29.598539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6dd5d-e80e-429e-a21d-1d63421146b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:29.655259 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4bb6dd5d-e80e-429e-a21d-1d63421146b5 None None] MFA Rules not processed for user `26aad3a8d2fa462e9bedcd2a1203571c`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:29.657159 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4bb6dd5d-e80e-429e-a21d-1d63421146b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:29.711450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa61ba7-de3d-49fd-bf64-23086a2205fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:29.712319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa61ba7-de3d-49fd-bf64-23086a2205fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:29.712612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa61ba7-de3d-49fd-bf64-23086a2205fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:29.712892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa61ba7-de3d-49fd-bf64-23086a2205fb admin admin] PATH_INFO: `/v3/projects/61c692c769bf4a98a98cc662b99756e2` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:29.715263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa61ba7-de3d-49fd-bf64-23086a2205fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c692c769bf4a98a98cc662b99756e2)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:29.734806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa61ba7-de3d-49fd-bf64-23086a2205fb admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:29.799306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1140/2281] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:29.818294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9aa61ba7-de3d-49fd-bf64-23086a2205fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c692c769bf4a98a98cc662b99756e2', 'request_id': 'req-9aa61ba7-de3d-49fd-bf64-23086a2205fb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:29.831623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9aa61ba7-de3d-49fd-bf64-23086a2205fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c692c769bf4a98a98cc662b99756e2', 'request_id': 'req-9aa61ba7-de3d-49fd-bf64-23086a2205fb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:29.844319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9aa61ba7-de3d-49fd-bf64-23086a2205fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c692c769bf4a98a98cc662b99756e2', 'request_id': 'req-9aa61ba7-de3d-49fd-bf64-23086a2205fb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:29.885994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9aa61ba7-de3d-49fd-bf64-23086a2205fb admin admin] The token cache is being invalidate because project 61c692c769bf4a98a98cc662b99756e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:29.886405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9aa61ba7-de3d-49fd-bf64-23086a2205fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:29.888717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9aa61ba7-de3d-49fd-bf64-23086a2205fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:29.918200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1142/2282] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:29 2022] DELETE /identity/v3/projects/61c692c769bf4a98a98cc662b99756e2 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:29.922745 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96e126-fae3-4de4-abb0-8b085111008c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:29.923029 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96e126-fae3-4de4-abb0-8b085111008c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:29.923346 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96e126-fae3-4de4-abb0-8b085111008c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:29.958415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-be96e126-fae3-4de4-abb0-8b085111008c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:29.960441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-be96e126-fae3-4de4-abb0-8b085111008c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:30.080381 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1141/2283] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:30.088985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5d2f8-fe27-432d-9841-a572ad6a5495 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:30.089269 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5d2f8-fe27-432d-9841-a572ad6a5495 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:30.089846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5d2f8-fe27-432d-9841-a572ad6a5495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:30.094880 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96e126-fae3-4de4-abb0-8b085111008c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:30.105618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-be96e126-fae3-4de4-abb0-8b085111008c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:30.131444 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-49a5d2f8-fe27-432d-9841-a572ad6a5495 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:30.132987 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-49a5d2f8-fe27-432d-9841-a572ad6a5495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:30.147502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1143/2284] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:30.148665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5d2f8-fe27-432d-9841-a572ad6a5495 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:30.168162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5d2f8-fe27-432d-9841-a572ad6a5495 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:30.174640 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935526dc-16a4-4281-afad-100748d324a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:30.176287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935526dc-16a4-4281-afad-100748d324a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:30.176779 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935526dc-16a4-4281-afad-100748d324a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:30.177276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935526dc-16a4-4281-afad-100748d324a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:30.178192 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935526dc-16a4-4281-afad-100748d324a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:30.178753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935526dc-16a4-4281-afad-100748d324a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:30.180838 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935526dc-16a4-4281-afad-100748d324a9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:30.205331 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1144/2285] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:30.206726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935526dc-16a4-4281-afad-100748d324a9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:30.215094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:30.221802 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935526dc-16a4-4281-afad-100748d324a9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:30.250309 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500c68-24a6-4e98-b6ac-b1c7a2bd4bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:30.251777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500c68-24a6-4e98-b6ac-b1c7a2bd4bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:30.255841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500c68-24a6-4e98-b6ac-b1c7a2bd4bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:30.256223 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500c68-24a6-4e98-b6ac-b1c7a2bd4bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:30.257367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1500c68-24a6-4e98-b6ac-b1c7a2bd4bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:30.261820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1500c68-24a6-4e98-b6ac-b1c7a2bd4bd2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:30.272442 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96e126-fae3-4de4-abb0-8b085111008c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:30.276929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1e6a5-3b94-411c-8780-0ade38238161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:30.277630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1e6a5-3b94-411c-8780-0ade38238161 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:30.277970 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1e6a5-3b94-411c-8780-0ade38238161 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:30.278305 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1e6a5-3b94-411c-8780-0ade38238161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:30.280245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ddd1e6a5-3b94-411c-8780-0ade38238161 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:30.315756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1145/2286] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:30 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:30.317227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500c68-24a6-4e98-b6ac-b1c7a2bd4bd2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:30.319374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b1500c68-24a6-4e98-b6ac-b1c7a2bd4bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:30.326688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:30.408609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1e6a5-3b94-411c-8780-0ade38238161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:30.411320 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1e6a5-3b94-411c-8780-0ade38238161 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:30.434927 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1142/2287] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:30.437240 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500c68-24a6-4e98-b6ac-b1c7a2bd4bd2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:30.437964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1e6a5-3b94-411c-8780-0ade38238161 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:30.450881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dece23-3998-4d18-8c1f-b49762231300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:30.451428 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dece23-3998-4d18-8c1f-b49762231300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:30.451865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dece23-3998-4d18-8c1f-b49762231300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:30.452145 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dece23-3998-4d18-8c1f-b49762231300 admin admin] PATH_INFO: `/v3/users/91815c1307cf43c8a1fb6bb71add76e9` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:30.453473 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dece23-3998-4d18-8c1f-b49762231300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91815c1307cf43c8a1fb6bb71add76e9)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:30.455735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dece23-3998-4d18-8c1f-b49762231300 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:30.461794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1e6a5-3b94-411c-8780-0ade38238161 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:30.469080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e73da-b108-4452-9124-f567262b419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:30.470262 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e73da-b108-4452-9124-f567262b419a admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:30.471275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e73da-b108-4452-9124-f567262b419a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:30.471787 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e73da-b108-4452-9124-f567262b419a admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:30.473419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e73da-b108-4452-9124-f567262b419a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:30.486145 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e73da-b108-4452-9124-f567262b419a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:30.518126 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1143/2288] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:30 2022] POST /identity/v3/users => generated 289 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:30.519866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e73da-b108-4452-9124-f567262b419a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:30.530159 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c9dece23-3998-4d18-8c1f-b49762231300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91815c1307cf43c8a1fb6bb71add76e9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:30.531234 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c9dece23-3998-4d18-8c1f-b49762231300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91815c1307cf43c8a1fb6bb71add76e9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:30.535947 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e73da-b108-4452-9124-f567262b419a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:30.545150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c9dece23-3998-4d18-8c1f-b49762231300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91815c1307cf43c8a1fb6bb71add76e9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:30.550892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c42846-8453-4d96-ad41-53c2e4e5a348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:30.552015 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c42846-8453-4d96-ad41-53c2e4e5a348 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:30.552613 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c42846-8453-4d96-ad41-53c2e4e5a348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:30.553114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c42846-8453-4d96-ad41-53c2e4e5a348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:30.554234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c42846-8453-4d96-ad41-53c2e4e5a348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:30.556744 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c42846-8453-4d96-ad41-53c2e4e5a348 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:30.577983 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c9dece23-3998-4d18-8c1f-b49762231300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91815c1307cf43c8a1fb6bb71add76e9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:30.578828 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c9dece23-3998-4d18-8c1f-b49762231300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91815c1307cf43c8a1fb6bb71add76e9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:30.596411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1144/2289] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:20:30.599613 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c42846-8453-4d96-ad41-53c2e4e5a348 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:30.604328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-73c42846-8453-4d96-ad41-53c2e4e5a348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:30.605616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1146/2290] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:30 2022] DELETE /identity/v3/users/91815c1307cf43c8a1fb6bb71add76e9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:30.611346 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbe9c8-92d7-45f5-9bf9-c94dba3e98be None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:30.612000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbe9c8-92d7-45f5-9bf9-c94dba3e98be None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:30.612461 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbe9c8-92d7-45f5-9bf9-c94dba3e98be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:30.641777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ccbbe9c8-92d7-45f5-9bf9-c94dba3e98be None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:30.643352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c42846-8453-4d96-ad41-53c2e4e5a348 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:30.643723 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ccbbe9c8-92d7-45f5-9bf9-c94dba3e98be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:30.759058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b48d6c-258c-49a6-981b-21a705a1103d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:30.759794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b48d6c-258c-49a6-981b-21a705a1103d admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:30.760086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b48d6c-258c-49a6-981b-21a705a1103d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:30.760364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b48d6c-258c-49a6-981b-21a705a1103d admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:30.761176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b48d6c-258c-49a6-981b-21a705a1103d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:30.761287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1147/2291] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:30.762865 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b48d6c-258c-49a6-981b-21a705a1103d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:30.771738 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbe9c8-92d7-45f5-9bf9-c94dba3e98be None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:30.773196 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ccbbe9c8-92d7-45f5-9bf9-c94dba3e98be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:30.777738 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1145/2292] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:30.778836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b48d6c-258c-49a6-981b-21a705a1103d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:30.782500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:30.797870 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b48d6c-258c-49a6-981b-21a705a1103d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:30.806459 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea510c-2e91-4c6c-8bc7-d7706851b31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:30.807487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea510c-2e91-4c6c-8bc7-d7706851b31f admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:30.808559 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea510c-2e91-4c6c-8bc7-d7706851b31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:30.809058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea510c-2e91-4c6c-8bc7-d7706851b31f admin admin] PATH_INFO: `/v3/projects/cd3b0ed0bc174e4a8f961f01bd83c640/users/ba25f33e73654d549979575e87117e3d/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:30.829111 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea510c-2e91-4c6c-8bc7-d7706851b31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3b0ed0bc174e4a8f961f01bd83c640, user_id=ba25f33e73654d549979575e87117e3d, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:30.833375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea510c-2e91-4c6c-8bc7-d7706851b31f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:30.852881 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1146/2293] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:30 2022] PUT /identity/v3/projects/cd3b0ed0bc174e4a8f961f01bd83c640/users/ba25f33e73654d549979575e87117e3d/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:30.864245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad190bb-557d-4e80-8088-6607d763c77a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:30.864533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad190bb-557d-4e80-8088-6607d763c77a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:30.864811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad190bb-557d-4e80-8088-6607d763c77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:30.880612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbe9c8-92d7-45f5-9bf9-c94dba3e98be None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:30.899154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2ad190bb-557d-4e80-8088-6607d763c77a None None] MFA Rules not processed for user `ba25f33e73654d549979575e87117e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:30.900986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2ad190bb-557d-4e80-8088-6607d763c77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:30.966815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c6db0-4c5a-497e-a602-c9be37a7ce29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:30.968961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c6db0-4c5a-497e-a602-c9be37a7ce29 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:30.969247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c6db0-4c5a-497e-a602-c9be37a7ce29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:30.970230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c6db0-4c5a-497e-a602-c9be37a7ce29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:30.977669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:31.064506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c6db0-4c5a-497e-a602-c9be37a7ce29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:31.067482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c6db0-4c5a-497e-a602-c9be37a7ce29 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:31.085135 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1148/2294] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:31.099772 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1147/2295] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:31.104354 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c6db0-4c5a-497e-a602-c9be37a7ce29 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:31.129033 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c6db0-4c5a-497e-a602-c9be37a7ce29 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:31.165028 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ab6ff-f5e8-4090-add2-32146047c05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:31.166043 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ab6ff-f5e8-4090-add2-32146047c05b admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:31.166734 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ab6ff-f5e8-4090-add2-32146047c05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:31.167110 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ab6ff-f5e8-4090-add2-32146047c05b admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:31.167970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ab6ff-f5e8-4090-add2-32146047c05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:31.182160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ab6ff-f5e8-4090-add2-32146047c05b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:31.249954 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1149/2296] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:31 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:31.255437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad190bb-557d-4e80-8088-6607d763c77a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:31.288665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad190bb-557d-4e80-8088-6607d763c77a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:31.455101 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3110ac-66ef-43d8-b3bf-24015a9a0ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:31.455746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3110ac-66ef-43d8-b3bf-24015a9a0ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:31.456022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3110ac-66ef-43d8-b3bf-24015a9a0ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:31.456352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3110ac-66ef-43d8-b3bf-24015a9a0ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:31.456995 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3110ac-66ef-43d8-b3bf-24015a9a0ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:31.461249 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3110ac-66ef-43d8-b3bf-24015a9a0ba6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:31.524429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1148/2297] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:31 2022] POST /identity/v3/users => generated 288 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:31.526198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ab6ff-f5e8-4090-add2-32146047c05b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:31.542742 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ab6ff-f5e8-4090-add2-32146047c05b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:31.552056 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d38a5f-eb6b-47d0-b196-f1d8ec0373e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:31.552761 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d38a5f-eb6b-47d0-b196-f1d8ec0373e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:31.553148 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d38a5f-eb6b-47d0-b196-f1d8ec0373e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:31.553539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d38a5f-eb6b-47d0-b196-f1d8ec0373e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:31.554682 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d38a5f-eb6b-47d0-b196-f1d8ec0373e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:31.558441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d38a5f-eb6b-47d0-b196-f1d8ec0373e8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:31.577394 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1150/2298] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:20:31.582369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3110ac-66ef-43d8-b3bf-24015a9a0ba6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:31.609350 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d38a5f-eb6b-47d0-b196-f1d8ec0373e8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:31.615739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b5d38a5f-eb6b-47d0-b196-f1d8ec0373e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:31.628141 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3110ac-66ef-43d8-b3bf-24015a9a0ba6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:31.646683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57348484-05be-4d8b-b3d8-c7abee130d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:31.647461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57348484-05be-4d8b-b3d8-c7abee130d7b admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:31.647758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57348484-05be-4d8b-b3d8-c7abee130d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:31.648039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57348484-05be-4d8b-b3d8-c7abee130d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:31.648701 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57348484-05be-4d8b-b3d8-c7abee130d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:31.650471 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57348484-05be-4d8b-b3d8-c7abee130d7b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:31.673956 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d38a5f-eb6b-47d0-b196-f1d8ec0373e8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:31.676890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1149/2299] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:31.680795 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57348484-05be-4d8b-b3d8-c7abee130d7b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:31.689950 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf375c45-15d3-4244-be66-6543b9556138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:31.690863 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf375c45-15d3-4244-be66-6543b9556138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:31.691331 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf375c45-15d3-4244-be66-6543b9556138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:31.693939 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf375c45-15d3-4244-be66-6543b9556138 admin admin] PATH_INFO: `/v3/projects/73dc464ab5b44e2ca7ce450907f730d9` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:31.698526 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf375c45-15d3-4244-be66-6543b9556138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73dc464ab5b44e2ca7ce450907f730d9)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:31.698779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57348484-05be-4d8b-b3d8-c7abee130d7b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:31.707822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf375c45-15d3-4244-be66-6543b9556138 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:31.719136 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26e6a4-f0be-4afe-9a05-2b4eb952fab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:31.719726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26e6a4-f0be-4afe-9a05-2b4eb952fab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:31.720009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26e6a4-f0be-4afe-9a05-2b4eb952fab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:31.720293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26e6a4-f0be-4afe-9a05-2b4eb952fab9 admin admin] PATH_INFO: `/v3/projects/3832801a85d14c76afeec177206d4339/users/87454c3705754fadadf2e6143761304e/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:31.763038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26e6a4-f0be-4afe-9a05-2b4eb952fab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3832801a85d14c76afeec177206d4339, user_id=87454c3705754fadadf2e6143761304e, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:31.765820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26e6a4-f0be-4afe-9a05-2b4eb952fab9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:31.801915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1150/2300] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:31 2022] PUT /identity/v3/projects/3832801a85d14c76afeec177206d4339/users/87454c3705754fadadf2e6143761304e/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:31.813048 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3d8d4-abf5-4cb9-8829-ae6013cce17f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:31.813411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3d8d4-abf5-4cb9-8829-ae6013cce17f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:31.813727 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3d8d4-abf5-4cb9-8829-ae6013cce17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:31.827864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:31.870660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cf375c45-15d3-4244-be66-6543b9556138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73dc464ab5b44e2ca7ce450907f730d9', 'request_id': 'req-cf375c45-15d3-4244-be66-6543b9556138'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:31.884654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cf375c45-15d3-4244-be66-6543b9556138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73dc464ab5b44e2ca7ce450907f730d9', 'request_id': 'req-cf375c45-15d3-4244-be66-6543b9556138'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:31.915541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cf375c45-15d3-4244-be66-6543b9556138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73dc464ab5b44e2ca7ce450907f730d9', 'request_id': 'req-cf375c45-15d3-4244-be66-6543b9556138'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:31.918213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bfc3d8d4-abf5-4cb9-8829-ae6013cce17f None None] MFA Rules not processed for user `87454c3705754fadadf2e6143761304e`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:31.919595 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bfc3d8d4-abf5-4cb9-8829-ae6013cce17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:31.953114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cf375c45-15d3-4244-be66-6543b9556138 admin admin] The token cache is being invalidate because project 73dc464ab5b44e2ca7ce450907f730d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:31.953528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cf375c45-15d3-4244-be66-6543b9556138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:31.956085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cf375c45-15d3-4244-be66-6543b9556138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:31.959226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1151/2301] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:31 2022] DELETE /identity/v3/projects/73dc464ab5b44e2ca7ce450907f730d9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:31.966352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bee736-1bb7-4dc3-93e9-e06bade5f6cd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:31.968786 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bee736-1bb7-4dc3-93e9-e06bade5f6cd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:31.970293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bee736-1bb7-4dc3-93e9-e06bade5f6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:32.044067 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-52bee736-1bb7-4dc3-93e9-e06bade5f6cd None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:32.045654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-52bee736-1bb7-4dc3-93e9-e06bade5f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:32.138014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1151/2302] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:32.139729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3d8d4-abf5-4cb9-8829-ae6013cce17f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:32.141494 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bfc3d8d4-abf5-4cb9-8829-ae6013cce17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:32.196945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1152/2303] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:32.208017 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b03969-160c-407d-b416-c0e9fb53a5d2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:32.208745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b03969-160c-407d-b416-c0e9fb53a5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:32.208745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b03969-160c-407d-b416-c0e9fb53a5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:32.265350 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-24b03969-160c-407d-b416-c0e9fb53a5d2 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:32.266594 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-24b03969-160c-407d-b416-c0e9fb53a5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:32.288698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:32.293914 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1153/2304] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:32.298179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b03969-160c-407d-b416-c0e9fb53a5d2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:32.320624 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b03969-160c-407d-b416-c0e9fb53a5d2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:32.363724 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2b3f6-73bc-4164-868e-ac1383db918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:32.364381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2b3f6-73bc-4164-868e-ac1383db918f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:32.364777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2b3f6-73bc-4164-868e-ac1383db918f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:32.365020 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2b3f6-73bc-4164-868e-ac1383db918f admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:32.365719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2b3f6-73bc-4164-868e-ac1383db918f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:32.366029 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2b3f6-73bc-4164-868e-ac1383db918f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:32.367697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2b3f6-73bc-4164-868e-ac1383db918f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:32.386171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3d8d4-abf5-4cb9-8829-ae6013cce17f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:32.404294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6412d-3c3d-4076-8055-f30219e1b772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:32.405045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6412d-3c3d-4076-8055-f30219e1b772 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:32.405340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6412d-3c3d-4076-8055-f30219e1b772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:32.405624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6412d-3c3d-4076-8055-f30219e1b772 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:32.406261 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6412d-3c3d-4076-8055-f30219e1b772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:32.407411 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1154/2305] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:32.408309 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2b3f6-73bc-4164-868e-ac1383db918f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:32.409176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6412d-3c3d-4076-8055-f30219e1b772 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:32.426824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2b3f6-73bc-4164-868e-ac1383db918f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:32.440086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797f1d6-b86c-4c88-94a6-65830a81c278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:32.441528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797f1d6-b86c-4c88-94a6-65830a81c278 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:32.441881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797f1d6-b86c-4c88-94a6-65830a81c278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:32.442147 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797f1d6-b86c-4c88-94a6-65830a81c278 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:32.442778 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797f1d6-b86c-4c88-94a6-65830a81c278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:32.444785 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797f1d6-b86c-4c88-94a6-65830a81c278 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:32.474638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1152/2306] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:32 2022] POST /identity/v3/projects => generated 375 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:32.478791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6412d-3c3d-4076-8055-f30219e1b772 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:32.517646 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1155/2307] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:32 2022] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:32.521902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797f1d6-b86c-4c88-94a6-65830a81c278 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:32.584747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6412d-3c3d-4076-8055-f30219e1b772 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:32.647405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797f1d6-b86c-4c88-94a6-65830a81c278 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:32.653094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a049b-a2de-4feb-a2c3-d4cbbc91064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:32.654237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a049b-a2de-4feb-a2c3-d4cbbc91064f admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:32.654748 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335466-398a-4106-ad1f-6b2df791c1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:32.655288 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a049b-a2de-4feb-a2c3-d4cbbc91064f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:32.655429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a049b-a2de-4feb-a2c3-d4cbbc91064f admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:32.655613 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335466-398a-4106-ad1f-6b2df791c1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:32.655821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335466-398a-4106-ad1f-6b2df791c1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:32.656080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335466-398a-4106-ad1f-6b2df791c1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:32.656481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a049b-a2de-4feb-a2c3-d4cbbc91064f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:32.656714 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42335466-398a-4106-ad1f-6b2df791c1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:32.658744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a049b-a2de-4feb-a2c3-d4cbbc91064f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:32.659335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42335466-398a-4106-ad1f-6b2df791c1a5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:32.682945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1156/2308] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:32 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:32.687323 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a049b-a2de-4feb-a2c3-d4cbbc91064f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:32.699119 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1153/2309] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:32 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:32.699703 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a049b-a2de-4feb-a2c3-d4cbbc91064f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:32.702133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335466-398a-4106-ad1f-6b2df791c1a5 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:32.705090 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58202ef-7686-4c31-9d06-4c2b79222fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:32.705696 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58202ef-7686-4c31-9d06-4c2b79222fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:32.705972 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58202ef-7686-4c31-9d06-4c2b79222fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:32.706240 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58202ef-7686-4c31-9d06-4c2b79222fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:32.707034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58202ef-7686-4c31-9d06-4c2b79222fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:32.708800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58202ef-7686-4c31-9d06-4c2b79222fd9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:32.710511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:32.714983 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335466-398a-4106-ad1f-6b2df791c1a5 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:32.720401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f023d-871e-45db-8b74-3589059740d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:32.721123 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f023d-871e-45db-8b74-3589059740d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:32.721480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f023d-871e-45db-8b74-3589059740d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:32.721848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f023d-871e-45db-8b74-3589059740d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:32.722778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f023d-871e-45db-8b74-3589059740d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:32.724595 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f023d-871e-45db-8b74-3589059740d3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:32.726534 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1157/2310] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:32.728101 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58202ef-7686-4c31-9d06-4c2b79222fd9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:32.739144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1154/2311] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:32.739316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58202ef-7686-4c31-9d06-4c2b79222fd9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:32.741211 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f023d-871e-45db-8b74-3589059740d3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:32.743933 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185abc-014f-4c44-9d8b-b434c6b3ea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:32.744538 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185abc-014f-4c44-9d8b-b434c6b3ea0a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:32.744818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185abc-014f-4c44-9d8b-b434c6b3ea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:32.745120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185abc-014f-4c44-9d8b-b434c6b3ea0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:32.745757 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d185abc-014f-4c44-9d8b-b434c6b3ea0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:32.747382 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d185abc-014f-4c44-9d8b-b434c6b3ea0a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:32.752256 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f023d-871e-45db-8b74-3589059740d3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:32.758837 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5d0a0-bd0f-4792-8383-3a28b40c832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:32.759636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5d0a0-bd0f-4792-8383-3a28b40c832e admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:32.759912 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5d0a0-bd0f-4792-8383-3a28b40c832e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:32.760181 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5d0a0-bd0f-4792-8383-3a28b40c832e admin admin] PATH_INFO: `/v3/projects/f4d4de332aa044b6a94b13ed0d25a2c8/users/ef59b9747f0c4c08a23169e8c5be678f/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:32.761937 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1158/2312] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:32.766210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185abc-014f-4c44-9d8b-b434c6b3ea0a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:32.776637 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5d0a0-bd0f-4792-8383-3a28b40c832e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d4de332aa044b6a94b13ed0d25a2c8, user_id=ef59b9747f0c4c08a23169e8c5be678f, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:32.776827 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185abc-014f-4c44-9d8b-b434c6b3ea0a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:32.780112 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5d0a0-bd0f-4792-8383-3a28b40c832e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:32.781386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0f210-46d1-4ad7-88d5-0579f92547d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:32.782040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0f210-46d1-4ad7-88d5-0579f92547d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:32.782305 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0f210-46d1-4ad7-88d5-0579f92547d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:32.782578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0f210-46d1-4ad7-88d5-0579f92547d9 admin admin] PATH_INFO: `/v3/projects/1022eb2941a04585af706762df71e478/users/d4bc82ad8b21437d983f7d870d93794f/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:32.796495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1155/2313] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:32 2022] PUT /identity/v3/projects/f4d4de332aa044b6a94b13ed0d25a2c8/users/ef59b9747f0c4c08a23169e8c5be678f/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:32.800937 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5d0a0-bd0f-4792-8383-3a28b40c832e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:32.810048 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0f210-46d1-4ad7-88d5-0579f92547d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1022eb2941a04585af706762df71e478, user_id=d4bc82ad8b21437d983f7d870d93794f, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:32.812706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0f210-46d1-4ad7-88d5-0579f92547d9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:32.827484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1159/2314] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:32 2022] PUT /identity/v3/projects/1022eb2941a04585af706762df71e478/users/d4bc82ad8b21437d983f7d870d93794f/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:32.835687 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:32.838652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b284b-84fa-4dab-8224-b65f02f6051c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:32.839146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b284b-84fa-4dab-8224-b65f02f6051c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:32.839404 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b284b-84fa-4dab-8224-b65f02f6051c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:32.868739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5d0a0-bd0f-4792-8383-3a28b40c832e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:32.870004 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-150b284b-84fa-4dab-8224-b65f02f6051c None None] MFA Rules not processed for user `d4bc82ad8b21437d983f7d870d93794f`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:32.871201 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-150b284b-84fa-4dab-8224-b65f02f6051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:32.928957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e99e95-e925-41a1-bfb9-f88489368fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:32.929554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e99e95-e925-41a1-bfb9-f88489368fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:32.929836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e99e95-e925-41a1-bfb9-f88489368fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:32.930109 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e99e95-e925-41a1-bfb9-f88489368fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:32.930914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e99e95-e925-41a1-bfb9-f88489368fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:32.932563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e99e95-e925-41a1-bfb9-f88489368fc6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:32.942563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1160/2315] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:32.943312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1156/2316] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:20:32.947050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b284b-84fa-4dab-8224-b65f02f6051c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:32.953172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e99e95-e925-41a1-bfb9-f88489368fc6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:32.954997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-40e99e95-e925-41a1-bfb9-f88489368fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:32.958272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b284b-84fa-4dab-8224-b65f02f6051c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:32.963387 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3de9bb-35ce-4238-9323-e33ba9844d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:32.964038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3de9bb-35ce-4238-9323-e33ba9844d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:32.964311 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3de9bb-35ce-4238-9323-e33ba9844d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:32.964573 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3de9bb-35ce-4238-9323-e33ba9844d8a admin admin] PATH_INFO: `/v3/projects/f4d4de332aa044b6a94b13ed0d25a2c8/users/ef59b9747f0c4c08a23169e8c5be678f/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:32.966457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3de9bb-35ce-4238-9323-e33ba9844d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d4de332aa044b6a94b13ed0d25a2c8, user_id=ef59b9747f0c4c08a23169e8c5be678f, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:32.969086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3de9bb-35ce-4238-9323-e33ba9844d8a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:32.980478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1161/2317] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:32 2022] PUT /identity/v3/projects/f4d4de332aa044b6a94b13ed0d25a2c8/users/ef59b9747f0c4c08a23169e8c5be678f/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:32.992789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c373f-8efe-4acf-ae3a-e5bf0b9fcfc9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:32.993172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c373f-8efe-4acf-ae3a-e5bf0b9fcfc9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:32.993528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c373f-8efe-4acf-ae3a-e5bf0b9fcfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:33.014856 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e99e95-e925-41a1-bfb9-f88489368fc6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:33.027866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-442c373f-8efe-4acf-ae3a-e5bf0b9fcfc9 None None] MFA Rules not processed for user `ef59b9747f0c4c08a23169e8c5be678f`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:33.029080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-442c373f-8efe-4acf-ae3a-e5bf0b9fcfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:33.070488 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e278517-8e03-4707-a842-49a889013c85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:33.071008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e278517-8e03-4707-a842-49a889013c85 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:33.071356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e278517-8e03-4707-a842-49a889013c85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:33.071632 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e278517-8e03-4707-a842-49a889013c85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:33.123406 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1162/2318] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:33.124420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:33.141916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c373f-8efe-4acf-ae3a-e5bf0b9fcfc9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:33.144698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-442c373f-8efe-4acf-ae3a-e5bf0b9fcfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:33.159390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e278517-8e03-4707-a842-49a889013c85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:33.161373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e278517-8e03-4707-a842-49a889013c85 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:33.163871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c373f-8efe-4acf-ae3a-e5bf0b9fcfc9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:33.170141 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4775bad-3691-4100-a0b3-7ba6ebd70f8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:33.170785 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4775bad-3691-4100-a0b3-7ba6ebd70f8c service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:33.171279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4775bad-3691-4100-a0b3-7ba6ebd70f8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:33.171674 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4775bad-3691-4100-a0b3-7ba6ebd70f8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:33.173642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1157/2319] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:33.183618 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f4775bad-3691-4100-a0b3-7ba6ebd70f8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:33.241691 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:33.294445 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4775bad-3691-4100-a0b3-7ba6ebd70f8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:33.296287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4775bad-3691-4100-a0b3-7ba6ebd70f8c service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:33.307632 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1163/2320] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:33.754502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e278517-8e03-4707-a842-49a889013c85 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:33.764297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e278517-8e03-4707-a842-49a889013c85 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:33.773543 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c723a-2a28-4f7b-9e4f-46badd1de153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:33.774257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c723a-2a28-4f7b-9e4f-46badd1de153 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:33.774639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c723a-2a28-4f7b-9e4f-46badd1de153 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:33.775015 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c723a-2a28-4f7b-9e4f-46badd1de153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:33.776955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c85c723a-2a28-4f7b-9e4f-46badd1de153 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:33.842941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c723a-2a28-4f7b-9e4f-46badd1de153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:33.844343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c723a-2a28-4f7b-9e4f-46badd1de153 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:33.855400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1158/2321] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:36.137826 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4775bad-3691-4100-a0b3-7ba6ebd70f8c service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:36.148953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4775bad-3691-4100-a0b3-7ba6ebd70f8c service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:36.152698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d917ae-03af-46a2-84a6-f90989d424ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:36.153308 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d917ae-03af-46a2-84a6-f90989d424ec service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:36.153584 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d917ae-03af-46a2-84a6-f90989d424ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:36.153852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d917ae-03af-46a2-84a6-f90989d424ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:36.216303 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d917ae-03af-46a2-84a6-f90989d424ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:36.218101 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d917ae-03af-46a2-84a6-f90989d424ec service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:36.229403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1164/2322] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:36.372758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c723a-2a28-4f7b-9e4f-46badd1de153 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:36.375304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c85c723a-2a28-4f7b-9e4f-46badd1de153 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:36.492807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c723a-2a28-4f7b-9e4f-46badd1de153 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:36.499401 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e414d-2e49-4e6a-9187-d1c425bf64a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:36.500524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e414d-2e49-4e6a-9187-d1c425bf64a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:36.501591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e414d-2e49-4e6a-9187-d1c425bf64a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:36.502207 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e414d-2e49-4e6a-9187-d1c425bf64a2 admin admin] PATH_INFO: `/v3/users/764be6e1a12f4931a08d01ad32c8b8ef` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:36.504492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e414d-2e49-4e6a-9187-d1c425bf64a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=764be6e1a12f4931a08d01ad32c8b8ef)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:36.506565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e414d-2e49-4e6a-9187-d1c425bf64a2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:36.590740 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-956e414d-2e49-4e6a-9187-d1c425bf64a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764be6e1a12f4931a08d01ad32c8b8ef'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:36.591569 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-956e414d-2e49-4e6a-9187-d1c425bf64a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764be6e1a12f4931a08d01ad32c8b8ef'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:36.601968 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-956e414d-2e49-4e6a-9187-d1c425bf64a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764be6e1a12f4931a08d01ad32c8b8ef'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:36.617084 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:36.619090 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-956e414d-2e49-4e6a-9187-d1c425bf64a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764be6e1a12f4931a08d01ad32c8b8ef'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:36.620400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-956e414d-2e49-4e6a-9187-d1c425bf64a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764be6e1a12f4931a08d01ad32c8b8ef'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:36.643729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1159/2323] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:36 2022] DELETE /identity/v3/users/764be6e1a12f4931a08d01ad32c8b8ef => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:36.649001 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550bf91-86db-4567-8152-472d835e72f9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:36.649537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550bf91-86db-4567-8152-472d835e72f9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:36.649902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550bf91-86db-4567-8152-472d835e72f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:36.673268 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7550bf91-86db-4567-8152-472d835e72f9 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:36.674638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7550bf91-86db-4567-8152-472d835e72f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:36.750280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1165/2324] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:36.761537 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e414d-2e49-4e6a-9187-d1c425bf64a2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:36.763177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-956e414d-2e49-4e6a-9187-d1c425bf64a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:36.842168 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e414d-2e49-4e6a-9187-d1c425bf64a2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:36.846487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b035803-16bc-4aa5-9868-0211e6547601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:36.847562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b035803-16bc-4aa5-9868-0211e6547601 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:36.848037 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b035803-16bc-4aa5-9868-0211e6547601 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:36.848318 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b035803-16bc-4aa5-9868-0211e6547601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:36.861009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b035803-16bc-4aa5-9868-0211e6547601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:36.862479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b035803-16bc-4aa5-9868-0211e6547601 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:36.873394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1160/2325] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:37.027318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550bf91-86db-4567-8152-472d835e72f9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:37.031701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7550bf91-86db-4567-8152-472d835e72f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:37.095226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550bf91-86db-4567-8152-472d835e72f9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:37.099215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db50763-0499-452f-b3f3-7eee7130beee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:37.099860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db50763-0499-452f-b3f3-7eee7130beee service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:37.100142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db50763-0499-452f-b3f3-7eee7130beee service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:37.100421 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db50763-0499-452f-b3f3-7eee7130beee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:37.102526 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0db50763-0499-452f-b3f3-7eee7130beee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:37.116879 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:37.189507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db50763-0499-452f-b3f3-7eee7130beee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:37.192234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b035803-16bc-4aa5-9868-0211e6547601 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:37.192839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db50763-0499-452f-b3f3-7eee7130beee service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:37.194095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5b035803-16bc-4aa5-9868-0211e6547601 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:37.210877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1166/2326] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:37.212997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b035803-16bc-4aa5-9868-0211e6547601 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:37.219389 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504e082-d388-490a-9dbd-27cba7ebf767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:37.220121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504e082-d388-490a-9dbd-27cba7ebf767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:37.220557 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504e082-d388-490a-9dbd-27cba7ebf767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:37.221103 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504e082-d388-490a-9dbd-27cba7ebf767 admin admin] PATH_INFO: `/v3/projects/5cb6bfdebc484ae8a01e1e91faacbb2a` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:37.222935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504e082-d388-490a-9dbd-27cba7ebf767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cb6bfdebc484ae8a01e1e91faacbb2a)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:37.226782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504e082-d388-490a-9dbd-27cba7ebf767 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:37.288492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c504e082-d388-490a-9dbd-27cba7ebf767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cb6bfdebc484ae8a01e1e91faacbb2a', 'request_id': 'req-c504e082-d388-490a-9dbd-27cba7ebf767'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:37.295329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c504e082-d388-490a-9dbd-27cba7ebf767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cb6bfdebc484ae8a01e1e91faacbb2a', 'request_id': 'req-c504e082-d388-490a-9dbd-27cba7ebf767'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:37.302396 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c504e082-d388-490a-9dbd-27cba7ebf767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cb6bfdebc484ae8a01e1e91faacbb2a', 'request_id': 'req-c504e082-d388-490a-9dbd-27cba7ebf767'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:37.318829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c504e082-d388-490a-9dbd-27cba7ebf767 admin admin] The token cache is being invalidate because project 5cb6bfdebc484ae8a01e1e91faacbb2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:37.319310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c504e082-d388-490a-9dbd-27cba7ebf767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:37.320170 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c504e082-d388-490a-9dbd-27cba7ebf767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:37.323616 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1161/2327] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:37 2022] DELETE /identity/v3/projects/5cb6bfdebc484ae8a01e1e91faacbb2a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:37.327714 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db50763-0499-452f-b3f3-7eee7130beee service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:37.349676 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db50763-0499-452f-b3f3-7eee7130beee service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:37.449206 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1936f-9532-4835-aae1-dc5548608349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:37.449844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1936f-9532-4835-aae1-dc5548608349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:37.450120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1936f-9532-4835-aae1-dc5548608349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:37.450452 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1936f-9532-4835-aae1-dc5548608349 admin admin] PATH_INFO: `/v3/users/79e6d67e49dc4d82a7449b37b5a5d07c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:37.451789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1936f-9532-4835-aae1-dc5548608349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79e6d67e49dc4d82a7449b37b5a5d07c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:37.453882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1936f-9532-4835-aae1-dc5548608349 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:37.522858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fdb1936f-9532-4835-aae1-dc5548608349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e6d67e49dc4d82a7449b37b5a5d07c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:37.523701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fdb1936f-9532-4835-aae1-dc5548608349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e6d67e49dc4d82a7449b37b5a5d07c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:37.531033 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fdb1936f-9532-4835-aae1-dc5548608349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e6d67e49dc4d82a7449b37b5a5d07c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:37.546855 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fdb1936f-9532-4835-aae1-dc5548608349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e6d67e49dc4d82a7449b37b5a5d07c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:37.548269 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fdb1936f-9532-4835-aae1-dc5548608349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e6d67e49dc4d82a7449b37b5a5d07c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:37.563558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1167/2328] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:37 2022] DELETE /identity/v3/users/79e6d67e49dc4d82a7449b37b5a5d07c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:37.874159 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504e082-d388-490a-9dbd-27cba7ebf767 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:37.875656 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c504e082-d388-490a-9dbd-27cba7ebf767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:37.891830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504e082-d388-490a-9dbd-27cba7ebf767 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:37.953346 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:37.953976 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:37.954252 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:37.954522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481 admin admin] PATH_INFO: `/v3/projects/7cce4a478c6a468b903b3346358cdea5` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:37.955675 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cce4a478c6a468b903b3346358cdea5)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:37.957951 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:37.975402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:38.007531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cce4a478c6a468b903b3346358cdea5', 'request_id': 'req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:38.013712 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cce4a478c6a468b903b3346358cdea5', 'request_id': 'req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:38.019435 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cce4a478c6a468b903b3346358cdea5', 'request_id': 'req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:38.031864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481 admin admin] The token cache is being invalidate because project 7cce4a478c6a468b903b3346358cdea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:38.032087 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:38.032705 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:38.034173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1162/2329] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:37 2022] DELETE /identity/v3/projects/7cce4a478c6a468b903b3346358cdea5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:38.038184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1936f-9532-4835-aae1-dc5548608349 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:38.039826 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fdb1936f-9532-4835-aae1-dc5548608349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:38.054381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1936f-9532-4835-aae1-dc5548608349 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:38.083877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:38.116498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d1ce4-491a-4618-b8b2-dfdd95a3f59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:38.117129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d1ce4-491a-4618-b8b2-dfdd95a3f59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:38.117407 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d1ce4-491a-4618-b8b2-dfdd95a3f59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:38.117679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d1ce4-491a-4618-b8b2-dfdd95a3f59b admin admin] PATH_INFO: `/v3/users/ead797ad933c451695e56da3d55bb546` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:38.118780 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d1ce4-491a-4618-b8b2-dfdd95a3f59b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead797ad933c451695e56da3d55bb546)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:38.120740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d1ce4-491a-4618-b8b2-dfdd95a3f59b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:38.167829 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d47d1ce4-491a-4618-b8b2-dfdd95a3f59b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead797ad933c451695e56da3d55bb546'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:38.168482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d47d1ce4-491a-4618-b8b2-dfdd95a3f59b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead797ad933c451695e56da3d55bb546'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:38.176145 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d47d1ce4-491a-4618-b8b2-dfdd95a3f59b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead797ad933c451695e56da3d55bb546'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:38.188204 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d47d1ce4-491a-4618-b8b2-dfdd95a3f59b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead797ad933c451695e56da3d55bb546'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:38.188849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d47d1ce4-491a-4618-b8b2-dfdd95a3f59b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead797ad933c451695e56da3d55bb546'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:38.201583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1168/2330] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:38 2022] DELETE /identity/v3/users/ead797ad933c451695e56da3d55bb546 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:38.494611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:38.496128 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:38.521530 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9bd74-3d4d-45bc-b2b3-639b4c936481 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:38.605399 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea10bb-b4b2-4a38-b11d-4f2b9085ed2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:38.606191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea10bb-b4b2-4a38-b11d-4f2b9085ed2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:38.606368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea10bb-b4b2-4a38-b11d-4f2b9085ed2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:38.606796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea10bb-b4b2-4a38-b11d-4f2b9085ed2c admin admin] PATH_INFO: `/v3/projects/fb6fab0b451f4d86833796993e4fa614` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:38.608169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea10bb-b4b2-4a38-b11d-4f2b9085ed2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6fab0b451f4d86833796993e4fa614)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:38.610747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea10bb-b4b2-4a38-b11d-4f2b9085ed2c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:38.677545 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-76ea10bb-b4b2-4a38-b11d-4f2b9085ed2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6fab0b451f4d86833796993e4fa614', 'request_id': 'req-76ea10bb-b4b2-4a38-b11d-4f2b9085ed2c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:38.689612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-76ea10bb-b4b2-4a38-b11d-4f2b9085ed2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6fab0b451f4d86833796993e4fa614', 'request_id': 'req-76ea10bb-b4b2-4a38-b11d-4f2b9085ed2c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:38.698668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-76ea10bb-b4b2-4a38-b11d-4f2b9085ed2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6fab0b451f4d86833796993e4fa614', 'request_id': 'req-76ea10bb-b4b2-4a38-b11d-4f2b9085ed2c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:38.715948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-76ea10bb-b4b2-4a38-b11d-4f2b9085ed2c admin admin] The token cache is being invalidate because project fb6fab0b451f4d86833796993e4fa614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:38.716247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-76ea10bb-b4b2-4a38-b11d-4f2b9085ed2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:38.728658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-76ea10bb-b4b2-4a38-b11d-4f2b9085ed2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:38.734851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1163/2331] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:38 2022] DELETE /identity/v3/projects/fb6fab0b451f4d86833796993e4fa614 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:38.739713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3416a2-839c-4141-b07b-6dc3d7a3421d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:38.740027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3416a2-839c-4141-b07b-6dc3d7a3421d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:38.740309 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3416a2-839c-4141-b07b-6dc3d7a3421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:38.767875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3b3416a2-839c-4141-b07b-6dc3d7a3421d None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:38.769172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3b3416a2-839c-4141-b07b-6dc3d7a3421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:38.855355 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1169/2332] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:38.858493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbad4e-c27e-43f9-b865-346b8d980081 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:38.859394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbad4e-c27e-43f9-b865-346b8d980081 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:38.859878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbad4e-c27e-43f9-b865-346b8d980081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:38.886382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-32fbad4e-c27e-43f9-b865-346b8d980081 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:38.889250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-32fbad4e-c27e-43f9-b865-346b8d980081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:38.907813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1164/2333] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:38.912502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3416a2-839c-4141-b07b-6dc3d7a3421d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:38.928753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3416a2-839c-4141-b07b-6dc3d7a3421d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:38.935112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a521c95-5178-467e-8aac-611e2aa6b285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:38.935112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a521c95-5178-467e-8aac-611e2aa6b285 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:38.935112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a521c95-5178-467e-8aac-611e2aa6b285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:38.935112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a521c95-5178-467e-8aac-611e2aa6b285 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:38.936099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a521c95-5178-467e-8aac-611e2aa6b285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:38.936512 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a521c95-5178-467e-8aac-611e2aa6b285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:38.938264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a521c95-5178-467e-8aac-611e2aa6b285 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:38.956828 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1170/2334] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:20:38.958187 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbad4e-c27e-43f9-b865-346b8d980081 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:38.969321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbad4e-c27e-43f9-b865-346b8d980081 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:38.974935 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dbfa7-a062-4a21-b4ee-8a989fb6fa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:38.975640 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dbfa7-a062-4a21-b4ee-8a989fb6fa5c admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:38.975916 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dbfa7-a062-4a21-b4ee-8a989fb6fa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:38.976184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dbfa7-a062-4a21-b4ee-8a989fb6fa5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:38.976848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dbfa7-a062-4a21-b4ee-8a989fb6fa5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:38.980929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dbfa7-a062-4a21-b4ee-8a989fb6fa5c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:39.020324 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1165/2335] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:38 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:39.024031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a521c95-5178-467e-8aac-611e2aa6b285 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:39.034119 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a521c95-5178-467e-8aac-611e2aa6b285 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:39.067474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:39.093545 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8f52a-1fe3-4b1e-8f78-43e4bfa83d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:39.094089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f52a-1fe3-4b1e-8f78-43e4bfa83d60 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:39.094372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f52a-1fe3-4b1e-8f78-43e4bfa83d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:39.094647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f52a-1fe3-4b1e-8f78-43e4bfa83d60 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:39.095309 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8f52a-1fe3-4b1e-8f78-43e4bfa83d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:39.098026 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8f52a-1fe3-4b1e-8f78-43e4bfa83d60 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:39.118767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1171/2336] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:39 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:39.122942 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dbfa7-a062-4a21-b4ee-8a989fb6fa5c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:39.133522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dbfa7-a062-4a21-b4ee-8a989fb6fa5c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:39.138345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807b57f-7fbe-4d60-aa1e-a48e7f440df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:39.138952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807b57f-7fbe-4d60-aa1e-a48e7f440df7 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:39.139260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807b57f-7fbe-4d60-aa1e-a48e7f440df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:39.139538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807b57f-7fbe-4d60-aa1e-a48e7f440df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:39.140208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807b57f-7fbe-4d60-aa1e-a48e7f440df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:39.141893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807b57f-7fbe-4d60-aa1e-a48e7f440df7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:39.143329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:39.155108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1166/2337] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:39.158833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8f52a-1fe3-4b1e-8f78-43e4bfa83d60 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:39.169648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8f52a-1fe3-4b1e-8f78-43e4bfa83d60 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:39.174299 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2884816-dc96-4659-a3b3-4898cf866e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:39.174894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2884816-dc96-4659-a3b3-4898cf866e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:39.175759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2884816-dc96-4659-a3b3-4898cf866e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:39.176033 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2884816-dc96-4659-a3b3-4898cf866e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:39.176672 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2884816-dc96-4659-a3b3-4898cf866e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:39.178251 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2884816-dc96-4659-a3b3-4898cf866e71 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:39.188502 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1172/2338] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:39.193225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807b57f-7fbe-4d60-aa1e-a48e7f440df7 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:39.203330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807b57f-7fbe-4d60-aa1e-a48e7f440df7 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:39.208063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6edba-5639-4385-9d3d-48771431a70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:39.208747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6edba-5639-4385-9d3d-48771431a70e admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:39.209021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6edba-5639-4385-9d3d-48771431a70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:39.209296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6edba-5639-4385-9d3d-48771431a70e admin admin] PATH_INFO: `/v3/projects/86fe78cbdc3e4dada5eb2a80d1ed4789/users/e0c011df3b044ee0b2d069fb1527e876/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:39.224410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6edba-5639-4385-9d3d-48771431a70e admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fe78cbdc3e4dada5eb2a80d1ed4789, user_id=e0c011df3b044ee0b2d069fb1527e876, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:39.227114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6edba-5639-4385-9d3d-48771431a70e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:39.240374 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1167/2339] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:39 2022] PUT /identity/v3/projects/86fe78cbdc3e4dada5eb2a80d1ed4789/users/e0c011df3b044ee0b2d069fb1527e876/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:39.251651 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecde48f-7263-4186-abf2-fce64ede50a6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:39.252124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecde48f-7263-4186-abf2-fce64ede50a6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:39.252261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecde48f-7263-4186-abf2-fce64ede50a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:39.280901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7ecde48f-7263-4186-abf2-fce64ede50a6 None None] MFA Rules not processed for user `e0c011df3b044ee0b2d069fb1527e876`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:39.282112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7ecde48f-7263-4186-abf2-fce64ede50a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:39.349261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1173/2340] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:39.353787 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6edba-5639-4385-9d3d-48771431a70e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:39.426753 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6edba-5639-4385-9d3d-48771431a70e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:39.431541 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00658022-038d-435f-8bc0-e82acd88f15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:39.432145 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00658022-038d-435f-8bc0-e82acd88f15b admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:39.432447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00658022-038d-435f-8bc0-e82acd88f15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:39.432717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00658022-038d-435f-8bc0-e82acd88f15b admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:39.433352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00658022-038d-435f-8bc0-e82acd88f15b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:39.435534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00658022-038d-435f-8bc0-e82acd88f15b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:39.465067 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1168/2341] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:39 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:39.469398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecde48f-7263-4186-abf2-fce64ede50a6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:39.482508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecde48f-7263-4186-abf2-fce64ede50a6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:39.543182 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ab91c-019d-4282-b596-c4a72ad01580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:39.544282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ab91c-019d-4282-b596-c4a72ad01580 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:39.544630 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ab91c-019d-4282-b596-c4a72ad01580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:39.545071 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ab91c-019d-4282-b596-c4a72ad01580 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:39.545725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ab91c-019d-4282-b596-c4a72ad01580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:39.547657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ab91c-019d-4282-b596-c4a72ad01580 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:39.572997 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1174/2342] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:39 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:39.574644 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00658022-038d-435f-8bc0-e82acd88f15b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:39.586039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00658022-038d-435f-8bc0-e82acd88f15b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:39.590620 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f1fe3-fd38-46f4-a60b-1c57cb4ab77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:39.591752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f1fe3-fd38-46f4-a60b-1c57cb4ab77f admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:39.592035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f1fe3-fd38-46f4-a60b-1c57cb4ab77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:39.592308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f1fe3-fd38-46f4-a60b-1c57cb4ab77f admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:39.592946 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f1fe3-fd38-46f4-a60b-1c57cb4ab77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:39.594544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f1fe3-fd38-46f4-a60b-1c57cb4ab77f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:39.606275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1169/2343] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:39.610303 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ab91c-019d-4282-b596-c4a72ad01580 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:39.621068 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ab91c-019d-4282-b596-c4a72ad01580 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:39.625658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a1437-5be1-41ad-a9f1-f034f6296b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:39.626271 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a1437-5be1-41ad-a9f1-f034f6296b4d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:39.626534 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a1437-5be1-41ad-a9f1-f034f6296b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:39.626811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a1437-5be1-41ad-a9f1-f034f6296b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:39.627608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a1437-5be1-41ad-a9f1-f034f6296b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:39.629690 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a1437-5be1-41ad-a9f1-f034f6296b4d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:39.643205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1175/2344] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:39.645608 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f1fe3-fd38-46f4-a60b-1c57cb4ab77f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:39.656140 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f1fe3-fd38-46f4-a60b-1c57cb4ab77f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:39.661225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f48e5-b722-4136-8cac-f4127f086429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:39.661916 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f48e5-b722-4136-8cac-f4127f086429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:39.662192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f48e5-b722-4136-8cac-f4127f086429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:39.662472 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f48e5-b722-4136-8cac-f4127f086429 admin admin] PATH_INFO: `/v3/projects/5aad52636bba4b76b194fd378a166923/users/fe22f472fccb4215847f95eb457542f4/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:39.682709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f48e5-b722-4136-8cac-f4127f086429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aad52636bba4b76b194fd378a166923, user_id=fe22f472fccb4215847f95eb457542f4, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:39.685441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f48e5-b722-4136-8cac-f4127f086429 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:39.701747 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1170/2345] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:39 2022] PUT /identity/v3/projects/5aad52636bba4b76b194fd378a166923/users/fe22f472fccb4215847f95eb457542f4/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:39.712555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4f880-3ba7-4248-a136-2c35c883e173 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:39.712850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4f880-3ba7-4248-a136-2c35c883e173 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:39.713128 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4f880-3ba7-4248-a136-2c35c883e173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:39.743218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-81e4f880-3ba7-4248-a136-2c35c883e173 None None] MFA Rules not processed for user `fe22f472fccb4215847f95eb457542f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:39.744674 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-81e4f880-3ba7-4248-a136-2c35c883e173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:39.755698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:39.818495 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1176/2346] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:39.822920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f48e5-b722-4136-8cac-f4127f086429 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:39.899338 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f48e5-b722-4136-8cac-f4127f086429 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:39.904204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b6ca9-7725-4b7b-aeb4-de1eb0bcb88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:39.904821 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b6ca9-7725-4b7b-aeb4-de1eb0bcb88e admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:39.905105 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b6ca9-7725-4b7b-aeb4-de1eb0bcb88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:39.905375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b6ca9-7725-4b7b-aeb4-de1eb0bcb88e admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:39.906021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b6ca9-7725-4b7b-aeb4-de1eb0bcb88e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:39.907952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b6ca9-7725-4b7b-aeb4-de1eb0bcb88e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:39.938822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1171/2347] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:39 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:39.945083 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4f880-3ba7-4248-a136-2c35c883e173 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:39.958059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4f880-3ba7-4248-a136-2c35c883e173 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:40.071145 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b9fdb-bc4e-4aa8-aefd-50c04023a601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:40.071888 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b9fdb-bc4e-4aa8-aefd-50c04023a601 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:40.072179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b9fdb-bc4e-4aa8-aefd-50c04023a601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:40.072457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b9fdb-bc4e-4aa8-aefd-50c04023a601 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:40.076231 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b9fdb-bc4e-4aa8-aefd-50c04023a601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:40.076231 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b9fdb-bc4e-4aa8-aefd-50c04023a601 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:40.079700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b6ca9-7725-4b7b-aeb4-de1eb0bcb88e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:40.081768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4c0b6ca9-7725-4b7b-aeb4-de1eb0bcb88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:40.111911 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b6ca9-7725-4b7b-aeb4-de1eb0bcb88e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:40.127645 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02e8f0-c58e-4f0f-976b-f1a72812f419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:40.130932 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02e8f0-c58e-4f0f-976b-f1a72812f419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:40.131251 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02e8f0-c58e-4f0f-976b-f1a72812f419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:40.131533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02e8f0-c58e-4f0f-976b-f1a72812f419 admin admin] PATH_INFO: `/v3/users/d199ea943e094b579f123383709e8d7e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:40.134780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02e8f0-c58e-4f0f-976b-f1a72812f419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d199ea943e094b579f123383709e8d7e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:40.143730 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1177/2348] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:39 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:40.144131 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02e8f0-c58e-4f0f-976b-f1a72812f419 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:40.144855 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:40.144996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b9fdb-bc4e-4aa8-aefd-50c04023a601 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:40.163960 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b9fdb-bc4e-4aa8-aefd-50c04023a601 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:40.169904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e36710-6b1d-497c-846c-1dbdc3629a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:40.170639 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e36710-6b1d-497c-846c-1dbdc3629a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:40.170988 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e36710-6b1d-497c-846c-1dbdc3629a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:40.171365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e36710-6b1d-497c-846c-1dbdc3629a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:40.172184 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e36710-6b1d-497c-846c-1dbdc3629a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:40.173986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e36710-6b1d-497c-846c-1dbdc3629a96 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:40.192558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1178/2349] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:40.198380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e36710-6b1d-497c-846c-1dbdc3629a96 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:40.223953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e36710-6b1d-497c-846c-1dbdc3629a96 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:40.234493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca319c-970d-420d-a0ca-19de6477461f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:40.235279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca319c-970d-420d-a0ca-19de6477461f admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:40.235597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca319c-970d-420d-a0ca-19de6477461f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:40.235876 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca319c-970d-420d-a0ca-19de6477461f admin admin] PATH_INFO: `/v3/projects/444254be05184eb09b8bb10b57a4a377/users/da64be1188ed4f738981f182699d9961/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:40.251636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9a02e8f0-c58e-4f0f-976b-f1a72812f419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd199ea943e094b579f123383709e8d7e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:40.254940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9a02e8f0-c58e-4f0f-976b-f1a72812f419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd199ea943e094b579f123383709e8d7e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:40.275099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca319c-970d-420d-a0ca-19de6477461f admin admin] RBAC: Authorizing `identity:create_grant(project_id=444254be05184eb09b8bb10b57a4a377, user_id=da64be1188ed4f738981f182699d9961, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:40.276058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9a02e8f0-c58e-4f0f-976b-f1a72812f419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd199ea943e094b579f123383709e8d7e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:40.278488 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca319c-970d-420d-a0ca-19de6477461f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:40.301050 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9a02e8f0-c58e-4f0f-976b-f1a72812f419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd199ea943e094b579f123383709e8d7e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:40.302393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9a02e8f0-c58e-4f0f-976b-f1a72812f419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd199ea943e094b579f123383709e8d7e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:40.306140 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1179/2350] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:40 2022] PUT /identity/v3/projects/444254be05184eb09b8bb10b57a4a377/users/da64be1188ed4f738981f182699d9961/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:40.310840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca319c-970d-420d-a0ca-19de6477461f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:40.315375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-53ca319c-970d-420d-a0ca-19de6477461f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:40.322384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1172/2351] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:40 2022] DELETE /identity/v3/users/d199ea943e094b579f123383709e8d7e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:40.325871 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaadd11-d3d1-49a9-8cfc-245de2145972 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:40.326158 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaadd11-d3d1-49a9-8cfc-245de2145972 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:40.326428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaadd11-d3d1-49a9-8cfc-245de2145972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:40.363769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-abaadd11-d3d1-49a9-8cfc-245de2145972 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:40.367192 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-abaadd11-d3d1-49a9-8cfc-245de2145972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:40.451841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca319c-970d-420d-a0ca-19de6477461f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:40.464459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:40.495106 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1173/2352] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:40.506596 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaadd11-d3d1-49a9-8cfc-245de2145972 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:40.508207 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-abaadd11-d3d1-49a9-8cfc-245de2145972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:40.527786 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4c48e-21c2-4ec1-b95d-55d7672b8ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:40.528506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4c48e-21c2-4ec1-b95d-55d7672b8ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:40.529022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4c48e-21c2-4ec1-b95d-55d7672b8ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:40.529286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4c48e-21c2-4ec1-b95d-55d7672b8ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:40.529998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4c48e-21c2-4ec1-b95d-55d7672b8ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:40.531700 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4c48e-21c2-4ec1-b95d-55d7672b8ed5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:40.542188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1180/2353] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:20:40.546139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4c48e-21c2-4ec1-b95d-55d7672b8ed5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:40.559866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4c48e-21c2-4ec1-b95d-55d7672b8ed5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:40.564875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94eb229-01d3-499b-989b-9e8c801bc249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:40.566941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eb229-01d3-499b-989b-9e8c801bc249 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:40.567260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eb229-01d3-499b-989b-9e8c801bc249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:40.567525 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eb229-01d3-499b-989b-9e8c801bc249 admin admin] PATH_INFO: `/v3/projects/444254be05184eb09b8bb10b57a4a377/users/da64be1188ed4f738981f182699d9961/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:40.570231 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94eb229-01d3-499b-989b-9e8c801bc249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444254be05184eb09b8bb10b57a4a377, user_id=da64be1188ed4f738981f182699d9961, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:40.573591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94eb229-01d3-499b-989b-9e8c801bc249 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:40.607917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaadd11-d3d1-49a9-8cfc-245de2145972 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:40.609774 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1181/2354] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:40 2022] PUT /identity/v3/projects/444254be05184eb09b8bb10b57a4a377/users/da64be1188ed4f738981f182699d9961/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:40.621708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec97167-ef40-4a2a-9816-a7c3e63707cb None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:40.621904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec97167-ef40-4a2a-9816-a7c3e63707cb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:40.622178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec97167-ef40-4a2a-9816-a7c3e63707cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:40.646517 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:40.668990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-dec97167-ef40-4a2a-9816-a7c3e63707cb None None] MFA Rules not processed for user `da64be1188ed4f738981f182699d9961`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:40.670389 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dec97167-ef40-4a2a-9816-a7c3e63707cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:40.703734 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e6360-8b5c-4cc8-9a93-e414d78f93d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:40.704664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e6360-8b5c-4cc8-9a93-e414d78f93d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:40.705102 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e6360-8b5c-4cc8-9a93-e414d78f93d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:40.705607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e6360-8b5c-4cc8-9a93-e414d78f93d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:40.763961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1182/2355] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:40.776435 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec97167-ef40-4a2a-9816-a7c3e63707cb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:40.777916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dec97167-ef40-4a2a-9816-a7c3e63707cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:40.783152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e6360-8b5c-4cc8-9a93-e414d78f93d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:40.784693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e6360-8b5c-4cc8-9a93-e414d78f93d2 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:40.794823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1174/2356] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:40.849954 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec97167-ef40-4a2a-9816-a7c3e63707cb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:40.853822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b068d4f-0dca-4b66-a1be-31d150b2fa33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:40.854438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b068d4f-0dca-4b66-a1be-31d150b2fa33 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:40.854715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b068d4f-0dca-4b66-a1be-31d150b2fa33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:40.854992 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b068d4f-0dca-4b66-a1be-31d150b2fa33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:40.856870 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7b068d4f-0dca-4b66-a1be-31d150b2fa33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:40.893660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:40.921501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b068d4f-0dca-4b66-a1be-31d150b2fa33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:40.923113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b068d4f-0dca-4b66-a1be-31d150b2fa33 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:40.933848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1183/2357] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:41.443535 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e6360-8b5c-4cc8-9a93-e414d78f93d2 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:41.445845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4c0e6360-8b5c-4cc8-9a93-e414d78f93d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:41.471304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e6360-8b5c-4cc8-9a93-e414d78f93d2 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:41.485302 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef815bc5-095e-4e5e-95ce-9fcb705233c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:41.485965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef815bc5-095e-4e5e-95ce-9fcb705233c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:41.486250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef815bc5-095e-4e5e-95ce-9fcb705233c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:41.486529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef815bc5-095e-4e5e-95ce-9fcb705233c7 admin admin] PATH_INFO: `/v3/users/ba25f33e73654d549979575e87117e3d` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:41.489832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef815bc5-095e-4e5e-95ce-9fcb705233c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba25f33e73654d549979575e87117e3d)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:41.492086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef815bc5-095e-4e5e-95ce-9fcb705233c7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:41.541390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b068d4f-0dca-4b66-a1be-31d150b2fa33 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:41.543654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7b068d4f-0dca-4b66-a1be-31d150b2fa33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:41.560686 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b068d4f-0dca-4b66-a1be-31d150b2fa33 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:41.567428 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:41.568345 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:41.568789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:41.569058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257 admin admin] PATH_INFO: `/v3/projects/a0848b0c065f452bac7936bc951272a7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:41.569546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ef815bc5-095e-4e5e-95ce-9fcb705233c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba25f33e73654d549979575e87117e3d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:41.570570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0848b0c065f452bac7936bc951272a7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:41.570863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ef815bc5-095e-4e5e-95ce-9fcb705233c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba25f33e73654d549979575e87117e3d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:41.573467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:41.579967 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ef815bc5-095e-4e5e-95ce-9fcb705233c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba25f33e73654d549979575e87117e3d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:41.596735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ef815bc5-095e-4e5e-95ce-9fcb705233c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba25f33e73654d549979575e87117e3d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:41.597754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ef815bc5-095e-4e5e-95ce-9fcb705233c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba25f33e73654d549979575e87117e3d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:41.614316 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1175/2358] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:41 2022] DELETE /identity/v3/users/ba25f33e73654d549979575e87117e3d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:41.618540 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4e8b1-0f80-45eb-914a-eaf1f52345e9 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:41.618890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4e8b1-0f80-45eb-914a-eaf1f52345e9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:41.619217 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4e8b1-0f80-45eb-914a-eaf1f52345e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:41.638954 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0848b0c065f452bac7936bc951272a7', 'request_id': 'req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:41.640110 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0ae4e8b1-0f80-45eb-914a-eaf1f52345e9 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:41.641381 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0ae4e8b1-0f80-45eb-914a-eaf1f52345e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:41.650975 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0848b0c065f452bac7936bc951272a7', 'request_id': 'req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:41.659981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0848b0c065f452bac7936bc951272a7', 'request_id': 'req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:41.673052 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257 admin admin] The token cache is being invalidate because project a0848b0c065f452bac7936bc951272a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:41.673343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:41.674248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:41.676543 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1184/2359] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:41 2022] DELETE /identity/v3/projects/a0848b0c065f452bac7936bc951272a7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:41.680503 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:41.682268 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:41.712833 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:41.730647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1176/2360] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:41.735388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4e8b1-0f80-45eb-914a-eaf1f52345e9 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:41.737991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0ae4e8b1-0f80-45eb-914a-eaf1f52345e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:41.790976 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7574ac-ac2c-4b06-8ea5-53d2195f7257 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:41.804127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95c5a8-0147-45a8-8744-f802b68872af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:41.804747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95c5a8-0147-45a8-8744-f802b68872af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:41.805034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95c5a8-0147-45a8-8744-f802b68872af admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:41.805318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95c5a8-0147-45a8-8744-f802b68872af admin admin] PATH_INFO: `/v3/users/21fc5dc5f33549eb984972935deca94a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:41.808523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95c5a8-0147-45a8-8744-f802b68872af admin admin] RBAC: Authorizing `identity:delete_user(user_id=21fc5dc5f33549eb984972935deca94a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:41.818365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95c5a8-0147-45a8-8744-f802b68872af admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:41.830058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4e8b1-0f80-45eb-914a-eaf1f52345e9 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:41.834960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733ecee-57bf-466d-a7a2-75277c4785a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:41.835681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733ecee-57bf-466d-a7a2-75277c4785a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:41.835969 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733ecee-57bf-466d-a7a2-75277c4785a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:41.836245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733ecee-57bf-466d-a7a2-75277c4785a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:41.850283 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733ecee-57bf-466d-a7a2-75277c4785a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:41.852218 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733ecee-57bf-466d-a7a2-75277c4785a1 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:41.867620 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1177/2361] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:41.926751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6a95c5a8-0147-45a8-8744-f802b68872af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21fc5dc5f33549eb984972935deca94a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:41.927649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6a95c5a8-0147-45a8-8744-f802b68872af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21fc5dc5f33549eb984972935deca94a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:41.936727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6a95c5a8-0147-45a8-8744-f802b68872af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21fc5dc5f33549eb984972935deca94a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:41.942106 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:41.956080 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6a95c5a8-0147-45a8-8744-f802b68872af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21fc5dc5f33549eb984972935deca94a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:41.957460 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6a95c5a8-0147-45a8-8744-f802b68872af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21fc5dc5f33549eb984972935deca94a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:41.973218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1185/2362] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:41 2022] DELETE /identity/v3/users/21fc5dc5f33549eb984972935deca94a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:42.220510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733ecee-57bf-466d-a7a2-75277c4785a1 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:42.222641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0733ecee-57bf-466d-a7a2-75277c4785a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:42.238359 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733ecee-57bf-466d-a7a2-75277c4785a1 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:42.303769 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95c5a8-0147-45a8-8744-f802b68872af admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:42.305461 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6a95c5a8-0147-45a8-8744-f802b68872af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:42.308072 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:42.308887 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:42.309691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:42.309691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8 admin admin] PATH_INFO: `/v3/projects/cd3b0ed0bc174e4a8f961f01bd83c640` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:42.310662 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd3b0ed0bc174e4a8f961f01bd83c640)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:42.312627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:42.320346 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95c5a8-0147-45a8-8744-f802b68872af admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:42.327859 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b66d8-465a-4336-9ad3-8ccd48c9c8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:42.333204 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b66d8-465a-4336-9ad3-8ccd48c9c8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:42.334264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b66d8-465a-4336-9ad3-8ccd48c9c8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:42.339517 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b66d8-465a-4336-9ad3-8ccd48c9c8fe admin admin] PATH_INFO: `/v3/projects/2710d3c18db2451cb8d4736174885b89` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:42.342677 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b66d8-465a-4336-9ad3-8ccd48c9c8fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2710d3c18db2451cb8d4736174885b89)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:42.345554 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b66d8-465a-4336-9ad3-8ccd48c9c8fe admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:42.370383 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd3b0ed0bc174e4a8f961f01bd83c640', 'request_id': 'req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:42.383700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd3b0ed0bc174e4a8f961f01bd83c640', 'request_id': 'req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:42.399561 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd3b0ed0bc174e4a8f961f01bd83c640', 'request_id': 'req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:42.414956 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7a5b66d8-465a-4336-9ad3-8ccd48c9c8fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2710d3c18db2451cb8d4736174885b89', 'request_id': 'req-7a5b66d8-465a-4336-9ad3-8ccd48c9c8fe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:42.425525 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7a5b66d8-465a-4336-9ad3-8ccd48c9c8fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2710d3c18db2451cb8d4736174885b89', 'request_id': 'req-7a5b66d8-465a-4336-9ad3-8ccd48c9c8fe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:42.433094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7a5b66d8-465a-4336-9ad3-8ccd48c9c8fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2710d3c18db2451cb8d4736174885b89', 'request_id': 'req-7a5b66d8-465a-4336-9ad3-8ccd48c9c8fe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:42.435908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8 admin admin] The token cache is being invalidate because project cd3b0ed0bc174e4a8f961f01bd83c640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:42.436198 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:42.437384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:42.439115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1178/2363] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:42 2022] DELETE /identity/v3/projects/cd3b0ed0bc174e4a8f961f01bd83c640 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:42.443957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:42.455892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7a5b66d8-465a-4336-9ad3-8ccd48c9c8fe admin admin] The token cache is being invalidate because project 2710d3c18db2451cb8d4736174885b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:42.455892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7a5b66d8-465a-4336-9ad3-8ccd48c9c8fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:42.455892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7a5b66d8-465a-4336-9ad3-8ccd48c9c8fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:42.455892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1186/2364] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:42 2022] DELETE /identity/v3/projects/2710d3c18db2451cb8d4736174885b89 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:42.458121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:42.462807 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b2e50-4d14-40df-bd5b-4a1a26b334aa None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:42.463030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b2e50-4d14-40df-bd5b-4a1a26b334aa None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:42.463355 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b2e50-4d14-40df-bd5b-4a1a26b334aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:42.493358 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7f8b2e50-4d14-40df-bd5b-4a1a26b334aa None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:42.495144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7f8b2e50-4d14-40df-bd5b-4a1a26b334aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:42.523549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:42.570893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2e284-308f-4c1b-82e7-dd7b91a208a8 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:42.616508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1187/2365] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:42.616508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b2e50-4d14-40df-bd5b-4a1a26b334aa None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:42.616508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7f8b2e50-4d14-40df-bd5b-4a1a26b334aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:42.648811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709164ad-4600-40b7-ab89-2c0328eb87be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:42.649990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709164ad-4600-40b7-ab89-2c0328eb87be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:42.650117 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709164ad-4600-40b7-ab89-2c0328eb87be admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:42.650368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709164ad-4600-40b7-ab89-2c0328eb87be admin admin] PATH_INFO: `/v3/users/87454c3705754fadadf2e6143761304e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:42.651902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709164ad-4600-40b7-ab89-2c0328eb87be admin admin] RBAC: Authorizing `identity:delete_user(user_id=87454c3705754fadadf2e6143761304e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:42.654465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709164ad-4600-40b7-ab89-2c0328eb87be admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:42.687172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b2e50-4d14-40df-bd5b-4a1a26b334aa None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:42.693149 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374253b-a33f-4f0a-86e8-00899372e994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:42.694621 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374253b-a33f-4f0a-86e8-00899372e994 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:42.695057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374253b-a33f-4f0a-86e8-00899372e994 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:42.695671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374253b-a33f-4f0a-86e8-00899372e994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:42.697776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3374253b-a33f-4f0a-86e8-00899372e994 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:42.715007 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:42.724973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-709164ad-4600-40b7-ab89-2c0328eb87be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87454c3705754fadadf2e6143761304e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:42.725763 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-709164ad-4600-40b7-ab89-2c0328eb87be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87454c3705754fadadf2e6143761304e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:42.735874 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-709164ad-4600-40b7-ab89-2c0328eb87be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87454c3705754fadadf2e6143761304e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:42.762242 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-709164ad-4600-40b7-ab89-2c0328eb87be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87454c3705754fadadf2e6143761304e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:42.763150 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-709164ad-4600-40b7-ab89-2c0328eb87be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87454c3705754fadadf2e6143761304e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:42.777751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374253b-a33f-4f0a-86e8-00899372e994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:42.779364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374253b-a33f-4f0a-86e8-00899372e994 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:42.789584 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1188/2366] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:42.791099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760e2a4-3fef-4e4a-9c97-fa57fb896488 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:42.791680 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760e2a4-3fef-4e4a-9c97-fa57fb896488 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:42.791979 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760e2a4-3fef-4e4a-9c97-fa57fb896488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:42.801986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1179/2367] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:42 2022] DELETE /identity/v3/users/87454c3705754fadadf2e6143761304e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:42.824719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8760e2a4-3fef-4e4a-9c97-fa57fb896488 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:42.826269 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8760e2a4-3fef-4e4a-9c97-fa57fb896488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:42.933596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1189/2368] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:42.937883 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709164ad-4600-40b7-ab89-2c0328eb87be admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:42.959906 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709164ad-4600-40b7-ab89-2c0328eb87be admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:42.968781 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4d5f5-d8b9-4c65-9fe5-af09b3be4fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:42.969407 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4d5f5-d8b9-4c65-9fe5-af09b3be4fde admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:42.969681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4d5f5-d8b9-4c65-9fe5-af09b3be4fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:42.969948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4d5f5-d8b9-4c65-9fe5-af09b3be4fde admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:42.970596 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4d5f5-d8b9-4c65-9fe5-af09b3be4fde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:42.970902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4d5f5-d8b9-4c65-9fe5-af09b3be4fde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:42.973347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4d5f5-d8b9-4c65-9fe5-af09b3be4fde admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:43.012406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1180/2369] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:43.016819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760e2a4-3fef-4e4a-9c97-fa57fb896488 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:43.035174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760e2a4-3fef-4e4a-9c97-fa57fb896488 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:43.047681 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdb90d-7330-4c31-8f09-68711d38e059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:43.055508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdb90d-7330-4c31-8f09-68711d38e059 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:43.055883 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdb90d-7330-4c31-8f09-68711d38e059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:43.056113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdb90d-7330-4c31-8f09-68711d38e059 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:43.056832 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdb90d-7330-4c31-8f09-68711d38e059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:43.063226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdb90d-7330-4c31-8f09-68711d38e059 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:43.133643 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1190/2370] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:43 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:43.134721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4d5f5-d8b9-4c65-9fe5-af09b3be4fde admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:43.157081 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4d5f5-d8b9-4c65-9fe5-af09b3be4fde admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:43.238977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:43.277180 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dac884-c0a8-4c33-8537-90b2cf8bacd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:43.278215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dac884-c0a8-4c33-8537-90b2cf8bacd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:43.278509 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dac884-c0a8-4c33-8537-90b2cf8bacd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:43.278793 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dac884-c0a8-4c33-8537-90b2cf8bacd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:43.279509 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dac884-c0a8-4c33-8537-90b2cf8bacd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:43.292063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dac884-c0a8-4c33-8537-90b2cf8bacd2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:43.349700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1181/2371] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:43 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:43.352149 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdb90d-7330-4c31-8f09-68711d38e059 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:43.367737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdb90d-7330-4c31-8f09-68711d38e059 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:43.374866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee915b-56a9-496e-9947-5559ced099d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:43.376142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee915b-56a9-496e-9947-5559ced099d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:43.376551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee915b-56a9-496e-9947-5559ced099d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:43.376970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee915b-56a9-496e-9947-5559ced099d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:43.377772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee915b-56a9-496e-9947-5559ced099d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:43.381060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee915b-56a9-496e-9947-5559ced099d3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:43.400215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1191/2372] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:43.400590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dac884-c0a8-4c33-8537-90b2cf8bacd2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:43.430586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dac884-c0a8-4c33-8537-90b2cf8bacd2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:43.436369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f3c7a-4e90-46cc-ac88-a10b81a931b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:43.437031 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f3c7a-4e90-46cc-ac88-a10b81a931b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:43.437279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f3c7a-4e90-46cc-ac88-a10b81a931b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:43.437623 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f3c7a-4e90-46cc-ac88-a10b81a931b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:43.438332 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f3c7a-4e90-46cc-ac88-a10b81a931b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:43.440363 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f3c7a-4e90-46cc-ac88-a10b81a931b3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:43.464809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1182/2373] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:20:43.466232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee915b-56a9-496e-9947-5559ced099d3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:43.482626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee915b-56a9-496e-9947-5559ced099d3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:43.492275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7d65a-062f-4cc3-8623-4f736a42a340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:43.493059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7d65a-062f-4cc3-8623-4f736a42a340 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:43.493343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7d65a-062f-4cc3-8623-4f736a42a340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:43.493636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7d65a-062f-4cc3-8623-4f736a42a340 admin admin] PATH_INFO: `/v3/projects/2713c7a4c1454251bf1a0b45e3227ca1/users/59aefdb4fbe54c7c88f3440013835b53/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:43.515622 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f3c7a-4e90-46cc-ac88-a10b81a931b3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:43.523746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-992f3c7a-4e90-46cc-ac88-a10b81a931b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:43.546439 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f3c7a-4e90-46cc-ac88-a10b81a931b3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:43.548907 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7d65a-062f-4cc3-8623-4f736a42a340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2713c7a4c1454251bf1a0b45e3227ca1, user_id=59aefdb4fbe54c7c88f3440013835b53, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:43.555316 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849c7e-ae31-441a-bd07-dc0f66e2e52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:43.556593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849c7e-ae31-441a-bd07-dc0f66e2e52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:43.557582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7d65a-062f-4cc3-8623-4f736a42a340 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:43.558141 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849c7e-ae31-441a-bd07-dc0f66e2e52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:43.558583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849c7e-ae31-441a-bd07-dc0f66e2e52f admin admin] PATH_INFO: `/v3/projects/3832801a85d14c76afeec177206d4339` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:43.560329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78849c7e-ae31-441a-bd07-dc0f66e2e52f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3832801a85d14c76afeec177206d4339)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:43.563025 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78849c7e-ae31-441a-bd07-dc0f66e2e52f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:43.583996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1192/2374] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:43 2022] PUT /identity/v3/projects/2713c7a4c1454251bf1a0b45e3227ca1/users/59aefdb4fbe54c7c88f3440013835b53/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:43.599100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2c01b-a0b6-406a-959a-9b9703502b15 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:43.599564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2c01b-a0b6-406a-959a-9b9703502b15 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:43.599812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2c01b-a0b6-406a-959a-9b9703502b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:43.636857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6ae2c01b-a0b6-406a-959a-9b9703502b15 None None] MFA Rules not processed for user `59aefdb4fbe54c7c88f3440013835b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:43.638082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6ae2c01b-a0b6-406a-959a-9b9703502b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:43.642586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-78849c7e-ae31-441a-bd07-dc0f66e2e52f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3832801a85d14c76afeec177206d4339', 'request_id': 'req-78849c7e-ae31-441a-bd07-dc0f66e2e52f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:43.653080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-78849c7e-ae31-441a-bd07-dc0f66e2e52f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3832801a85d14c76afeec177206d4339', 'request_id': 'req-78849c7e-ae31-441a-bd07-dc0f66e2e52f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:43.661771 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-78849c7e-ae31-441a-bd07-dc0f66e2e52f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3832801a85d14c76afeec177206d4339', 'request_id': 'req-78849c7e-ae31-441a-bd07-dc0f66e2e52f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:43.678091 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-78849c7e-ae31-441a-bd07-dc0f66e2e52f admin admin] The token cache is being invalidate because project 3832801a85d14c76afeec177206d4339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:43.678711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-78849c7e-ae31-441a-bd07-dc0f66e2e52f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:43.679627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-78849c7e-ae31-441a-bd07-dc0f66e2e52f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:43.681811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1183/2375] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:43 2022] DELETE /identity/v3/projects/3832801a85d14c76afeec177206d4339 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:43.685646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849c7e-ae31-441a-bd07-dc0f66e2e52f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:43.687095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-78849c7e-ae31-441a-bd07-dc0f66e2e52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:43.694586 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:43.716246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1193/2376] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:43.720521 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2c01b-a0b6-406a-959a-9b9703502b15 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:43.720521 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6ae2c01b-a0b6-406a-959a-9b9703502b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:43.769594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849c7e-ae31-441a-bd07-dc0f66e2e52f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:43.775300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b6f03-74e0-46b2-9588-febbc261c32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:43.776079 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b6f03-74e0-46b2-9588-febbc261c32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:43.776436 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b6f03-74e0-46b2-9588-febbc261c32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:43.776790 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b6f03-74e0-46b2-9588-febbc261c32e admin admin] PATH_INFO: `/v3/users/ef59b9747f0c4c08a23169e8c5be678f` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:43.778700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b6f03-74e0-46b2-9588-febbc261c32e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef59b9747f0c4c08a23169e8c5be678f)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:43.780931 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b6f03-74e0-46b2-9588-febbc261c32e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:43.789557 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2c01b-a0b6-406a-959a-9b9703502b15 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:43.793314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0ea3a-a673-4c88-b299-cb0489699931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:43.793928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0ea3a-a673-4c88-b299-cb0489699931 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:43.794209 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0ea3a-a673-4c88-b299-cb0489699931 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:43.794480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0ea3a-a673-4c88-b299-cb0489699931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:43.796372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b8e0ea3a-a673-4c88-b299-cb0489699931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:43.833166 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b28b6f03-74e0-46b2-9588-febbc261c32e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef59b9747f0c4c08a23169e8c5be678f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:43.834073 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b28b6f03-74e0-46b2-9588-febbc261c32e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef59b9747f0c4c08a23169e8c5be678f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:43.836317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:43.844669 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b28b6f03-74e0-46b2-9588-febbc261c32e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef59b9747f0c4c08a23169e8c5be678f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:43.859472 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b28b6f03-74e0-46b2-9588-febbc261c32e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef59b9747f0c4c08a23169e8c5be678f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:43.860230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b28b6f03-74e0-46b2-9588-febbc261c32e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef59b9747f0c4c08a23169e8c5be678f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:43.867135 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0ea3a-a673-4c88-b299-cb0489699931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:43.869244 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0ea3a-a673-4c88-b299-cb0489699931 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:43.873724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1184/2377] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:43 2022] DELETE /identity/v3/users/ef59b9747f0c4c08a23169e8c5be678f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:43.879323 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b6f03-74e0-46b2-9588-febbc261c32e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:43.881276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b28b6f03-74e0-46b2-9588-febbc261c32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:43.881698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1194/2378] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:43.949028 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b6f03-74e0-46b2-9588-febbc261c32e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:43.955108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e536486-8d0a-4068-8540-fd7935bf1342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:43.955108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e536486-8d0a-4068-8540-fd7935bf1342 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:43.955108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e536486-8d0a-4068-8540-fd7935bf1342 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:43.955108 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e536486-8d0a-4068-8540-fd7935bf1342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:43.958209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6e536486-8d0a-4068-8540-fd7935bf1342 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:44.040914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e536486-8d0a-4068-8540-fd7935bf1342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:44.043260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e536486-8d0a-4068-8540-fd7935bf1342 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:44.063188 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1185/2379] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:44.287978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0ea3a-a673-4c88-b299-cb0489699931 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:44.303087 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0ea3a-a673-4c88-b299-cb0489699931 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:44.384894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91366403-38b9-482f-aedf-216641848f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:44.385821 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91366403-38b9-482f-aedf-216641848f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:44.386360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91366403-38b9-482f-aedf-216641848f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:44.386958 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91366403-38b9-482f-aedf-216641848f64 admin admin] PATH_INFO: `/v3/projects/f4d4de332aa044b6a94b13ed0d25a2c8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:44.389330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91366403-38b9-482f-aedf-216641848f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d4de332aa044b6a94b13ed0d25a2c8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:44.392617 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91366403-38b9-482f-aedf-216641848f64 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:44.481057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:44.491109 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-91366403-38b9-482f-aedf-216641848f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d4de332aa044b6a94b13ed0d25a2c8', 'request_id': 'req-91366403-38b9-482f-aedf-216641848f64'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:44.500524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-91366403-38b9-482f-aedf-216641848f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d4de332aa044b6a94b13ed0d25a2c8', 'request_id': 'req-91366403-38b9-482f-aedf-216641848f64'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:44.509498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-91366403-38b9-482f-aedf-216641848f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d4de332aa044b6a94b13ed0d25a2c8', 'request_id': 'req-91366403-38b9-482f-aedf-216641848f64'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:44.527740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-91366403-38b9-482f-aedf-216641848f64 admin admin] The token cache is being invalidate because project f4d4de332aa044b6a94b13ed0d25a2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:44.528470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-91366403-38b9-482f-aedf-216641848f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:44.529411 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-91366403-38b9-482f-aedf-216641848f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:44.534367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1195/2380] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:44 2022] DELETE /identity/v3/projects/f4d4de332aa044b6a94b13ed0d25a2c8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:44.536537 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b70897-9283-455b-95cb-8d9c99f957f1 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:44.536981 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b70897-9283-455b-95cb-8d9c99f957f1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:44.537083 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b70897-9283-455b-95cb-8d9c99f957f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:44.568665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-33b70897-9283-455b-95cb-8d9c99f957f1 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:44.570390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-33b70897-9283-455b-95cb-8d9c99f957f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:44.666070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1186/2381] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:44.674185 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7341a5-2de6-41cf-b44c-e5dd58954f2f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:44.674656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7341a5-2de6-41cf-b44c-e5dd58954f2f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:44.674741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7341a5-2de6-41cf-b44c-e5dd58954f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:44.702323 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3e7341a5-2de6-41cf-b44c-e5dd58954f2f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:44.703636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3e7341a5-2de6-41cf-b44c-e5dd58954f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:44.712474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1196/2382] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:44.716919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b70897-9283-455b-95cb-8d9c99f957f1 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:44.728247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b70897-9283-455b-95cb-8d9c99f957f1 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:44.732931 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c3ab4-9c96-45a0-bdf4-d416bd3304e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:44.733532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c3ab4-9c96-45a0-bdf4-d416bd3304e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:44.733813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c3ab4-9c96-45a0-bdf4-d416bd3304e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:44.734090 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c3ab4-9c96-45a0-bdf4-d416bd3304e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:44.734738 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c3ab4-9c96-45a0-bdf4-d416bd3304e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:44.735042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c3ab4-9c96-45a0-bdf4-d416bd3304e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:44.736684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c3ab4-9c96-45a0-bdf4-d416bd3304e6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:44.751828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1187/2383] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:44.752978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7341a5-2de6-41cf-b44c-e5dd58954f2f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:44.762840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7341a5-2de6-41cf-b44c-e5dd58954f2f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:44.769823 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa2faf-e833-498a-9150-81a3517d7ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:44.770508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa2faf-e833-498a-9150-81a3517d7ebe admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:44.770787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa2faf-e833-498a-9150-81a3517d7ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:44.771110 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa2faf-e833-498a-9150-81a3517d7ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:44.771745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa2faf-e833-498a-9150-81a3517d7ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:44.773663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa2faf-e833-498a-9150-81a3517d7ebe admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:44.800486 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1197/2384] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:44 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:44.804643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c3ab4-9c96-45a0-bdf4-d416bd3304e6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:44.814799 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c3ab4-9c96-45a0-bdf4-d416bd3304e6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:44.818368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:44.876373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fa38e-80f2-4554-b1de-41d89b8a1a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:44.876373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fa38e-80f2-4554-b1de-41d89b8a1a3a admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:44.876972 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fa38e-80f2-4554-b1de-41d89b8a1a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:44.876972 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fa38e-80f2-4554-b1de-41d89b8a1a3a admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:44.878778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fa38e-80f2-4554-b1de-41d89b8a1a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:44.880054 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fa38e-80f2-4554-b1de-41d89b8a1a3a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:44.901350 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1188/2385] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:44 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:44.905718 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa2faf-e833-498a-9150-81a3517d7ebe admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:44.915913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa2faf-e833-498a-9150-81a3517d7ebe admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:44.920629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42b77d-183c-43af-85c3-81ec5d1dc677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:44.921271 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42b77d-183c-43af-85c3-81ec5d1dc677 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:44.921575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42b77d-183c-43af-85c3-81ec5d1dc677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:44.921874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42b77d-183c-43af-85c3-81ec5d1dc677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:44.922558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42b77d-183c-43af-85c3-81ec5d1dc677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:44.924311 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42b77d-183c-43af-85c3-81ec5d1dc677 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:44.934727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1198/2386] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:44.938531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fa38e-80f2-4554-b1de-41d89b8a1a3a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:44.949147 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fa38e-80f2-4554-b1de-41d89b8a1a3a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:44.953885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56afb32-ed0c-4d43-a7f2-2b35087900b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:44.954426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56afb32-ed0c-4d43-a7f2-2b35087900b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:44.954709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56afb32-ed0c-4d43-a7f2-2b35087900b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:44.954985 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56afb32-ed0c-4d43-a7f2-2b35087900b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:44.955657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56afb32-ed0c-4d43-a7f2-2b35087900b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:44.958293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56afb32-ed0c-4d43-a7f2-2b35087900b4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:44.969051 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1189/2387] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:44.973081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42b77d-183c-43af-85c3-81ec5d1dc677 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:44.982902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42b77d-183c-43af-85c3-81ec5d1dc677 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:44.987523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f464c5c-3ebd-4898-98b0-2c7eb629b077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:44.988194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f464c5c-3ebd-4898-98b0-2c7eb629b077 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:44.988476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f464c5c-3ebd-4898-98b0-2c7eb629b077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:44.988750 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f464c5c-3ebd-4898-98b0-2c7eb629b077 admin admin] PATH_INFO: `/v3/projects/9659b29b7e51434e96f38fecbdfa078f/users/04b1618bcb6543a89f5783ae999eafa3/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:45.004667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f464c5c-3ebd-4898-98b0-2c7eb629b077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9659b29b7e51434e96f38fecbdfa078f, user_id=04b1618bcb6543a89f5783ae999eafa3, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:45.007358 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f464c5c-3ebd-4898-98b0-2c7eb629b077 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:45.020329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1199/2388] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:44 2022] PUT /identity/v3/projects/9659b29b7e51434e96f38fecbdfa078f/users/04b1618bcb6543a89f5783ae999eafa3/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:45.025306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a16b2a-6fe9-400a-8159-12546cee485a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:45.025597 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a16b2a-6fe9-400a-8159-12546cee485a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:45.025875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a16b2a-6fe9-400a-8159-12546cee485a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:45.046768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c3a16b2a-6fe9-400a-8159-12546cee485a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:45.048672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c3a16b2a-6fe9-400a-8159-12546cee485a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:45.120088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1190/2389] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:45.133320 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f464c5c-3ebd-4898-98b0-2c7eb629b077 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:45.135727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8f464c5c-3ebd-4898-98b0-2c7eb629b077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:45.214845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f464c5c-3ebd-4898-98b0-2c7eb629b077 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:45.219974 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8d0ca-eae3-48d9-9739-eb90419e33c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:45.220925 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8d0ca-eae3-48d9-9739-eb90419e33c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:45.221264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8d0ca-eae3-48d9-9739-eb90419e33c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:45.221613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8d0ca-eae3-48d9-9739-eb90419e33c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:45.235002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8d0ca-eae3-48d9-9739-eb90419e33c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:45.238214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8d0ca-eae3-48d9-9739-eb90419e33c9 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:45.252399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1200/2390] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:45.502785 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a16b2a-6fe9-400a-8159-12546cee485a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:45.504604 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c3a16b2a-6fe9-400a-8159-12546cee485a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:45.525333 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a16b2a-6fe9-400a-8159-12546cee485a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:45.535058 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2471fe-c5b1-474d-9e1a-9fa797704090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:45.536109 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2471fe-c5b1-474d-9e1a-9fa797704090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:45.536609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2471fe-c5b1-474d-9e1a-9fa797704090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:45.537608 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2471fe-c5b1-474d-9e1a-9fa797704090 admin admin] PATH_INFO: `/v3/users/d4bc82ad8b21437d983f7d870d93794f` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:45.539118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2471fe-c5b1-474d-9e1a-9fa797704090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4bc82ad8b21437d983f7d870d93794f)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:45.541364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2471fe-c5b1-474d-9e1a-9fa797704090 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:45.626508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9e2471fe-c5b1-474d-9e1a-9fa797704090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4bc82ad8b21437d983f7d870d93794f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:45.627584 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9e2471fe-c5b1-474d-9e1a-9fa797704090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4bc82ad8b21437d983f7d870d93794f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:45.639148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9e2471fe-c5b1-474d-9e1a-9fa797704090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4bc82ad8b21437d983f7d870d93794f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:45.688190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9e2471fe-c5b1-474d-9e1a-9fa797704090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4bc82ad8b21437d983f7d870d93794f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:45.693327 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9e2471fe-c5b1-474d-9e1a-9fa797704090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4bc82ad8b21437d983f7d870d93794f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:45.710408 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:45.718866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1191/2391] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:45 2022] DELETE /identity/v3/users/d4bc82ad8b21437d983f7d870d93794f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:45.725259 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ef1db-ba0b-46f6-815c-c92836efd194 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:45.726058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ef1db-ba0b-46f6-815c-c92836efd194 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:45.726760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ef1db-ba0b-46f6-815c-c92836efd194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:45.757488 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cc4ef1db-ba0b-46f6-815c-c92836efd194 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:45.758807 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cc4ef1db-ba0b-46f6-815c-c92836efd194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:45.828344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1201/2392] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:45.839776 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2471fe-c5b1-474d-9e1a-9fa797704090 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:45.841325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9e2471fe-c5b1-474d-9e1a-9fa797704090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:45.909561 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2471fe-c5b1-474d-9e1a-9fa797704090 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:45.915204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561866e-4fdc-4d6f-8192-0d2b4b9179ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:45.915823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561866e-4fdc-4d6f-8192-0d2b4b9179ad service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:45.916101 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561866e-4fdc-4d6f-8192-0d2b4b9179ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:45.916372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561866e-4fdc-4d6f-8192-0d2b4b9179ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:45.927285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561866e-4fdc-4d6f-8192-0d2b4b9179ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:45.928971 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561866e-4fdc-4d6f-8192-0d2b4b9179ad service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:45.941485 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1192/2393] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:46.444659 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ef1db-ba0b-46f6-815c-c92836efd194 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:46.446508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cc4ef1db-ba0b-46f6-815c-c92836efd194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:46.452868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe2b75-a779-47cb-82be-c76df9fc131a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:46.453151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe2b75-a779-47cb-82be-c76df9fc131a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:46.453767 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe2b75-a779-47cb-82be-c76df9fc131a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:46.477321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ef1db-ba0b-46f6-815c-c92836efd194 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:46.484768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c111bd-db19-49ae-983a-94ef2fc62db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:46.485830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c111bd-db19-49ae-983a-94ef2fc62db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:46.486467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c111bd-db19-49ae-983a-94ef2fc62db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:46.487223 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c111bd-db19-49ae-983a-94ef2fc62db2 admin admin] PATH_INFO: `/v3/projects/1022eb2941a04585af706762df71e478` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:46.489597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c111bd-db19-49ae-983a-94ef2fc62db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1022eb2941a04585af706762df71e478)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:46.492195 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c111bd-db19-49ae-983a-94ef2fc62db2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:46.495287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:46.503159 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-45fe2b75-a779-47cb-82be-c76df9fc131a None None] MFA Rules not processed for user `04b1618bcb6543a89f5783ae999eafa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:46.505466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-45fe2b75-a779-47cb-82be-c76df9fc131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:46.574305 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e1c111bd-db19-49ae-983a-94ef2fc62db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1022eb2941a04585af706762df71e478', 'request_id': 'req-e1c111bd-db19-49ae-983a-94ef2fc62db2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:46.584793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e1c111bd-db19-49ae-983a-94ef2fc62db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1022eb2941a04585af706762df71e478', 'request_id': 'req-e1c111bd-db19-49ae-983a-94ef2fc62db2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:46.594316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e1c111bd-db19-49ae-983a-94ef2fc62db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1022eb2941a04585af706762df71e478', 'request_id': 'req-e1c111bd-db19-49ae-983a-94ef2fc62db2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:46.609569 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e1c111bd-db19-49ae-983a-94ef2fc62db2 admin admin] The token cache is being invalidate because project 1022eb2941a04585af706762df71e478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:46.609894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e1c111bd-db19-49ae-983a-94ef2fc62db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:46.610554 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e1c111bd-db19-49ae-983a-94ef2fc62db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:46.612111 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1202/2394] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:46 2022] DELETE /identity/v3/projects/1022eb2941a04585af706762df71e478 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:46.617727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d678924-e281-452e-808b-2a415d1b9b74 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:46.618015 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d678924-e281-452e-808b-2a415d1b9b74 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:46.618297 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d678924-e281-452e-808b-2a415d1b9b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:46.633713 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1193/2395] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:46.647378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8d678924-e281-452e-808b-2a415d1b9b74 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:46.647378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8d678924-e281-452e-808b-2a415d1b9b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:46.647532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe2b75-a779-47cb-82be-c76df9fc131a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:46.647532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-45fe2b75-a779-47cb-82be-c76df9fc131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:46.736024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe2b75-a779-47cb-82be-c76df9fc131a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:46.747299 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1203/2396] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:46.756689 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccf05a-d7a2-47ab-8c40-caa21b3a9889 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:46.756980 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccf05a-d7a2-47ab-8c40-caa21b3a9889 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:46.757256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccf05a-d7a2-47ab-8c40-caa21b3a9889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:46.781896 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-92ccf05a-d7a2-47ab-8c40-caa21b3a9889 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:46.783230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-92ccf05a-d7a2-47ab-8c40-caa21b3a9889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:46.792239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1204/2397] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:46.796629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccf05a-d7a2-47ab-8c40-caa21b3a9889 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:46.798489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:46.806796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccf05a-d7a2-47ab-8c40-caa21b3a9889 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:46.807195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50af64-d20d-425a-9339-911d9099bda1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:46.807884 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50af64-d20d-425a-9339-911d9099bda1 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:46.808091 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50af64-d20d-425a-9339-911d9099bda1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:46.808364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50af64-d20d-425a-9339-911d9099bda1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:46.811656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746286df-06a2-49cd-97d4-1fe05fabaa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:46.812436 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746286df-06a2-49cd-97d4-1fe05fabaa00 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:46.812898 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746286df-06a2-49cd-97d4-1fe05fabaa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:46.813177 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746286df-06a2-49cd-97d4-1fe05fabaa00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:46.813976 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746286df-06a2-49cd-97d4-1fe05fabaa00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:46.814285 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746286df-06a2-49cd-97d4-1fe05fabaa00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:46.816052 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746286df-06a2-49cd-97d4-1fe05fabaa00 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:46.837974 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1205/2398] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:20:46.842732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746286df-06a2-49cd-97d4-1fe05fabaa00 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:46.856336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746286df-06a2-49cd-97d4-1fe05fabaa00 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:46.875303 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8759777-d701-409e-8bee-065795425dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:46.876463 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8759777-d701-409e-8bee-065795425dbb admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:46.876969 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8759777-d701-409e-8bee-065795425dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:46.877524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8759777-d701-409e-8bee-065795425dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:46.878210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8759777-d701-409e-8bee-065795425dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:46.880881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8759777-d701-409e-8bee-065795425dbb admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:46.898221 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50af64-d20d-425a-9339-911d9099bda1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:46.899883 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50af64-d20d-425a-9339-911d9099bda1 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:46.914450 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1194/2399] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:46.920256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1206/2400] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:46 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:46.921681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50af64-d20d-425a-9339-911d9099bda1 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:46.935529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50af64-d20d-425a-9339-911d9099bda1 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:47.009847 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15242c-526f-4a6c-bea1-dba9bbf54624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:47.011095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15242c-526f-4a6c-bea1-dba9bbf54624 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:47.011757 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15242c-526f-4a6c-bea1-dba9bbf54624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:47.013056 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15242c-526f-4a6c-bea1-dba9bbf54624 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:47.014551 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15242c-526f-4a6c-bea1-dba9bbf54624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:47.016737 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15242c-526f-4a6c-bea1-dba9bbf54624 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:47.041231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1195/2401] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:46 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:47.045472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8759777-d701-409e-8bee-065795425dbb admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:47.057503 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8759777-d701-409e-8bee-065795425dbb admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:47.064065 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded3b54-ef96-4307-b8e8-fdcc0d77068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:47.064873 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded3b54-ef96-4307-b8e8-fdcc0d77068a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:47.065374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded3b54-ef96-4307-b8e8-fdcc0d77068a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:47.065945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded3b54-ef96-4307-b8e8-fdcc0d77068a admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:47.067352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded3b54-ef96-4307-b8e8-fdcc0d77068a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:47.068986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded3b54-ef96-4307-b8e8-fdcc0d77068a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:47.083361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1207/2402] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:47.089666 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15242c-526f-4a6c-bea1-dba9bbf54624 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:47.105407 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15242c-526f-4a6c-bea1-dba9bbf54624 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:47.115177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f3bc-0ff7-4f7c-bed1-6da12970378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:47.116384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f3bc-0ff7-4f7c-bed1-6da12970378b admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:47.116710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f3bc-0ff7-4f7c-bed1-6da12970378b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:47.116996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f3bc-0ff7-4f7c-bed1-6da12970378b admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:47.117731 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29f3bc-0ff7-4f7c-bed1-6da12970378b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:47.119453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29f3bc-0ff7-4f7c-bed1-6da12970378b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:47.135113 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1196/2403] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:47.138786 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded3b54-ef96-4307-b8e8-fdcc0d77068a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:47.152456 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded3b54-ef96-4307-b8e8-fdcc0d77068a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:47.160495 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc194c-0d94-41bf-b1ca-92c16d3717ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:47.161918 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc194c-0d94-41bf-b1ca-92c16d3717ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:47.162431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc194c-0d94-41bf-b1ca-92c16d3717ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:47.162795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc194c-0d94-41bf-b1ca-92c16d3717ef admin admin] PATH_INFO: `/v3/projects/a0c7f685ea3445d9b54d7f455fe0f01b/users/f668854151ce49e1bd5de651e731f989/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:47.185746 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc194c-0d94-41bf-b1ca-92c16d3717ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c7f685ea3445d9b54d7f455fe0f01b, user_id=f668854151ce49e1bd5de651e731f989, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:47.188715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc194c-0d94-41bf-b1ca-92c16d3717ef admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:47.203826 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1208/2404] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:47 2022] PUT /identity/v3/projects/a0c7f685ea3445d9b54d7f455fe0f01b/users/f668854151ce49e1bd5de651e731f989/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:47.211829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b5681-c384-458a-9fad-11683077db85 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:47.212139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b5681-c384-458a-9fad-11683077db85 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:47.212391 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b5681-c384-458a-9fad-11683077db85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:47.244622 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-fe4b5681-c384-458a-9fad-11683077db85 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:47.247230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fe4b5681-c384-458a-9fad-11683077db85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:47.379683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1197/2405] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:47.384372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc194c-0d94-41bf-b1ca-92c16d3717ef admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:47.388282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-eefc194c-0d94-41bf-b1ca-92c16d3717ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:47.421629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:47.478004 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc194c-0d94-41bf-b1ca-92c16d3717ef admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:47.482484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774488bd-8ce2-4cfa-bc4c-0afaa07f0ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:47.483277 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774488bd-8ce2-4cfa-bc4c-0afaa07f0ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:47.483717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774488bd-8ce2-4cfa-bc4c-0afaa07f0ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:47.484007 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774488bd-8ce2-4cfa-bc4c-0afaa07f0ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:47.495854 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774488bd-8ce2-4cfa-bc4c-0afaa07f0ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:47.497583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774488bd-8ce2-4cfa-bc4c-0afaa07f0ad3 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:47.511698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1209/2406] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:48.163970 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b5681-c384-458a-9fad-11683077db85 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:48.165556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fe4b5681-c384-458a-9fad-11683077db85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:48.183909 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b5681-c384-458a-9fad-11683077db85 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:48.192390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6b2a0-44ec-4396-8ae7-0cb7e6d7e2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:48.193486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6b2a0-44ec-4396-8ae7-0cb7e6d7e2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:48.193906 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6b2a0-44ec-4396-8ae7-0cb7e6d7e2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:48.194250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6b2a0-44ec-4396-8ae7-0cb7e6d7e2d9 admin admin] PATH_INFO: `/v3/users/e0c011df3b044ee0b2d069fb1527e876` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:48.195900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6b2a0-44ec-4396-8ae7-0cb7e6d7e2d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c011df3b044ee0b2d069fb1527e876)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:48.198010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6b2a0-44ec-4396-8ae7-0cb7e6d7e2d9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:48.217244 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:48.259403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a9f6b2a0-44ec-4396-8ae7-0cb7e6d7e2d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c011df3b044ee0b2d069fb1527e876'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:48.260321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a9f6b2a0-44ec-4396-8ae7-0cb7e6d7e2d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c011df3b044ee0b2d069fb1527e876'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:48.270394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a9f6b2a0-44ec-4396-8ae7-0cb7e6d7e2d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c011df3b044ee0b2d069fb1527e876'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:48.286067 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a9f6b2a0-44ec-4396-8ae7-0cb7e6d7e2d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c011df3b044ee0b2d069fb1527e876'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:48.287041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a9f6b2a0-44ec-4396-8ae7-0cb7e6d7e2d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c011df3b044ee0b2d069fb1527e876'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:48.317009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1198/2407] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:48 2022] DELETE /identity/v3/users/e0c011df3b044ee0b2d069fb1527e876 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:48.321549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351847ad-e30f-400b-ba48-e2655ac49a64 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:48.322054 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351847ad-e30f-400b-ba48-e2655ac49a64 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:48.322204 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351847ad-e30f-400b-ba48-e2655ac49a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:48.359790 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-351847ad-e30f-400b-ba48-e2655ac49a64 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:48.361336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-351847ad-e30f-400b-ba48-e2655ac49a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:48.510470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108cb01-002f-4268-80dd-47d0f9305f1a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:48.510760 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108cb01-002f-4268-80dd-47d0f9305f1a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:48.511287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108cb01-002f-4268-80dd-47d0f9305f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:48.518111 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1210/2408] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:48.531348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c108cb01-002f-4268-80dd-47d0f9305f1a None None] MFA Rules not processed for user `04b1618bcb6543a89f5783ae999eafa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:48.532574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c108cb01-002f-4268-80dd-47d0f9305f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:48.536464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351847ad-e30f-400b-ba48-e2655ac49a64 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:48.538437 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-351847ad-e30f-400b-ba48-e2655ac49a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:48.656359 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1199/2409] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:48.666971 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351847ad-e30f-400b-ba48-e2655ac49a64 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:48.676786 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadb61d-0c85-4ad1-b188-cb174f707dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:48.677421 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadb61d-0c85-4ad1-b188-cb174f707dff service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:48.677699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadb61d-0c85-4ad1-b188-cb174f707dff service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:48.677968 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadb61d-0c85-4ad1-b188-cb174f707dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:48.707935 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbadb61d-0c85-4ad1-b188-cb174f707dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:48.709886 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbadb61d-0c85-4ad1-b188-cb174f707dff service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:48.720665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1211/2410] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:49.736362 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108cb01-002f-4268-80dd-47d0f9305f1a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:49.739643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c108cb01-002f-4268-80dd-47d0f9305f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:49.762954 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108cb01-002f-4268-80dd-47d0f9305f1a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:49.770186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:49.781904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:49.782197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:49.783850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00 admin admin] PATH_INFO: `/v3/projects/86fe78cbdc3e4dada5eb2a80d1ed4789` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:49.793025 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86fe78cbdc3e4dada5eb2a80d1ed4789)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:49.797447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:49.878920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86fe78cbdc3e4dada5eb2a80d1ed4789', 'request_id': 'req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:49.886967 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86fe78cbdc3e4dada5eb2a80d1ed4789', 'request_id': 'req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:49.895838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86fe78cbdc3e4dada5eb2a80d1ed4789', 'request_id': 'req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:49.916827 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00 admin admin] The token cache is being invalidate because project 86fe78cbdc3e4dada5eb2a80d1ed4789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:49.917133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:49.917890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:49.922730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1200/2411] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:49 2022] DELETE /identity/v3/projects/86fe78cbdc3e4dada5eb2a80d1ed4789 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:49.925961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadb61d-0c85-4ad1-b188-cb174f707dff service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:49.936118 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadb61d-0c85-4ad1-b188-cb174f707dff service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:50.027476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086309a-6552-4c87-8c0e-8caa14df5b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:50.028079 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086309a-6552-4c87-8c0e-8caa14df5b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:50.028477 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086309a-6552-4c87-8c0e-8caa14df5b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:50.028870 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086309a-6552-4c87-8c0e-8caa14df5b39 admin admin] PATH_INFO: `/v3/users/fe22f472fccb4215847f95eb457542f4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:50.030694 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086309a-6552-4c87-8c0e-8caa14df5b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe22f472fccb4215847f95eb457542f4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:50.034610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086309a-6552-4c87-8c0e-8caa14df5b39 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:50.041452 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:50.158858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2086309a-6552-4c87-8c0e-8caa14df5b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe22f472fccb4215847f95eb457542f4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:50.161295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2086309a-6552-4c87-8c0e-8caa14df5b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe22f472fccb4215847f95eb457542f4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:50.174372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2086309a-6552-4c87-8c0e-8caa14df5b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe22f472fccb4215847f95eb457542f4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:50.190272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2086309a-6552-4c87-8c0e-8caa14df5b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe22f472fccb4215847f95eb457542f4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:50.191764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2086309a-6552-4c87-8c0e-8caa14df5b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe22f472fccb4215847f95eb457542f4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:50.239692 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1212/2412] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:49 2022] DELETE /identity/v3/users/fe22f472fccb4215847f95eb457542f4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:51.539623 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:51.547804 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:51.588322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeec516-01d5-48fc-b2c1-6c0d59b5fc00 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:51.652364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:51.711920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086309a-6552-4c87-8c0e-8caa14df5b39 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:51.713394 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2086309a-6552-4c87-8c0e-8caa14df5b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:51.760353 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba62c7-6636-48ed-8c44-709daa3fe717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:51.761003 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba62c7-6636-48ed-8c44-709daa3fe717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:51.761510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba62c7-6636-48ed-8c44-709daa3fe717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:51.761934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba62c7-6636-48ed-8c44-709daa3fe717 admin admin] PATH_INFO: `/v3/users/bb889ce5000a46e2b4e9d37dbb5c9b0b` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:51.763784 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba62c7-6636-48ed-8c44-709daa3fe717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb889ce5000a46e2b4e9d37dbb5c9b0b)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:51.787859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba62c7-6636-48ed-8c44-709daa3fe717 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:51.846050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086309a-6552-4c87-8c0e-8caa14df5b39 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:51.852558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f86c50-dca4-401e-b02e-56c34e4952ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:51.853261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f86c50-dca4-401e-b02e-56c34e4952ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:51.853551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f86c50-dca4-401e-b02e-56c34e4952ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:51.853865 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f86c50-dca4-401e-b02e-56c34e4952ee admin admin] PATH_INFO: `/v3/projects/5aad52636bba4b76b194fd378a166923` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:51.855666 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f86c50-dca4-401e-b02e-56c34e4952ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aad52636bba4b76b194fd378a166923)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:51.857599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f86c50-dca4-401e-b02e-56c34e4952ee admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:51.879013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dbba62c7-6636-48ed-8c44-709daa3fe717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb889ce5000a46e2b4e9d37dbb5c9b0b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:51.879866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dbba62c7-6636-48ed-8c44-709daa3fe717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb889ce5000a46e2b4e9d37dbb5c9b0b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:51.890840 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dbba62c7-6636-48ed-8c44-709daa3fe717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb889ce5000a46e2b4e9d37dbb5c9b0b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:51.908347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dbba62c7-6636-48ed-8c44-709daa3fe717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb889ce5000a46e2b4e9d37dbb5c9b0b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:51.909589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dbba62c7-6636-48ed-8c44-709daa3fe717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb889ce5000a46e2b4e9d37dbb5c9b0b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:51.925641 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a6f86c50-dca4-401e-b02e-56c34e4952ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aad52636bba4b76b194fd378a166923', 'request_id': 'req-a6f86c50-dca4-401e-b02e-56c34e4952ee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:51.931123 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1201/2413] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:51 2022] DELETE /identity/v3/users/bb889ce5000a46e2b4e9d37dbb5c9b0b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:51.933542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f20e2a-b72a-41ab-85d5-96bfe8f3e388 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:51.934539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f20e2a-b72a-41ab-85d5-96bfe8f3e388 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:51.934539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f20e2a-b72a-41ab-85d5-96bfe8f3e388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:51.940812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a6f86c50-dca4-401e-b02e-56c34e4952ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aad52636bba4b76b194fd378a166923', 'request_id': 'req-a6f86c50-dca4-401e-b02e-56c34e4952ee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:51.956557 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a6f86c50-dca4-401e-b02e-56c34e4952ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aad52636bba4b76b194fd378a166923', 'request_id': 'req-a6f86c50-dca4-401e-b02e-56c34e4952ee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:51.960160 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-03f20e2a-b72a-41ab-85d5-96bfe8f3e388 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:51.961544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-03f20e2a-b72a-41ab-85d5-96bfe8f3e388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:51.998948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a6f86c50-dca4-401e-b02e-56c34e4952ee admin admin] The token cache is being invalidate because project 5aad52636bba4b76b194fd378a166923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:51.999318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a6f86c50-dca4-401e-b02e-56c34e4952ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:52.000382 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a6f86c50-dca4-401e-b02e-56c34e4952ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:52.002264 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1213/2414] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:51 2022] DELETE /identity/v3/projects/5aad52636bba4b76b194fd378a166923 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:52.008046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f86c50-dca4-401e-b02e-56c34e4952ee admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:52.010771 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a6f86c50-dca4-401e-b02e-56c34e4952ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:52.041254 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:52.145231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1202/2415] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:52.154341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f86c50-dca4-401e-b02e-56c34e4952ee admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:52.161785 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511e74b-e138-4a5d-95cd-fa51493eeebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:52.163330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511e74b-e138-4a5d-95cd-fa51493eeebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:52.163825 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511e74b-e138-4a5d-95cd-fa51493eeebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:52.164326 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511e74b-e138-4a5d-95cd-fa51493eeebd admin admin] PATH_INFO: `/v3/users/da64be1188ed4f738981f182699d9961` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:52.165769 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511e74b-e138-4a5d-95cd-fa51493eeebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=da64be1188ed4f738981f182699d9961)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:52.168846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511e74b-e138-4a5d-95cd-fa51493eeebd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:52.228496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f20e2a-b72a-41ab-85d5-96bfe8f3e388 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:52.230116 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-03f20e2a-b72a-41ab-85d5-96bfe8f3e388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:52.256760 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8511e74b-e138-4a5d-95cd-fa51493eeebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da64be1188ed4f738981f182699d9961'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:52.257309 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8511e74b-e138-4a5d-95cd-fa51493eeebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da64be1188ed4f738981f182699d9961'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:52.280068 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8511e74b-e138-4a5d-95cd-fa51493eeebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da64be1188ed4f738981f182699d9961'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:52.301072 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8511e74b-e138-4a5d-95cd-fa51493eeebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da64be1188ed4f738981f182699d9961'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:52.302128 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8511e74b-e138-4a5d-95cd-fa51493eeebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da64be1188ed4f738981f182699d9961'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:52.318347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:52.328479 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1214/2416] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:52 2022] DELETE /identity/v3/users/da64be1188ed4f738981f182699d9961 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:52.352806 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f20e2a-b72a-41ab-85d5-96bfe8f3e388 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:52.446435 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c20e98-9355-4bb0-b16d-ff75a87411bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:52.447263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20e98-9355-4bb0-b16d-ff75a87411bd service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:52.447548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20e98-9355-4bb0-b16d-ff75a87411bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:52.447859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20e98-9355-4bb0-b16d-ff75a87411bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:52.450474 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-42c20e98-9355-4bb0-b16d-ff75a87411bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:52.555368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c20e98-9355-4bb0-b16d-ff75a87411bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:52.556910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c20e98-9355-4bb0-b16d-ff75a87411bd service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:52.570505 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1203/2417] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:52.884868 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511e74b-e138-4a5d-95cd-fa51493eeebd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:52.886597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8511e74b-e138-4a5d-95cd-fa51493eeebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:52.914227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511e74b-e138-4a5d-95cd-fa51493eeebd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:52.921162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8843c2-fabb-43c6-ad7c-386b655bacb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:52.922143 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8843c2-fabb-43c6-ad7c-386b655bacb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:52.922617 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8843c2-fabb-43c6-ad7c-386b655bacb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:52.923187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8843c2-fabb-43c6-ad7c-386b655bacb0 admin admin] PATH_INFO: `/v3/projects/444254be05184eb09b8bb10b57a4a377` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:52.924523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8843c2-fabb-43c6-ad7c-386b655bacb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=444254be05184eb09b8bb10b57a4a377)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:52.927027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8843c2-fabb-43c6-ad7c-386b655bacb0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:53.016892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5f8843c2-fabb-43c6-ad7c-386b655bacb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444254be05184eb09b8bb10b57a4a377', 'request_id': 'req-5f8843c2-fabb-43c6-ad7c-386b655bacb0'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:53.033835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5f8843c2-fabb-43c6-ad7c-386b655bacb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444254be05184eb09b8bb10b57a4a377', 'request_id': 'req-5f8843c2-fabb-43c6-ad7c-386b655bacb0'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:53.044247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5f8843c2-fabb-43c6-ad7c-386b655bacb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444254be05184eb09b8bb10b57a4a377', 'request_id': 'req-5f8843c2-fabb-43c6-ad7c-386b655bacb0'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:53.069237 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5f8843c2-fabb-43c6-ad7c-386b655bacb0 admin admin] The token cache is being invalidate because project 444254be05184eb09b8bb10b57a4a377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:53.069386 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5f8843c2-fabb-43c6-ad7c-386b655bacb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:53.074398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5f8843c2-fabb-43c6-ad7c-386b655bacb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:53.082609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507e061-83c3-4f9b-b86b-51920893886a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:53.082915 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507e061-83c3-4f9b-b86b-51920893886a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:53.083229 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507e061-83c3-4f9b-b86b-51920893886a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:53.086318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1215/2418] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:52 2022] DELETE /identity/v3/projects/444254be05184eb09b8bb10b57a4a377 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:53.110981 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f507e061-83c3-4f9b-b86b-51920893886a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:53.112866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f507e061-83c3-4f9b-b86b-51920893886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:53.207614 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1204/2419] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:53.211374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad36f2-b778-4b93-9455-71f05e1c6afc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:53.212236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad36f2-b778-4b93-9455-71f05e1c6afc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:53.212554 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad36f2-b778-4b93-9455-71f05e1c6afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:53.240031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-60ad36f2-b778-4b93-9455-71f05e1c6afc None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:53.242273 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-60ad36f2-b778-4b93-9455-71f05e1c6afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:53.257814 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1216/2420] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:53.262263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507e061-83c3-4f9b-b86b-51920893886a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:53.276045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507e061-83c3-4f9b-b86b-51920893886a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:53.285510 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7f09e-b938-42c4-94dd-1401147cdcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:53.286787 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7f09e-b938-42c4-94dd-1401147cdcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:53.287752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7f09e-b938-42c4-94dd-1401147cdcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:53.288352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7f09e-b938-42c4-94dd-1401147cdcd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:53.288709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7f09e-b938-42c4-94dd-1401147cdcd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:53.290033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7f09e-b938-42c4-94dd-1401147cdcd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:53.293308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7f09e-b938-42c4-94dd-1401147cdcd5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:53.318704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1205/2421] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:53.323688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad36f2-b778-4b93-9455-71f05e1c6afc None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:53.338571 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad36f2-b778-4b93-9455-71f05e1c6afc None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:53.348723 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93398d1a-2574-49fc-96f2-ca86b3808617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:53.349367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93398d1a-2574-49fc-96f2-ca86b3808617 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:53.349649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93398d1a-2574-49fc-96f2-ca86b3808617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:53.350281 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93398d1a-2574-49fc-96f2-ca86b3808617 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:53.351275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93398d1a-2574-49fc-96f2-ca86b3808617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:53.354200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93398d1a-2574-49fc-96f2-ca86b3808617 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:53.361875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:53.409109 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1217/2422] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:53 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:53.411054 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7f09e-b938-42c4-94dd-1401147cdcd5 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:53.430225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7f09e-b938-42c4-94dd-1401147cdcd5 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:53.473707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:53.512357 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435d9dd-3670-4f40-b780-5a973ce0e2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:53.512990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435d9dd-3670-4f40-b780-5a973ce0e2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:53.513269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435d9dd-3670-4f40-b780-5a973ce0e2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:53.513541 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435d9dd-3670-4f40-b780-5a973ce0e2f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:53.515542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435d9dd-3670-4f40-b780-5a973ce0e2f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:53.518749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435d9dd-3670-4f40-b780-5a973ce0e2f5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:53.551356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1206/2423] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:53 2022] POST /identity/v3/users => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:53.553597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93398d1a-2574-49fc-96f2-ca86b3808617 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:53.571607 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93398d1a-2574-49fc-96f2-ca86b3808617 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:53.577904 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafb568-1623-4d23-ad4d-ec5edeefe134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:53.578553 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafb568-1623-4d23-ad4d-ec5edeefe134 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:53.578927 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafb568-1623-4d23-ad4d-ec5edeefe134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:53.579453 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafb568-1623-4d23-ad4d-ec5edeefe134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:53.580189 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafb568-1623-4d23-ad4d-ec5edeefe134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:53.582745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafb568-1623-4d23-ad4d-ec5edeefe134 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:53.594220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1218/2424] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:53.598371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435d9dd-3670-4f40-b780-5a973ce0e2f5 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:53.609234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435d9dd-3670-4f40-b780-5a973ce0e2f5 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:53.615873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46b9dc-6fee-406b-ad2a-6533524a8deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:53.616475 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46b9dc-6fee-406b-ad2a-6533524a8deb admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:53.616770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46b9dc-6fee-406b-ad2a-6533524a8deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:53.617486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46b9dc-6fee-406b-ad2a-6533524a8deb admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:53.618202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46b9dc-6fee-406b-ad2a-6533524a8deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:53.620416 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46b9dc-6fee-406b-ad2a-6533524a8deb admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:53.635369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1207/2425] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:20:53.639506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafb568-1623-4d23-ad4d-ec5edeefe134 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:53.651365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafb568-1623-4d23-ad4d-ec5edeefe134 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:53.657601 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd12480-653b-4e47-a147-849d0ec26713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:53.658469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd12480-653b-4e47-a147-849d0ec26713 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:53.658631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd12480-653b-4e47-a147-849d0ec26713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:53.659625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd12480-653b-4e47-a147-849d0ec26713 admin admin] PATH_INFO: `/v3/projects/b653de18d59741f0b2cd0d08c1061e13/users/b4ff94c18f214439b5305ebca1ae4855/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:53.679668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd12480-653b-4e47-a147-849d0ec26713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b653de18d59741f0b2cd0d08c1061e13, user_id=b4ff94c18f214439b5305ebca1ae4855, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:53.683406 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd12480-653b-4e47-a147-849d0ec26713 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:53.714528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6697c6d-767d-4041-9bd0-a3363eff9268 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:53.714864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6697c6d-767d-4041-9bd0-a3363eff9268 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:53.715170 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6697c6d-767d-4041-9bd0-a3363eff9268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:53.723597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1219/2426] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:53 2022] PUT /identity/v3/projects/b653de18d59741f0b2cd0d08c1061e13/users/b4ff94c18f214439b5305ebca1ae4855/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:53.760133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e6697c6d-767d-4041-9bd0-a3363eff9268 None None] MFA Rules not processed for user `b4ff94c18f214439b5305ebca1ae4855`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:53.761383 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e6697c6d-767d-4041-9bd0-a3363eff9268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:53.883368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1208/2427] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:53.897001 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd12480-653b-4e47-a147-849d0ec26713 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:53.899950 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6fd12480-653b-4e47-a147-849d0ec26713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:53.926425 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6697c6d-767d-4041-9bd0-a3363eff9268 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:53.928546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e6697c6d-767d-4041-9bd0-a3363eff9268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:54.041405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd12480-653b-4e47-a147-849d0ec26713 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:54.046441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa39600-bba3-4491-b116-f00933b7f1d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c78d95e6774755b11508fc1954ad5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:54.048210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa39600-bba3-4491-b116-f00933b7f1d4 service glance] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:54.048690 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa39600-bba3-4491-b116-f00933b7f1d4 service glance] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:54.049150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa39600-bba3-4491-b116-f00933b7f1d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:54.055405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6697c6d-767d-4041-9bd0-a3363eff9268 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:54.060835 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23c079-2f2e-4641-a091-60fed2030546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:54.061468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa39600-bba3-4491-b116-f00933b7f1d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:54.061654 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23c079-2f2e-4641-a091-60fed2030546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:54.061945 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23c079-2f2e-4641-a091-60fed2030546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:54.062366 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23c079-2f2e-4641-a091-60fed2030546 admin admin] PATH_INFO: `/v3/projects/28192929d869488f9d16b845b3bc0ca9` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:54.063647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23c079-2f2e-4641-a091-60fed2030546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28192929d869488f9d16b845b3bc0ca9)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:54.064637 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa39600-bba3-4491-b116-f00933b7f1d4 service glance] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:54.065782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23c079-2f2e-4641-a091-60fed2030546 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:54.077654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1220/2428] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:54.138151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:54.144346 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fa23c079-2f2e-4641-a091-60fed2030546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28192929d869488f9d16b845b3bc0ca9', 'request_id': 'req-fa23c079-2f2e-4641-a091-60fed2030546'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:54.160834 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fa23c079-2f2e-4641-a091-60fed2030546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28192929d869488f9d16b845b3bc0ca9', 'request_id': 'req-fa23c079-2f2e-4641-a091-60fed2030546'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:54.168541 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fa23c079-2f2e-4641-a091-60fed2030546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28192929d869488f9d16b845b3bc0ca9', 'request_id': 'req-fa23c079-2f2e-4641-a091-60fed2030546'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:54.201343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fa23c079-2f2e-4641-a091-60fed2030546 admin admin] The token cache is being invalidate because project 28192929d869488f9d16b845b3bc0ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:54.201616 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fa23c079-2f2e-4641-a091-60fed2030546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:54.204409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fa23c079-2f2e-4641-a091-60fed2030546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:54.212180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059baa-5e19-4a25-9103-1e8adada47c0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:54.212522 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059baa-5e19-4a25-9103-1e8adada47c0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:54.212689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1209/2429] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:53 2022] DELETE /identity/v3/projects/28192929d869488f9d16b845b3bc0ca9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:20:54.212823 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059baa-5e19-4a25-9103-1e8adada47c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:54.240372 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4d059baa-5e19-4a25-9103-1e8adada47c0 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:54.241698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4d059baa-5e19-4a25-9103-1e8adada47c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:54.385588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4f426-5c44-4f8c-9722-610de79ef6ff None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:54.385917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4f426-5c44-4f8c-9722-610de79ef6ff None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:54.386201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4f426-5c44-4f8c-9722-610de79ef6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:54.391300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1221/2430] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:54.431427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2ae4f426-5c44-4f8c-9722-610de79ef6ff None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:54.432645 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2ae4f426-5c44-4f8c-9722-610de79ef6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:54.449110 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1210/2431] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:54.453509 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d059baa-5e19-4a25-9103-1e8adada47c0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:54.466072 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d059baa-5e19-4a25-9103-1e8adada47c0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:54.476272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91205ba-e540-4be6-a7b9-64b75af19b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:54.477194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91205ba-e540-4be6-a7b9-64b75af19b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:54.477401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91205ba-e540-4be6-a7b9-64b75af19b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:54.477770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91205ba-e540-4be6-a7b9-64b75af19b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:54.478594 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91205ba-e540-4be6-a7b9-64b75af19b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:54.478951 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91205ba-e540-4be6-a7b9-64b75af19b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:54.480994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91205ba-e540-4be6-a7b9-64b75af19b2d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:54.507199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1222/2432] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:54.508539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4f426-5c44-4f8c-9722-610de79ef6ff None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:54.543343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4f426-5c44-4f8c-9722-610de79ef6ff None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:54.558789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5268274-8f8e-40a9-9784-e1bddb884a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:54.559484 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5268274-8f8e-40a9-9784-e1bddb884a55 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:54.560014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5268274-8f8e-40a9-9784-e1bddb884a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:54.560440 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5268274-8f8e-40a9-9784-e1bddb884a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:54.561170 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5268274-8f8e-40a9-9784-e1bddb884a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:54.567191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5268274-8f8e-40a9-9784-e1bddb884a55 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:54.692459 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1211/2433] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:54 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:54.696808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91205ba-e540-4be6-a7b9-64b75af19b2d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:54.709484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91205ba-e540-4be6-a7b9-64b75af19b2d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:54.801210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:54.833540 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e6661-5323-450e-af91-cb8e73e14bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:54.834864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e6661-5323-450e-af91-cb8e73e14bed admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:54.835741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e6661-5323-450e-af91-cb8e73e14bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:54.836459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e6661-5323-450e-af91-cb8e73e14bed admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:54.837275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e6661-5323-450e-af91-cb8e73e14bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:54.840304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e6661-5323-450e-af91-cb8e73e14bed admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:54.905134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1223/2434] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:54 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:54.909842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5268274-8f8e-40a9-9784-e1bddb884a55 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:54.932074 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5268274-8f8e-40a9-9784-e1bddb884a55 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:54.938950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1d2ec-c5e8-4362-9eb8-6804f9ca220b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:54.939820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1d2ec-c5e8-4362-9eb8-6804f9ca220b admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:54.940182 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1d2ec-c5e8-4362-9eb8-6804f9ca220b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:54.941090 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1d2ec-c5e8-4362-9eb8-6804f9ca220b admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:54.941888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1d2ec-c5e8-4362-9eb8-6804f9ca220b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:54.943905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1d2ec-c5e8-4362-9eb8-6804f9ca220b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:54.959188 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1212/2435] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:54.961330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e6661-5323-450e-af91-cb8e73e14bed admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:54.980988 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e6661-5323-450e-af91-cb8e73e14bed admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:54.986841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc94466-4946-4dd3-a803-e7453d0dfa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:54.988082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc94466-4946-4dd3-a803-e7453d0dfa60 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:54.988367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc94466-4946-4dd3-a803-e7453d0dfa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:54.988705 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc94466-4946-4dd3-a803-e7453d0dfa60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:54.989721 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc94466-4946-4dd3-a803-e7453d0dfa60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:54.991379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc94466-4946-4dd3-a803-e7453d0dfa60 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:55.010539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1224/2436] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:55.013697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1d2ec-c5e8-4362-9eb8-6804f9ca220b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:55.027668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1d2ec-c5e8-4362-9eb8-6804f9ca220b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:55.034035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44502680-bb75-4a39-9f0e-231485f3bd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:55.035166 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44502680-bb75-4a39-9f0e-231485f3bd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:55.035622 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44502680-bb75-4a39-9f0e-231485f3bd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:55.036052 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44502680-bb75-4a39-9f0e-231485f3bd46 admin admin] PATH_INFO: `/v3/projects/b614046bc1b248c09e49b3cdbc8db69a/users/b865150f02f54afbb395a1f31914dd75/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:55.060863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44502680-bb75-4a39-9f0e-231485f3bd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b614046bc1b248c09e49b3cdbc8db69a, user_id=b865150f02f54afbb395a1f31914dd75, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:55.065928 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44502680-bb75-4a39-9f0e-231485f3bd46 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:55.081409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1213/2437] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:55 2022] PUT /identity/v3/projects/b614046bc1b248c09e49b3cdbc8db69a/users/b865150f02f54afbb395a1f31914dd75/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:55.092719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa10621-211a-4419-a577-b3bead1d4843 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:55.093181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa10621-211a-4419-a577-b3bead1d4843 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:55.094956 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa10621-211a-4419-a577-b3bead1d4843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:55.173346 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-faa10621-211a-4419-a577-b3bead1d4843 None None] MFA Rules not processed for user `b865150f02f54afbb395a1f31914dd75`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:55.174567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-faa10621-211a-4419-a577-b3bead1d4843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:55.317763 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1225/2438] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:55.331601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44502680-bb75-4a39-9f0e-231485f3bd46 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:55.333622 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-44502680-bb75-4a39-9f0e-231485f3bd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:55.506045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44502680-bb75-4a39-9f0e-231485f3bd46 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:55.512171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8286b48-c4bc-470f-9a46-e4e7d5f1f88f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:55.512853 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8286b48-c4bc-470f-9a46-e4e7d5f1f88f service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:55.513069 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8286b48-c4bc-470f-9a46-e4e7d5f1f88f service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:55.513343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8286b48-c4bc-470f-9a46-e4e7d5f1f88f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:55.524893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8286b48-c4bc-470f-9a46-e4e7d5f1f88f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:55.526641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8286b48-c4bc-470f-9a46-e4e7d5f1f88f service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:55.544365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1214/2439] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:20:56.693404 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa10621-211a-4419-a577-b3bead1d4843 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:56.694971 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-faa10621-211a-4419-a577-b3bead1d4843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:56.777327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa10621-211a-4419-a577-b3bead1d4843 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:56.782736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0505f36-f469-48dd-b2d3-e18c9779fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:56.784645 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0505f36-f469-48dd-b2d3-e18c9779fb2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:56.785195 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0505f36-f469-48dd-b2d3-e18c9779fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:56.785784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0505f36-f469-48dd-b2d3-e18c9779fb2a admin admin] PATH_INFO: `/v3/users/59aefdb4fbe54c7c88f3440013835b53` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:56.787166 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0505f36-f469-48dd-b2d3-e18c9779fb2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=59aefdb4fbe54c7c88f3440013835b53)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:56.789188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0505f36-f469-48dd-b2d3-e18c9779fb2a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:56.865004 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b0505f36-f469-48dd-b2d3-e18c9779fb2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59aefdb4fbe54c7c88f3440013835b53'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:56.865783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b0505f36-f469-48dd-b2d3-e18c9779fb2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59aefdb4fbe54c7c88f3440013835b53'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:56.868023 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:56.874544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b0505f36-f469-48dd-b2d3-e18c9779fb2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59aefdb4fbe54c7c88f3440013835b53'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:56.889155 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b0505f36-f469-48dd-b2d3-e18c9779fb2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59aefdb4fbe54c7c88f3440013835b53'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:56.890106 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b0505f36-f469-48dd-b2d3-e18c9779fb2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59aefdb4fbe54c7c88f3440013835b53'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:56.911154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1226/2440] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:20:56 2022] DELETE /identity/v3/users/59aefdb4fbe54c7c88f3440013835b53 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:56.915738 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d07cb-754e-446a-a336-5923ffd84377 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:56.916275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d07cb-754e-446a-a336-5923ffd84377 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:56.916275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d07cb-754e-446a-a336-5923ffd84377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:56.937525 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ed2d07cb-754e-446a-a336-5923ffd84377 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:56.938648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ed2d07cb-754e-446a-a336-5923ffd84377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:57.054624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1215/2441] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:57.055435 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0505f36-f469-48dd-b2d3-e18c9779fb2a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:57.057019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b0505f36-f469-48dd-b2d3-e18c9779fb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:57.129639 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0505f36-f469-48dd-b2d3-e18c9779fb2a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:57.134044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d82722-f02b-4d76-a8aa-e5f9defeb792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:57.134737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d82722-f02b-4d76-a8aa-e5f9defeb792 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:57.135098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d82722-f02b-4d76-a8aa-e5f9defeb792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:57.135461 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d82722-f02b-4d76-a8aa-e5f9defeb792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:57.148771 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d82722-f02b-4d76-a8aa-e5f9defeb792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:57.167361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d82722-f02b-4d76-a8aa-e5f9defeb792 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:57.191840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1227/2442] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:20:57.513771 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439c8bf-5151-4cdd-ac8a-9e9b3930ec0a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:57.516549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439c8bf-5151-4cdd-ac8a-9e9b3930ec0a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:57.516907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439c8bf-5151-4cdd-ac8a-9e9b3930ec0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:57.569572 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:57.586372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0439c8bf-5151-4cdd-ac8a-9e9b3930ec0a None None] MFA Rules not processed for user `f668854151ce49e1bd5de651e731f989`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:57.588711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0439c8bf-5151-4cdd-ac8a-9e9b3930ec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:57.654805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d82722-f02b-4d76-a8aa-e5f9defeb792 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:57.656104 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-32d82722-f02b-4d76-a8aa-e5f9defeb792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:57.685140 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d82722-f02b-4d76-a8aa-e5f9defeb792 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:57.708935 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7ec51-ab81-4477-90dc-f1ba14c6f17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:57.710673 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7ec51-ab81-4477-90dc-f1ba14c6f17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:57.712961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7ec51-ab81-4477-90dc-f1ba14c6f17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:57.715802 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7ec51-ab81-4477-90dc-f1ba14c6f17a admin admin] PATH_INFO: `/v3/projects/2713c7a4c1454251bf1a0b45e3227ca1` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:57.724764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7ec51-ab81-4477-90dc-f1ba14c6f17a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2713c7a4c1454251bf1a0b45e3227ca1)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:57.733810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7ec51-ab81-4477-90dc-f1ba14c6f17a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:57.784223 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1216/2443] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:57.785446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439c8bf-5151-4cdd-ac8a-9e9b3930ec0a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:57.790668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0439c8bf-5151-4cdd-ac8a-9e9b3930ec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:57.820196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439c8bf-5151-4cdd-ac8a-9e9b3930ec0a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:57.842661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-acc7ec51-ab81-4477-90dc-f1ba14c6f17a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2713c7a4c1454251bf1a0b45e3227ca1', 'request_id': 'req-acc7ec51-ab81-4477-90dc-f1ba14c6f17a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:57.883495 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-acc7ec51-ab81-4477-90dc-f1ba14c6f17a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2713c7a4c1454251bf1a0b45e3227ca1', 'request_id': 'req-acc7ec51-ab81-4477-90dc-f1ba14c6f17a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:57.906629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-acc7ec51-ab81-4477-90dc-f1ba14c6f17a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2713c7a4c1454251bf1a0b45e3227ca1', 'request_id': 'req-acc7ec51-ab81-4477-90dc-f1ba14c6f17a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:57.941015 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-acc7ec51-ab81-4477-90dc-f1ba14c6f17a admin admin] The token cache is being invalidate because project 2713c7a4c1454251bf1a0b45e3227ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:20:57.945897 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-acc7ec51-ab81-4477-90dc-f1ba14c6f17a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:57.947729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-acc7ec51-ab81-4477-90dc-f1ba14c6f17a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:20:57.949947 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1228/2444] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:20:57 2022] DELETE /identity/v3/projects/2713c7a4c1454251bf1a0b45e3227ca1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:57.958359 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703cd03-fddb-4925-8170-3f31c1ff43a0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:57.958817 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703cd03-fddb-4925-8170-3f31c1ff43a0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:57.959288 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703cd03-fddb-4925-8170-3f31c1ff43a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:57.982179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1735e-121f-4d5c-b0bb-8d6a8b5be7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:57.983467 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1735e-121f-4d5c-b0bb-8d6a8b5be7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:57.983966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1735e-121f-4d5c-b0bb-8d6a8b5be7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:57.984831 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1735e-121f-4d5c-b0bb-8d6a8b5be7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:57.986018 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1735e-121f-4d5c-b0bb-8d6a8b5be7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:57.988814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1735e-121f-4d5c-b0bb-8d6a8b5be7a2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:58.006159 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d703cd03-fddb-4925-8170-3f31c1ff43a0 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:58.008549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d703cd03-fddb-4925-8170-3f31c1ff43a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:58.036796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1229/2445] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:20:58.044961 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677561a4-e431-4027-8d15-6b17a83d1467 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:58.045655 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677561a4-e431-4027-8d15-6b17a83d1467 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:58.046109 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677561a4-e431-4027-8d15-6b17a83d1467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:58.060925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1217/2446] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:57 2022] POST /identity/v3/projects => generated 371 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:58.064877 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1735e-121f-4d5c-b0bb-8d6a8b5be7a2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:58.070346 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5ad1735e-121f-4d5c-b0bb-8d6a8b5be7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:58.083985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-677561a4-e431-4027-8d15-6b17a83d1467 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:58.087629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-677561a4-e431-4027-8d15-6b17a83d1467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:58.167725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:58.196387 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1230/2447] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:58.198116 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677561a4-e431-4027-8d15-6b17a83d1467 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:58.215310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677561a4-e431-4027-8d15-6b17a83d1467 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:58.225678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6d663-6268-407f-b4f9-870b23434e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:58.226336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6d663-6268-407f-b4f9-870b23434e50 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:58.233471 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6d663-6268-407f-b4f9-870b23434e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:58.233764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6d663-6268-407f-b4f9-870b23434e50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:58.240189 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6d663-6268-407f-b4f9-870b23434e50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:20:58.241310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6d663-6268-407f-b4f9-870b23434e50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:58.246835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6d663-6268-407f-b4f9-870b23434e50 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:58.283727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1231/2448] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:20:58.285445 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6d663-6268-407f-b4f9-870b23434e50 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:58.292404 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1735e-121f-4d5c-b0bb-8d6a8b5be7a2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:58.297869 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6d663-6268-407f-b4f9-870b23434e50 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:58.298234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c4427-237e-424f-b148-ad731ec84ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:58.298956 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c4427-237e-424f-b148-ad731ec84ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:58.299374 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c4427-237e-424f-b148-ad731ec84ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:58.299882 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c4427-237e-424f-b148-ad731ec84ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:58.301047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c4427-237e-424f-b148-ad731ec84ff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:58.302990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1730d5-4f2a-4097-89de-2a1ecd970d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:58.303613 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c4427-237e-424f-b148-ad731ec84ff4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:58.303751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1730d5-4f2a-4097-89de-2a1ecd970d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:58.304164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1730d5-4f2a-4097-89de-2a1ecd970d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:58.304448 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1730d5-4f2a-4097-89de-2a1ecd970d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:58.305087 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1730d5-4f2a-4097-89de-2a1ecd970d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:58.307392 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1730d5-4f2a-4097-89de-2a1ecd970d14 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:58.352066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1218/2449] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:58 2022] POST /identity/v3/users => generated 292 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:20:58.352280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1232/2450] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:20:58 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:58.355591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c4427-237e-424f-b148-ad731ec84ff4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:58.356641 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1730d5-4f2a-4097-89de-2a1ecd970d14 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:58.370544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c4427-237e-424f-b148-ad731ec84ff4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:58.399528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:58.472153 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea326bf-eaa3-4440-8731-933806249901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:58.473072 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea326bf-eaa3-4440-8731-933806249901 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:58.473588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea326bf-eaa3-4440-8731-933806249901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:58.474013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea326bf-eaa3-4440-8731-933806249901 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:58.475576 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea326bf-eaa3-4440-8731-933806249901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:58.477888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea326bf-eaa3-4440-8731-933806249901 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:58.488025 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1730d5-4f2a-4097-89de-2a1ecd970d14 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:58.506221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd967e38-9caa-4cbe-a37a-71e4f37a001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:58.507204 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd967e38-9caa-4cbe-a37a-71e4f37a001e admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:58.507793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd967e38-9caa-4cbe-a37a-71e4f37a001e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:58.510436 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd967e38-9caa-4cbe-a37a-71e4f37a001e admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:58.512662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd967e38-9caa-4cbe-a37a-71e4f37a001e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:58.515943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd967e38-9caa-4cbe-a37a-71e4f37a001e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:58.517886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1219/2451] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:20:58 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:20:58.522129 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea326bf-eaa3-4440-8731-933806249901 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:58.528013 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1233/2452] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:58.532653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd967e38-9caa-4cbe-a37a-71e4f37a001e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:58.540745 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea326bf-eaa3-4440-8731-933806249901 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:58.546414 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd967e38-9caa-4cbe-a37a-71e4f37a001e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:58.547759 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10fc65-a366-4713-9a72-9d1674f49577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:58.548648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10fc65-a366-4713-9a72-9d1674f49577 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:58.553884 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10fc65-a366-4713-9a72-9d1674f49577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:58.554431 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10fc65-a366-4713-9a72-9d1674f49577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:58.555663 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10fc65-a366-4713-9a72-9d1674f49577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:58.556311 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6287c5-2bb6-417e-a085-20e107e5688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:58.557480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6287c5-2bb6-417e-a085-20e107e5688c admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:58.558272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6287c5-2bb6-417e-a085-20e107e5688c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:58.558693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6287c5-2bb6-417e-a085-20e107e5688c admin admin] PATH_INFO: `/v3/projects/b0656ad6848344b18e4ff63975fc3879/users/820ead1cf5b04798b2dfe2da95a8571f/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:58.562182 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10fc65-a366-4713-9a72-9d1674f49577 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:58.582099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1220/2453] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:58.584382 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6287c5-2bb6-417e-a085-20e107e5688c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0656ad6848344b18e4ff63975fc3879, user_id=820ead1cf5b04798b2dfe2da95a8571f, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:58.585404 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10fc65-a366-4713-9a72-9d1674f49577 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:58.587911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6287c5-2bb6-417e-a085-20e107e5688c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:58.615930 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1234/2454] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:58 2022] PUT /identity/v3/projects/b0656ad6848344b18e4ff63975fc3879/users/820ead1cf5b04798b2dfe2da95a8571f/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:58.618748 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10fc65-a366-4713-9a72-9d1674f49577 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:58.620058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6287c5-2bb6-417e-a085-20e107e5688c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:58.716934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34607b61-b2ed-452a-acac-cc698606723d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:58.717495 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34607b61-b2ed-452a-acac-cc698606723d admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:58.717780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34607b61-b2ed-452a-acac-cc698606723d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:58.718422 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34607b61-b2ed-452a-acac-cc698606723d admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:58.719456 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34607b61-b2ed-452a-acac-cc698606723d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:58.723279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34607b61-b2ed-452a-acac-cc698606723d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:58.730191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6287c5-2bb6-417e-a085-20e107e5688c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:58.743994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08f2dc-70e9-46c9-b359-a2311322f093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:58.744745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08f2dc-70e9-46c9-b359-a2311322f093 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:58.745161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08f2dc-70e9-46c9-b359-a2311322f093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:58.745739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08f2dc-70e9-46c9-b359-a2311322f093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:58.746306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08f2dc-70e9-46c9-b359-a2311322f093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:58.746776 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1221/2455] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:58.747791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34607b61-b2ed-452a-acac-cc698606723d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:58.748909 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08f2dc-70e9-46c9-b359-a2311322f093 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:58.764851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34607b61-b2ed-452a-acac-cc698606723d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:58.771239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1235/2456] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:20:58.776494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08f2dc-70e9-46c9-b359-a2311322f093 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:58.777297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0009a-dd2e-44e4-bc6e-afe1e7439c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:58.778300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0009a-dd2e-44e4-bc6e-afe1e7439c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:58.778519 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0009a-dd2e-44e4-bc6e-afe1e7439c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:58.778811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0009a-dd2e-44e4-bc6e-afe1e7439c71 admin admin] PATH_INFO: `/v3/projects/4a39fde48f524053a4b31c5fb2c67b2e/users/3170254d280d49dd8f4b9fa52e4d05b1/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:58.789512 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08f2dc-70e9-46c9-b359-a2311322f093 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:58.797813 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdff7b-b2a8-48d7-ba43-eab1aba2e917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:58.798549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdff7b-b2a8-48d7-ba43-eab1aba2e917 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:58.798835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdff7b-b2a8-48d7-ba43-eab1aba2e917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:58.799149 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdff7b-b2a8-48d7-ba43-eab1aba2e917 admin admin] PATH_INFO: `/v3/projects/b0656ad6848344b18e4ff63975fc3879/users/820ead1cf5b04798b2dfe2da95a8571f/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:58.800049 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0009a-dd2e-44e4-bc6e-afe1e7439c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a39fde48f524053a4b31c5fb2c67b2e, user_id=3170254d280d49dd8f4b9fa52e4d05b1, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:58.802150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdff7b-b2a8-48d7-ba43-eab1aba2e917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0656ad6848344b18e4ff63975fc3879, user_id=820ead1cf5b04798b2dfe2da95a8571f, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:58.803773 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0009a-dd2e-44e4-bc6e-afe1e7439c71 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:58.805035 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdff7b-b2a8-48d7-ba43-eab1aba2e917 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:58.820174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1236/2457] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:58 2022] PUT /identity/v3/projects/b0656ad6848344b18e4ff63975fc3879/users/820ead1cf5b04798b2dfe2da95a8571f/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:58.846750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1222/2458] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:20:58 2022] PUT /identity/v3/projects/4a39fde48f524053a4b31c5fb2c67b2e/users/3170254d280d49dd8f4b9fa52e4d05b1/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:20:58.852536 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04b330-f5b1-41c9-85e4-a498866e4314 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:58.852945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04b330-f5b1-41c9-85e4-a498866e4314 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:58.853458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04b330-f5b1-41c9-85e4-a498866e4314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:58.895488 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:58.906743 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fe04b330-f5b1-41c9-85e4-a498866e4314 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:20:58.908789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fe04b330-f5b1-41c9-85e4-a498866e4314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:59.110927 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1237/2459] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:20:59.162364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0009a-dd2e-44e4-bc6e-afe1e7439c71 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:20:59.164721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-afa0009a-dd2e-44e4-bc6e-afe1e7439c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:20:59.287491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0009a-dd2e-44e4-bc6e-afe1e7439c71 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:20:59.300734 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f8eef-2da2-4124-9aad-4f789e10b6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:20:59.302121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f8eef-2da2-4124-9aad-4f789e10b6df service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:20:59.302601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f8eef-2da2-4124-9aad-4f789e10b6df service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:20:59.303118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f8eef-2da2-4124-9aad-4f789e10b6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:20:59.331291 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f8eef-2da2-4124-9aad-4f789e10b6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:20:59.333822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f8eef-2da2-4124-9aad-4f789e10b6df service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:20:59.359879 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1223/2460] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:21:01.529416 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e2556-679d-497d-821f-5332cae06846 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:01.529976 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e2556-679d-497d-821f-5332cae06846 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:01.529976 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e2556-679d-497d-821f-5332cae06846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:01.562352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cd7e2556-679d-497d-821f-5332cae06846 None None] MFA Rules not processed for user `3170254d280d49dd8f4b9fa52e4d05b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:21:01.563749 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cd7e2556-679d-497d-821f-5332cae06846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:01.668476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1238/2461] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:21:01.683642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f8eef-2da2-4124-9aad-4f789e10b6df service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:21:01.685846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-071f8eef-2da2-4124-9aad-4f789e10b6df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:01.708757 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:01.800321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f8eef-2da2-4124-9aad-4f789e10b6df service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:21:01.805805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68d9c7-5120-458a-b818-3069346b6d39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:21:01.806572 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68d9c7-5120-458a-b818-3069346b6d39 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:01.806860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68d9c7-5120-458a-b818-3069346b6d39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:01.807321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68d9c7-5120-458a-b818-3069346b6d39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:01.827671 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68d9c7-5120-458a-b818-3069346b6d39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:21:01.830546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68d9c7-5120-458a-b818-3069346b6d39 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:21:01.872554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1224/2462] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:21:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:21:04.672171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bc7ca-138b-4119-8e6c-e4a53bbe270e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:04.673236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bc7ca-138b-4119-8e6c-e4a53bbe270e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:04.673694 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bc7ca-138b-4119-8e6c-e4a53bbe270e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:04.706903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-941bc7ca-138b-4119-8e6c-e4a53bbe270e None None] MFA Rules not processed for user `3170254d280d49dd8f4b9fa52e4d05b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:21:04.708858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-941bc7ca-138b-4119-8e6c-e4a53bbe270e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:04.729142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1239/2463] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:21:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:21:06.860237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a37c3-2fc2-4e40-9661-045d961153fe None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:06.861852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a37c3-2fc2-4e40-9661-045d961153fe None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:06.862674 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a37c3-2fc2-4e40-9661-045d961153fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:06.913665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f73a37c3-2fc2-4e40-9661-045d961153fe None None] MFA Rules not processed for user `820ead1cf5b04798b2dfe2da95a8571f`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:21:06.916360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f73a37c3-2fc2-4e40-9661-045d961153fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:06.995676 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1225/2464] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:21:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:21:07.013468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bc7ca-138b-4119-8e6c-e4a53bbe270e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:21:07.015028 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-941bc7ca-138b-4119-8e6c-e4a53bbe270e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:07.113489 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bc7ca-138b-4119-8e6c-e4a53bbe270e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:21:07.119491 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368fbfa-6eb8-4751-b9b0-fd34bd6937a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:21:07.120280 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368fbfa-6eb8-4751-b9b0-fd34bd6937a8 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:07.120544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368fbfa-6eb8-4751-b9b0-fd34bd6937a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:07.120818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368fbfa-6eb8-4751-b9b0-fd34bd6937a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:07.122598 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a368fbfa-6eb8-4751-b9b0-fd34bd6937a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:07.183202 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:07.257467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368fbfa-6eb8-4751-b9b0-fd34bd6937a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:21:07.259191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368fbfa-6eb8-4751-b9b0-fd34bd6937a8 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:21:07.269175 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1240/2465] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:21:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:21:08.999501 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cd636-f1d1-4cf9-a119-d4e8b0d63e27 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:09.000523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cd636-f1d1-4cf9-a119-d4e8b0d63e27 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:09.000523 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cd636-f1d1-4cf9-a119-d4e8b0d63e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:09.022863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ff3cd636-f1d1-4cf9-a119-d4e8b0d63e27 None None] MFA Rules not processed for user `f668854151ce49e1bd5de651e731f989`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:21:09.024364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ff3cd636-f1d1-4cf9-a119-d4e8b0d63e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:09.033243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1226/2466] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:21:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:21:13.437066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106d7fd-4bde-4012-acaf-73ae8dd3d86d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:13.437690 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106d7fd-4bde-4012-acaf-73ae8dd3d86d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:13.437690 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106d7fd-4bde-4012-acaf-73ae8dd3d86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:13.459004 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2106d7fd-4bde-4012-acaf-73ae8dd3d86d None None] MFA Rules not processed for user `00dbc8a1ee7645668360de8a7cc4ea92`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:21:13.460721 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2106d7fd-4bde-4012-acaf-73ae8dd3d86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:13.520262 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1241/2467] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:21:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:21:19.015759 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=59 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:20.645398 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9744b6-ca1f-4e0d-9d72-05451f7f41ae None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:20.646069 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9744b6-ca1f-4e0d-9d72-05451f7f41ae None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:20.646069 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9744b6-ca1f-4e0d-9d72-05451f7f41ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:20.665584 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-cf9744b6-ca1f-4e0d-9d72-05451f7f41ae None None] MFA Rules not processed for user `04b1618bcb6543a89f5783ae999eafa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:21:20.666798 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-cf9744b6-ca1f-4e0d-9d72-05451f7f41ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:20.726634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1227/2468] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:21:23.512638 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=40 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:30.719032 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=25 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:58.023342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106d7fd-4bde-4012-acaf-73ae8dd3d86d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:21:58.025049 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2106d7fd-4bde-4012-acaf-73ae8dd3d86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:58.038151 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106d7fd-4bde-4012-acaf-73ae8dd3d86d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:21:58.042964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999475de-95e2-4831-aad2-aea392b854f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:21:58.043654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999475de-95e2-4831-aad2-aea392b854f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:58.043939 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999475de-95e2-4831-aad2-aea392b854f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:58.044220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999475de-95e2-4831-aad2-aea392b854f8 admin admin] PATH_INFO: `/v3/users/b865150f02f54afbb395a1f31914dd75` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:58.045371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999475de-95e2-4831-aad2-aea392b854f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b865150f02f54afbb395a1f31914dd75)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:21:58.047404 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999475de-95e2-4831-aad2-aea392b854f8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:21:58.094060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-999475de-95e2-4831-aad2-aea392b854f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b865150f02f54afbb395a1f31914dd75'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:58.094710 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-999475de-95e2-4831-aad2-aea392b854f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b865150f02f54afbb395a1f31914dd75'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:58.101523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-999475de-95e2-4831-aad2-aea392b854f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b865150f02f54afbb395a1f31914dd75'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:58.113380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-999475de-95e2-4831-aad2-aea392b854f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b865150f02f54afbb395a1f31914dd75'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:58.114027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-999475de-95e2-4831-aad2-aea392b854f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b865150f02f54afbb395a1f31914dd75'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:58.126815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1242/2469] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:21:58 2022] DELETE /identity/v3/users/b865150f02f54afbb395a1f31914dd75 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:21:58.131382 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b207ce-4c37-47d6-ad63-25968cfeceea None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:58.131872 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b207ce-4c37-47d6-ad63-25968cfeceea None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:58.131982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b207ce-4c37-47d6-ad63-25968cfeceea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:58.154398 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-76b207ce-4c37-47d6-ad63-25968cfeceea None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:21:58.155642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-76b207ce-4c37-47d6-ad63-25968cfeceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:58.215564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1228/2470] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:21:58.225210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999475de-95e2-4831-aad2-aea392b854f8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:21:58.226591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-999475de-95e2-4831-aad2-aea392b854f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:58.283893 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999475de-95e2-4831-aad2-aea392b854f8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:21:58.287469 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606a289-ae98-472c-acb0-d331e309dcc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:21:58.288063 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606a289-ae98-472c-acb0-d331e309dcc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:58.288339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606a289-ae98-472c-acb0-d331e309dcc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:58.288609 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606a289-ae98-472c-acb0-d331e309dcc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:58.297588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606a289-ae98-472c-acb0-d331e309dcc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:21:58.299041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606a289-ae98-472c-acb0-d331e309dcc0 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:21:58.308489 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1243/2471] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:21:58.529060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b207ce-4c37-47d6-ad63-25968cfeceea None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:21:58.530658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-76b207ce-4c37-47d6-ad63-25968cfeceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:58.543473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b207ce-4c37-47d6-ad63-25968cfeceea None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:21:58.548067 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c8498-58ca-453d-8de2-de71aaee8388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:21:58.548798 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c8498-58ca-453d-8de2-de71aaee8388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:58.549148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c8498-58ca-453d-8de2-de71aaee8388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:58.549489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c8498-58ca-453d-8de2-de71aaee8388 admin admin] PATH_INFO: `/v3/users/b4ff94c18f214439b5305ebca1ae4855` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:58.550778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c8498-58ca-453d-8de2-de71aaee8388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ff94c18f214439b5305ebca1ae4855)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:21:58.552801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c8498-58ca-453d-8de2-de71aaee8388 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:21:58.588790 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606a289-ae98-472c-acb0-d331e309dcc0 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:21:58.590940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3606a289-ae98-472c-acb0-d331e309dcc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:58.606287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606a289-ae98-472c-acb0-d331e309dcc0 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:21:58.613047 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ac4be-72c6-45a1-b296-56bb46a89df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:21:58.613981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ac4be-72c6-45a1-b296-56bb46a89df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:58.614373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ac4be-72c6-45a1-b296-56bb46a89df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:58.614748 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ac4be-72c6-45a1-b296-56bb46a89df8 admin admin] PATH_INFO: `/v3/projects/b614046bc1b248c09e49b3cdbc8db69a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:58.616395 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ac4be-72c6-45a1-b296-56bb46a89df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b614046bc1b248c09e49b3cdbc8db69a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:21:58.620238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ac4be-72c6-45a1-b296-56bb46a89df8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:21:58.664697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a76c8498-58ca-453d-8de2-de71aaee8388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ff94c18f214439b5305ebca1ae4855'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:58.665679 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a76c8498-58ca-453d-8de2-de71aaee8388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ff94c18f214439b5305ebca1ae4855'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:58.676683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a76c8498-58ca-453d-8de2-de71aaee8388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ff94c18f214439b5305ebca1ae4855'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:58.705784 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a76c8498-58ca-453d-8de2-de71aaee8388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ff94c18f214439b5305ebca1ae4855'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:58.706903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a76c8498-58ca-453d-8de2-de71aaee8388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ff94c18f214439b5305ebca1ae4855'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:58.728987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1229/2472] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:21:58 2022] DELETE /identity/v3/users/b4ff94c18f214439b5305ebca1ae4855 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:21:58.732494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-521ac4be-72c6-45a1-b296-56bb46a89df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b614046bc1b248c09e49b3cdbc8db69a', 'request_id': 'req-521ac4be-72c6-45a1-b296-56bb46a89df8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:58.734099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac61b98-7069-4ea3-98a6-c2b6a306d7e8 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:58.734733 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac61b98-7069-4ea3-98a6-c2b6a306d7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:58.736113 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac61b98-7069-4ea3-98a6-c2b6a306d7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:58.742350 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-521ac4be-72c6-45a1-b296-56bb46a89df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b614046bc1b248c09e49b3cdbc8db69a', 'request_id': 'req-521ac4be-72c6-45a1-b296-56bb46a89df8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:58.760715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6ac61b98-7069-4ea3-98a6-c2b6a306d7e8 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:21:58.761928 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6ac61b98-7069-4ea3-98a6-c2b6a306d7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:58.768325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-521ac4be-72c6-45a1-b296-56bb46a89df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b614046bc1b248c09e49b3cdbc8db69a', 'request_id': 'req-521ac4be-72c6-45a1-b296-56bb46a89df8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:58.778293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:58.787173 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-521ac4be-72c6-45a1-b296-56bb46a89df8 admin admin] The token cache is being invalidate because project b614046bc1b248c09e49b3cdbc8db69a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:21:58.787173 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-521ac4be-72c6-45a1-b296-56bb46a89df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:58.787173 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-521ac4be-72c6-45a1-b296-56bb46a89df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:58.788756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1244/2473] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:21:58 2022] DELETE /identity/v3/projects/b614046bc1b248c09e49b3cdbc8db69a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:21:58.840257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1230/2474] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:21:58.849868 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ac4be-72c6-45a1-b296-56bb46a89df8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:21:58.851718 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-521ac4be-72c6-45a1-b296-56bb46a89df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:58.918740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ac4be-72c6-45a1-b296-56bb46a89df8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:21:58.980963 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e3ee8-00f4-4df1-85bc-ccba070a1ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:21:58.982000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e3ee8-00f4-4df1-85bc-ccba070a1ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:58.982000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e3ee8-00f4-4df1-85bc-ccba070a1ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:58.982203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e3ee8-00f4-4df1-85bc-ccba070a1ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:58.992786 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e3ee8-00f4-4df1-85bc-ccba070a1ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:21:58.994401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e3ee8-00f4-4df1-85bc-ccba070a1ef2 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:21:59.004679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1245/2475] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:21:59.293156 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac61b98-7069-4ea3-98a6-c2b6a306d7e8 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:21:59.294922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6ac61b98-7069-4ea3-98a6-c2b6a306d7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:21:59.321868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac61b98-7069-4ea3-98a6-c2b6a306d7e8 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:21:59.326987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05737477-920d-46cc-85af-6c6bae355ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:21:59.328275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05737477-920d-46cc-85af-6c6bae355ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:21:59.329114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05737477-920d-46cc-85af-6c6bae355ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:21:59.329396 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05737477-920d-46cc-85af-6c6bae355ffe admin admin] PATH_INFO: `/v3/projects/b653de18d59741f0b2cd0d08c1061e13` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:21:59.330744 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05737477-920d-46cc-85af-6c6bae355ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b653de18d59741f0b2cd0d08c1061e13)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:21:59.332717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05737477-920d-46cc-85af-6c6bae355ffe admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:21:59.343517 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:59.392671 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-05737477-920d-46cc-85af-6c6bae355ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b653de18d59741f0b2cd0d08c1061e13', 'request_id': 'req-05737477-920d-46cc-85af-6c6bae355ffe'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:59.399958 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-05737477-920d-46cc-85af-6c6bae355ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b653de18d59741f0b2cd0d08c1061e13', 'request_id': 'req-05737477-920d-46cc-85af-6c6bae355ffe'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:59.406030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-05737477-920d-46cc-85af-6c6bae355ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b653de18d59741f0b2cd0d08c1061e13', 'request_id': 'req-05737477-920d-46cc-85af-6c6bae355ffe'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:59.424570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-05737477-920d-46cc-85af-6c6bae355ffe admin admin] The token cache is being invalidate because project b653de18d59741f0b2cd0d08c1061e13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:21:59.424860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-05737477-920d-46cc-85af-6c6bae355ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:59.425660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-05737477-920d-46cc-85af-6c6bae355ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:21:59.427263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1231/2476] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:21:59 2022] DELETE /identity/v3/projects/b653de18d59741f0b2cd0d08c1061e13 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:22:03.227766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c09f37-9722-4b42-a4ee-52646a07eaed None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:03.228290 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c09f37-9722-4b42-a4ee-52646a07eaed None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:03.228403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c09f37-9722-4b42-a4ee-52646a07eaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:03.248700 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a8c09f37-9722-4b42-a4ee-52646a07eaed None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:22:03.249940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a8c09f37-9722-4b42-a4ee-52646a07eaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:03.310454 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1246/2477] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 13 01:22:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:22:03.362725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05737477-920d-46cc-85af-6c6bae355ffe admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:03.364195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-05737477-920d-46cc-85af-6c6bae355ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:03.436686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05737477-920d-46cc-85af-6c6bae355ffe admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:03.442285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a738628-ec6e-4c44-8321-61b0c1e783a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:03.442910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a738628-ec6e-4c44-8321-61b0c1e783a5 service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:03.443213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a738628-ec6e-4c44-8321-61b0c1e783a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:03.443492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a738628-ec6e-4c44-8321-61b0c1e783a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:03.453509 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a738628-ec6e-4c44-8321-61b0c1e783a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:03.455152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a738628-ec6e-4c44-8321-61b0c1e783a5 service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:03.465533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1232/2478] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:22:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 01:22:03.509719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e8645-d1f0-4338-8f3c-8eed558f6887 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:03.510322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e8645-d1f0-4338-8f3c-8eed558f6887 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:03.510564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e8645-d1f0-4338-8f3c-8eed558f6887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:03.539833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-727e8645-d1f0-4338-8f3c-8eed558f6887 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:22:03.541568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-727e8645-d1f0-4338-8f3c-8eed558f6887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:03.628906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1247/2479] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Sep 13 01:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:22:03.654313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a738628-ec6e-4c44-8321-61b0c1e783a5 service swift] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:03.656591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1a738628-ec6e-4c44-8321-61b0c1e783a5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:03.778592 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a738628-ec6e-4c44-8321-61b0c1e783a5 service swift] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:03.785007 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3f7db-b70d-403c-83f5-bc64dd619131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:03.786018 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3f7db-b70d-403c-83f5-bc64dd619131 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:03.786511 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3f7db-b70d-403c-83f5-bc64dd619131 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:03.786936 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3f7db-b70d-403c-83f5-bc64dd619131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:03.797312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3f7db-b70d-403c-83f5-bc64dd619131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:03.799267 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3f7db-b70d-403c-83f5-bc64dd619131 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:03.813137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1233/2480] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:22:11.905520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ffc86-db04-48c9-ba9d-fb0b0fc55b34 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:11.906393 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ffc86-db04-48c9-ba9d-fb0b0fc55b34 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:11.906393 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ffc86-db04-48c9-ba9d-fb0b0fc55b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:11.915230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:11.951199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fe1ffc86-db04-48c9-ba9d-fb0b0fc55b34 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:22:11.951199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fe1ffc86-db04-48c9-ba9d-fb0b0fc55b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:11.959657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1248/2481] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Sep 13 01:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:22:11.996520 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3f7db-b70d-403c-83f5-bc64dd619131 service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:11.999267 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-72f3f7db-b70d-403c-83f5-bc64dd619131 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:12.022993 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3f7db-b70d-403c-83f5-bc64dd619131 service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:12.029385 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e48b9-bd98-45ac-8125-5338045a6283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:12.030214 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e48b9-bd98-45ac-8125-5338045a6283 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:12.030575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e48b9-bd98-45ac-8125-5338045a6283 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:12.030851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e48b9-bd98-45ac-8125-5338045a6283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:12.042860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e48b9-bd98-45ac-8125-5338045a6283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:12.044558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e48b9-bd98-45ac-8125-5338045a6283 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:12.048924 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:12.058693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1234/2482] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:22:15.028106 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ffc86-db04-48c9-ba9d-fb0b0fc55b34 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:15.029716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fe1ffc86-db04-48c9-ba9d-fb0b0fc55b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:15.100431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ffc86-db04-48c9-ba9d-fb0b0fc55b34 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:15.122668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55445b6d-9adf-4eba-b8f7-a99c98df13e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:15.122668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55445b6d-9adf-4eba-b8f7-a99c98df13e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:15.122668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55445b6d-9adf-4eba-b8f7-a99c98df13e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:15.122668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55445b6d-9adf-4eba-b8f7-a99c98df13e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:15.123177 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-55445b6d-9adf-4eba-b8f7-a99c98df13e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:15.229211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55445b6d-9adf-4eba-b8f7-a99c98df13e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:15.230874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55445b6d-9adf-4eba-b8f7-a99c98df13e9 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:15.246445 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1249/2483] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:22:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:22:17.469152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467fafc-8dd1-4628-8a0e-8c6fd3954d59 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:17.469771 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467fafc-8dd1-4628-8a0e-8c6fd3954d59 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:17.469771 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467fafc-8dd1-4628-8a0e-8c6fd3954d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:17.493337 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0467fafc-8dd1-4628-8a0e-8c6fd3954d59 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:22:17.495018 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0467fafc-8dd1-4628-8a0e-8c6fd3954d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:17.505686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1235/2484] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Sep 13 01:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:22:17.536189 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55445b6d-9adf-4eba-b8f7-a99c98df13e9 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:17.555929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55445b6d-9adf-4eba-b8f7-a99c98df13e9 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:17.563622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b0497-4f1f-4f84-9ac9-410b28a2c294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:17.564438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b0497-4f1f-4f84-9ac9-410b28a2c294 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:17.564722 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b0497-4f1f-4f84-9ac9-410b28a2c294 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:17.564997 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b0497-4f1f-4f84-9ac9-410b28a2c294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:17.577692 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b0497-4f1f-4f84-9ac9-410b28a2c294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:17.579701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b0497-4f1f-4f84-9ac9-410b28a2c294 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:17.591759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1250/2485] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:22:19.783410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35ff5a-1d5a-45ac-bfdb-40742d7e3c33 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:19.783905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35ff5a-1d5a-45ac-bfdb-40742d7e3c33 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:19.784013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35ff5a-1d5a-45ac-bfdb-40742d7e3c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:19.803743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5e35ff5a-1d5a-45ac-bfdb-40742d7e3c33 None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:22:19.804944 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5e35ff5a-1d5a-45ac-bfdb-40742d7e3c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:19.812320 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1236/2486] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 13 01:22:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:22:19.826272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b0497-4f1f-4f84-9ac9-410b28a2c294 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:19.839447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b0497-4f1f-4f84-9ac9-410b28a2c294 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:19.844478 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6ceef-46cb-4ca5-b0e9-fb5943af2775 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:19.845083 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6ceef-46cb-4ca5-b0e9-fb5943af2775 service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:19.845359 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6ceef-46cb-4ca5-b0e9-fb5943af2775 service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:19.845630 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6ceef-46cb-4ca5-b0e9-fb5943af2775 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:19.856155 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6ceef-46cb-4ca5-b0e9-fb5943af2775 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:19.858047 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6ceef-46cb-4ca5-b0e9-fb5943af2775 service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:19.869012 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1251/2487] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:22:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 01:22:21.584720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79873e-bb22-43c1-8835-038d8d497a6a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:21.585289 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79873e-bb22-43c1-8835-038d8d497a6a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:21.585289 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79873e-bb22-43c1-8835-038d8d497a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:21.606235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-dd79873e-bb22-43c1-8835-038d8d497a6a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:22:21.607563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-dd79873e-bb22-43c1-8835-038d8d497a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:21.615937 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1237/2488] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Sep 13 01:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:22:21.644603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6ceef-46cb-4ca5-b0e9-fb5943af2775 service swift] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:21.661570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6ceef-46cb-4ca5-b0e9-fb5943af2775 service swift] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:21.667461 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4868a1-20a7-4c97-a042-5c3727ad7555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:21.668060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4868a1-20a7-4c97-a042-5c3727ad7555 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:21.668336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4868a1-20a7-4c97-a042-5c3727ad7555 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:21.668607 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4868a1-20a7-4c97-a042-5c3727ad7555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:21.677072 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4868a1-20a7-4c97-a042-5c3727ad7555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:21.678668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4868a1-20a7-4c97-a042-5c3727ad7555 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:21.689368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1252/2489] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:22:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:22:21.932838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685be5a-69b9-4221-85cb-4286ee7ed563 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:21.933235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685be5a-69b9-4221-85cb-4286ee7ed563 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:21.933564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685be5a-69b9-4221-85cb-4286ee7ed563 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:21.935243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1238/2490] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 13 01:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:22:21.970952 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af438e1-2ee8-4c52-9fbc-c1fef98c9d72 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:21.971287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af438e1-2ee8-4c52-9fbc-c1fef98c9d72 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:21.971631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af438e1-2ee8-4c52-9fbc-c1fef98c9d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:21.993276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6af438e1-2ee8-4c52-9fbc-c1fef98c9d72 None None] MFA Rules not processed for user `0c5e6dae854a44a0ad6628e7dd69dfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:22:21.994520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6af438e1-2ee8-4c52-9fbc-c1fef98c9d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:22.005048 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685be5a-69b9-4221-85cb-4286ee7ed563 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:22.006996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4685be5a-69b9-4221-85cb-4286ee7ed563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:22.026264 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685be5a-69b9-4221-85cb-4286ee7ed563 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:22.030983 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c82c2-04a3-4e3c-af74-5d95a9af3db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:22.031733 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c82c2-04a3-4e3c-af74-5d95a9af3db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:22.032074 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c82c2-04a3-4e3c-af74-5d95a9af3db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:22.032408 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c82c2-04a3-4e3c-af74-5d95a9af3db1 admin admin] PATH_INFO: `/v3/users/04b1618bcb6543a89f5783ae999eafa3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:22.033595 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c82c2-04a3-4e3c-af74-5d95a9af3db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b1618bcb6543a89f5783ae999eafa3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:22.035672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c82c2-04a3-4e3c-af74-5d95a9af3db1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:22.064487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1253/2491] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 13 01:22:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:22:22.077161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5c6fa-0ba3-4a26-961e-916fdc800b23 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:22.077365 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5c6fa-0ba3-4a26-961e-916fdc800b23 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:22.077668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5c6fa-0ba3-4a26-961e-916fdc800b23 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:22.079326 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1254/2492] 10.222.0.20 () {54 vars in 961 bytes} [Tue Sep 13 01:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:22:22.083913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce50e8-97b7-413a-8c5b-29c0c9ad2e75 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:22.084031 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-919c82c2-04a3-4e3c-af74-5d95a9af3db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b1618bcb6543a89f5783ae999eafa3'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:22.084200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce50e8-97b7-413a-8c5b-29c0c9ad2e75 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:22.084480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce50e8-97b7-413a-8c5b-29c0c9ad2e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:22.084689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-919c82c2-04a3-4e3c-af74-5d95a9af3db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b1618bcb6543a89f5783ae999eafa3'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:22.093059 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-919c82c2-04a3-4e3c-af74-5d95a9af3db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b1618bcb6543a89f5783ae999eafa3'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:22.093425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:22.106686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-919c82c2-04a3-4e3c-af74-5d95a9af3db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b1618bcb6543a89f5783ae999eafa3'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:22.107044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7fce50e8-97b7-413a-8c5b-29c0c9ad2e75 None None] MFA Rules not processed for user `0c5e6dae854a44a0ad6628e7dd69dfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:22:22.107386 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-919c82c2-04a3-4e3c-af74-5d95a9af3db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b1618bcb6543a89f5783ae999eafa3'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:22.108290 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7fce50e8-97b7-413a-8c5b-29c0c9ad2e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:22.117997 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1255/2493] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Sep 13 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:22:22.121920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1239/2494] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:22:22 2022] DELETE /identity/v3/users/04b1618bcb6543a89f5783ae999eafa3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:22:22.128105 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce50e8-97b7-413a-8c5b-29c0c9ad2e75 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:22.137928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce50e8-97b7-413a-8c5b-29c0c9ad2e75 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:22.201470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4cdbc-cfb5-4220-9d4f-964b5e6d0136 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c5e6dae854a44a0ad6628e7dd69dfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:22.202087 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4cdbc-cfb5-4220-9d4f-964b5e6d0136 service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:22.202368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4cdbc-cfb5-4220-9d4f-964b5e6d0136 service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:22.203019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4cdbc-cfb5-4220-9d4f-964b5e6d0136 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:22.204484 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-eae4cdbc-cfb5-4220-9d4f-964b5e6d0136 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:22.216384 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4cdbc-cfb5-4220-9d4f-964b5e6d0136 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:22.217970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4cdbc-cfb5-4220-9d4f-964b5e6d0136 service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:22.228431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1256/2495] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:22:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:22:22.297188 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c82c2-04a3-4e3c-af74-5d95a9af3db1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:22.298639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-919c82c2-04a3-4e3c-af74-5d95a9af3db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:22.365615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c82c2-04a3-4e3c-af74-5d95a9af3db1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:22.370134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e696d-4338-46e2-9fb3-a23a39255c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:22.370751 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e696d-4338-46e2-9fb3-a23a39255c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:22.371028 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e696d-4338-46e2-9fb3-a23a39255c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:22.371332 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e696d-4338-46e2-9fb3-a23a39255c07 admin admin] PATH_INFO: `/v3/projects/9659b29b7e51434e96f38fecbdfa078f` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:22.372429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e696d-4338-46e2-9fb3-a23a39255c07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9659b29b7e51434e96f38fecbdfa078f)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:22.374311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e696d-4338-46e2-9fb3-a23a39255c07 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:22.437571 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-452e696d-4338-46e2-9fb3-a23a39255c07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9659b29b7e51434e96f38fecbdfa078f', 'request_id': 'req-452e696d-4338-46e2-9fb3-a23a39255c07'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:22.439918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:22.448169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-452e696d-4338-46e2-9fb3-a23a39255c07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9659b29b7e51434e96f38fecbdfa078f', 'request_id': 'req-452e696d-4338-46e2-9fb3-a23a39255c07'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:22.456042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-452e696d-4338-46e2-9fb3-a23a39255c07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9659b29b7e51434e96f38fecbdfa078f', 'request_id': 'req-452e696d-4338-46e2-9fb3-a23a39255c07'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:22.472578 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-452e696d-4338-46e2-9fb3-a23a39255c07 admin admin] The token cache is being invalidate because project 9659b29b7e51434e96f38fecbdfa078f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:22:22.472867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-452e696d-4338-46e2-9fb3-a23a39255c07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:22.473520 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-452e696d-4338-46e2-9fb3-a23a39255c07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:22.475005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1240/2496] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:22:22 2022] DELETE /identity/v3/projects/9659b29b7e51434e96f38fecbdfa078f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:22:22.480330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da8b87-4e29-4f5d-b92b-07083269eda1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:22.480621 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da8b87-4e29-4f5d-b92b-07083269eda1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:22.480898 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da8b87-4e29-4f5d-b92b-07083269eda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:22.500717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-36da8b87-4e29-4f5d-b92b-07083269eda1 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:22:22.501960 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-36da8b87-4e29-4f5d-b92b-07083269eda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:22.560257 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1257/2497] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:22:22.568032 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded87e39-a8dc-443f-a5cb-6981e655cfa3 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:22.568352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded87e39-a8dc-443f-a5cb-6981e655cfa3 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:22.568772 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded87e39-a8dc-443f-a5cb-6981e655cfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:22.594093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ded87e39-a8dc-443f-a5cb-6981e655cfa3 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:22:22.595354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ded87e39-a8dc-443f-a5cb-6981e655cfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:22.603642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1241/2498] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:22:22.607999 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da8b87-4e29-4f5d-b92b-07083269eda1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:22.618397 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da8b87-4e29-4f5d-b92b-07083269eda1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:22.622894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a3286-b515-48a2-9352-11c645994da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:22.623537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a3286-b515-48a2-9352-11c645994da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:22.623807 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a3286-b515-48a2-9352-11c645994da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:22.624083 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a3286-b515-48a2-9352-11c645994da6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:22.624762 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a3286-b515-48a2-9352-11c645994da6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:22:22.625066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a3286-b515-48a2-9352-11c645994da6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:22.626650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a3286-b515-48a2-9352-11c645994da6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:22.638778 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1258/2499] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:22:22.642926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded87e39-a8dc-443f-a5cb-6981e655cfa3 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:22.652322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded87e39-a8dc-443f-a5cb-6981e655cfa3 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:22.656992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707a0c0-c539-40bc-8dee-60957f2a9b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:22.657583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707a0c0-c539-40bc-8dee-60957f2a9b19 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:22.657866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707a0c0-c539-40bc-8dee-60957f2a9b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:22.658140 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707a0c0-c539-40bc-8dee-60957f2a9b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:22.658765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707a0c0-c539-40bc-8dee-60957f2a9b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:22.660691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707a0c0-c539-40bc-8dee-60957f2a9b19 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:22.688059 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1242/2500] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:22:22 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:22:22.692019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a3286-b515-48a2-9352-11c645994da6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:22.702791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a3286-b515-48a2-9352-11c645994da6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:22.763648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e3666-c6da-4283-87ef-55cb871903cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:22.763648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e3666-c6da-4283-87ef-55cb871903cd admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:22.763930 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e3666-c6da-4283-87ef-55cb871903cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:22.764169 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e3666-c6da-4283-87ef-55cb871903cd admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:22.764718 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e3666-c6da-4283-87ef-55cb871903cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:22.767356 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e3666-c6da-4283-87ef-55cb871903cd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:22.792994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1259/2501] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:22:22 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:22:22.796808 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707a0c0-c539-40bc-8dee-60957f2a9b19 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:22.808019 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707a0c0-c539-40bc-8dee-60957f2a9b19 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:22.812702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734e1c8-28ec-485c-9fc1-2489f70d2368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:22.813331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734e1c8-28ec-485c-9fc1-2489f70d2368 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:22.813608 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734e1c8-28ec-485c-9fc1-2489f70d2368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:22.813877 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734e1c8-28ec-485c-9fc1-2489f70d2368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:22.814517 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734e1c8-28ec-485c-9fc1-2489f70d2368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:22.816203 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734e1c8-28ec-485c-9fc1-2489f70d2368 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:22.826691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1243/2502] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:22:22.830748 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e3666-c6da-4283-87ef-55cb871903cd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:22.837026 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:22.842881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e3666-c6da-4283-87ef-55cb871903cd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:22.848356 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c790a-6259-48a9-a877-7a78c6f65a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:22.849030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c790a-6259-48a9-a877-7a78c6f65a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:22.849376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c790a-6259-48a9-a877-7a78c6f65a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:22.849716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c790a-6259-48a9-a877-7a78c6f65a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:22.850428 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c790a-6259-48a9-a877-7a78c6f65a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:22.852770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c790a-6259-48a9-a877-7a78c6f65a96 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:22.864814 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1260/2503] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:22:22.869153 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734e1c8-28ec-485c-9fc1-2489f70d2368 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:22.879470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734e1c8-28ec-485c-9fc1-2489f70d2368 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:22.884697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff10666-31a1-4902-91f3-fcefbcdc5e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:22.885439 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff10666-31a1-4902-91f3-fcefbcdc5e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:22.885784 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff10666-31a1-4902-91f3-fcefbcdc5e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:22.886127 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff10666-31a1-4902-91f3-fcefbcdc5e7c admin admin] PATH_INFO: `/v3/projects/71c6dd16988d4d799c3c1e904bb16990/users/ea0239d7b5224c60a281673b390b1a68/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:22.908013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff10666-31a1-4902-91f3-fcefbcdc5e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c6dd16988d4d799c3c1e904bb16990, user_id=ea0239d7b5224c60a281673b390b1a68, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:22.910661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff10666-31a1-4902-91f3-fcefbcdc5e7c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:22.925814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1244/2504] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:22:22 2022] PUT /identity/v3/projects/71c6dd16988d4d799c3c1e904bb16990/users/ea0239d7b5224c60a281673b390b1a68/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:22:22.936095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6238e-d83a-49d6-9668-a07a3b0a122d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:22.936451 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6238e-d83a-49d6-9668-a07a3b0a122d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:22.936809 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6238e-d83a-49d6-9668-a07a3b0a122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:22.965858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0df6238e-d83a-49d6-9668-a07a3b0a122d None None] MFA Rules not processed for user `ea0239d7b5224c60a281673b390b1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:22:22.967060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0df6238e-d83a-49d6-9668-a07a3b0a122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:23.030745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1261/2505] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:22:23.042418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff10666-31a1-4902-91f3-fcefbcdc5e7c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:23.044131 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7ff10666-31a1-4902-91f3-fcefbcdc5e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:23.101100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff10666-31a1-4902-91f3-fcefbcdc5e7c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:23.105061 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ce1d7-bb0c-4767-8afa-5320d544632b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:23.105659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ce1d7-bb0c-4767-8afa-5320d544632b service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:23.105936 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ce1d7-bb0c-4767-8afa-5320d544632b service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:23.106206 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ce1d7-bb0c-4767-8afa-5320d544632b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:23.114311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ce1d7-bb0c-4767-8afa-5320d544632b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:23.115768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ce1d7-bb0c-4767-8afa-5320d544632b service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:23.124560 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1245/2506] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:22:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:22:23.151612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6238e-d83a-49d6-9668-a07a3b0a122d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:23.215563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6238e-d83a-49d6-9668-a07a3b0a122d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:23.220212 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b432ea6-86cc-4a8b-8270-faeb65f1354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:23.220845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b432ea6-86cc-4a8b-8270-faeb65f1354a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:23.221124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b432ea6-86cc-4a8b-8270-faeb65f1354a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:23.221399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b432ea6-86cc-4a8b-8270-faeb65f1354a admin admin] PATH_INFO: `/v3/users/ea0239d7b5224c60a281673b390b1a68` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:23.222560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b432ea6-86cc-4a8b-8270-faeb65f1354a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea0239d7b5224c60a281673b390b1a68)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:23.224505 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b432ea6-86cc-4a8b-8270-faeb65f1354a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:23.270147 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4b432ea6-86cc-4a8b-8270-faeb65f1354a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea0239d7b5224c60a281673b390b1a68'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:23.270893 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4b432ea6-86cc-4a8b-8270-faeb65f1354a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea0239d7b5224c60a281673b390b1a68'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:23.278627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4b432ea6-86cc-4a8b-8270-faeb65f1354a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea0239d7b5224c60a281673b390b1a68'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:23.290414 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4b432ea6-86cc-4a8b-8270-faeb65f1354a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea0239d7b5224c60a281673b390b1a68'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:23.291119 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4b432ea6-86cc-4a8b-8270-faeb65f1354a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea0239d7b5224c60a281673b390b1a68'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:23.299636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:23.304721 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1262/2507] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:22:23 2022] DELETE /identity/v3/users/ea0239d7b5224c60a281673b390b1a68 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:22:23.309330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed319b-40df-48c0-9916-756bbe849302 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:23.309648 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed319b-40df-48c0-9916-756bbe849302 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:23.309949 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed319b-40df-48c0-9916-756bbe849302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:23.329543 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e3ed319b-40df-48c0-9916-756bbe849302 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:22:23.330749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e3ed319b-40df-48c0-9916-756bbe849302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:23.391537 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1246/2508] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:22:23.401112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b432ea6-86cc-4a8b-8270-faeb65f1354a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:23.402535 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4b432ea6-86cc-4a8b-8270-faeb65f1354a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:23.461042 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b432ea6-86cc-4a8b-8270-faeb65f1354a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:23.464849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2d5a1-8df9-4f14-9f07-4fe476be1386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:23.465446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2d5a1-8df9-4f14-9f07-4fe476be1386 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:23.465726 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2d5a1-8df9-4f14-9f07-4fe476be1386 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:23.466014 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2d5a1-8df9-4f14-9f07-4fe476be1386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:23.474860 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2d5a1-8df9-4f14-9f07-4fe476be1386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:23.476402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2d5a1-8df9-4f14-9f07-4fe476be1386 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:23.485745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1263/2509] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:22:23.752660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed319b-40df-48c0-9916-756bbe849302 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:23.754152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e3ed319b-40df-48c0-9916-756bbe849302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:23.766729 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed319b-40df-48c0-9916-756bbe849302 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:23.771322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c46a2-42f5-457f-83fe-d41187640d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:23.772009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c46a2-42f5-457f-83fe-d41187640d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:23.772221 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c46a2-42f5-457f-83fe-d41187640d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:23.772542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c46a2-42f5-457f-83fe-d41187640d40 admin admin] PATH_INFO: `/v3/projects/71c6dd16988d4d799c3c1e904bb16990` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:23.773769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c46a2-42f5-457f-83fe-d41187640d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c6dd16988d4d799c3c1e904bb16990)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:23.776057 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c46a2-42f5-457f-83fe-d41187640d40 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:23.793213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:23.825271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c40c46a2-42f5-457f-83fe-d41187640d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c6dd16988d4d799c3c1e904bb16990', 'request_id': 'req-c40c46a2-42f5-457f-83fe-d41187640d40'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:23.831297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c40c46a2-42f5-457f-83fe-d41187640d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c6dd16988d4d799c3c1e904bb16990', 'request_id': 'req-c40c46a2-42f5-457f-83fe-d41187640d40'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:23.837402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c40c46a2-42f5-457f-83fe-d41187640d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c6dd16988d4d799c3c1e904bb16990', 'request_id': 'req-c40c46a2-42f5-457f-83fe-d41187640d40'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:23.849754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c40c46a2-42f5-457f-83fe-d41187640d40 admin admin] The token cache is being invalidate because project 71c6dd16988d4d799c3c1e904bb16990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:22:23.850036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c40c46a2-42f5-457f-83fe-d41187640d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:23.850635 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c40c46a2-42f5-457f-83fe-d41187640d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:22:23.853027 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1247/2510] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:22:23 2022] DELETE /identity/v3/projects/71c6dd16988d4d799c3c1e904bb16990 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:22:26.801070 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa546b-d0b2-4570-b28c-460b27ec18a8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:26.801580 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa546b-d0b2-4570-b28c-460b27ec18a8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:26.801675 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa546b-d0b2-4570-b28c-460b27ec18a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:26.821954 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-08aa546b-d0b2-4570-b28c-460b27ec18a8 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:22:26.823259 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-08aa546b-d0b2-4570-b28c-460b27ec18a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:26.884629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1264/2511] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Sep 13 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:22:26.907218 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c46a2-42f5-457f-83fe-d41187640d40 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:26.908625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c40c46a2-42f5-457f-83fe-d41187640d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:26.983868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c46a2-42f5-457f-83fe-d41187640d40 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:26.989353 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ce9ce-ae37-4cf2-8b82-81aefd6ad912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:26.989953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ce9ce-ae37-4cf2-8b82-81aefd6ad912 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:26.990234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ce9ce-ae37-4cf2-8b82-81aefd6ad912 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:26.990507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ce9ce-ae37-4cf2-8b82-81aefd6ad912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:26.999457 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ce9ce-ae37-4cf2-8b82-81aefd6ad912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:27.001028 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ce9ce-ae37-4cf2-8b82-81aefd6ad912 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:27.010338 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1248/2512] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:22:31.003861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd833700-8607-49c8-a761-78ed59dbe242 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:31.004378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd833700-8607-49c8-a761-78ed59dbe242 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:31.004509 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd833700-8607-49c8-a761-78ed59dbe242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:31.024375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fd833700-8607-49c8-a761-78ed59dbe242 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:22:31.025579 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fd833700-8607-49c8-a761-78ed59dbe242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:31.033420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1265/2513] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Sep 13 01:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:22:31.055779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ce9ce-ae37-4cf2-8b82-81aefd6ad912 service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:31.057184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b50ce9ce-ae37-4cf2-8b82-81aefd6ad912 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:31.072313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ce9ce-ae37-4cf2-8b82-81aefd6ad912 service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:31.077748 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d4ab2-eb06-4ea0-bef4-7e06a929bda7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:31.078335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d4ab2-eb06-4ea0-bef4-7e06a929bda7 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:31.078608 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d4ab2-eb06-4ea0-bef4-7e06a929bda7 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:31.078878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d4ab2-eb06-4ea0-bef4-7e06a929bda7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:31.087406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d4ab2-eb06-4ea0-bef4-7e06a929bda7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:31.088972 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d4ab2-eb06-4ea0-bef4-7e06a929bda7 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:31.098079 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1249/2514] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:22:41.018867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=56 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:41.094065 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:43.656276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd833700-8607-49c8-a761-78ed59dbe242 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:22:43.657657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fd833700-8607-49c8-a761-78ed59dbe242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:43.725576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd833700-8607-49c8-a761-78ed59dbe242 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:22:43.731493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8306d7-448e-4ea3-83a1-20446f837c19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c5e6dae854a44a0ad6628e7dd69dfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:22:43.732105 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8306d7-448e-4ea3-83a1-20446f837c19 service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:43.732498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8306d7-448e-4ea3-83a1-20446f837c19 service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:43.732832 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8306d7-448e-4ea3-83a1-20446f837c19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:43.734635 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cf8306d7-448e-4ea3-83a1-20446f837c19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:43.746322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8306d7-448e-4ea3-83a1-20446f837c19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:22:43.747941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8306d7-448e-4ea3-83a1-20446f837c19 service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:22:43.757668 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1266/2515] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:22:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:22:48.617114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a1f85-a113-47c2-8f0d-df86f7f76126 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:22:48.617642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a1f85-a113-47c2-8f0d-df86f7f76126 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:22:48.617801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a1f85-a113-47c2-8f0d-df86f7f76126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:22:48.637042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-737a1f85-a113-47c2-8f0d-df86f7f76126 None None] MFA Rules not processed for user `3170254d280d49dd8f4b9fa52e4d05b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:22:48.638239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-737a1f85-a113-47c2-8f0d-df86f7f76126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:22:48.691432 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1250/2516] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:22:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:22:53.753534 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=32 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:58.684888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=25 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:05.880164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac11bb4-0db0-4c33-9808-f58d072b6297 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:05.880660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac11bb4-0db0-4c33-9808-f58d072b6297 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:05.880774 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac11bb4-0db0-4c33-9808-f58d072b6297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:05.900455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-eac11bb4-0db0-4c33-9808-f58d072b6297 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:23:05.901647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-eac11bb4-0db0-4c33-9808-f58d072b6297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:05.910337 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1267/2517] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Sep 13 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:23:05.935279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a1f85-a113-47c2-8f0d-df86f7f76126 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:23:05.949249 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a1f85-a113-47c2-8f0d-df86f7f76126 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:23:05.956988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b78e1-2c32-4430-83ad-5638a4356439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:23:05.957838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b78e1-2c32-4430-83ad-5638a4356439 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:05.958121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b78e1-2c32-4430-83ad-5638a4356439 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:05.958398 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b78e1-2c32-4430-83ad-5638a4356439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:05.970513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b78e1-2c32-4430-83ad-5638a4356439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:23:05.972225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b78e1-2c32-4430-83ad-5638a4356439 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:23:05.979376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf003c6-7207-4c82-838f-bfa7583aa8d4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:05.979679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf003c6-7207-4c82-838f-bfa7583aa8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:05.979971 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf003c6-7207-4c82-838f-bfa7583aa8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:05.983574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1251/2518] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:23:06.002033 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-bbf003c6-7207-4c82-838f-bfa7583aa8d4 None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:23:06.003303 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bbf003c6-7207-4c82-838f-bfa7583aa8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:06.063268 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1268/2519] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 13 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:23:06.086713 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b78e1-2c32-4430-83ad-5638a4356439 service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:23:06.088909 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ae1b78e1-2c32-4430-83ad-5638a4356439 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:06.158518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b78e1-2c32-4430-83ad-5638a4356439 service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:23:06.163667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87296eaf-aa00-42fb-8278-069f4fa30c6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:23:06.164276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87296eaf-aa00-42fb-8278-069f4fa30c6d service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:06.164554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87296eaf-aa00-42fb-8278-069f4fa30c6d service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:06.164825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87296eaf-aa00-42fb-8278-069f4fa30c6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:06.174560 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87296eaf-aa00-42fb-8278-069f4fa30c6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:23:06.176390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87296eaf-aa00-42fb-8278-069f4fa30c6d service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:23:06.185016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1252/2520] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:23:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 01:23:10.329840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8c141-6618-4c71-b143-f0ad9c663939 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:10.330430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8c141-6618-4c71-b143-f0ad9c663939 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:10.330430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8c141-6618-4c71-b143-f0ad9c663939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:10.351745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-dba8c141-6618-4c71-b143-f0ad9c663939 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:23:10.353050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dba8c141-6618-4c71-b143-f0ad9c663939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:10.364048 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1269/2521] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Sep 13 01:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:23:10.392172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87296eaf-aa00-42fb-8278-069f4fa30c6d service swift] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:23:10.404894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87296eaf-aa00-42fb-8278-069f4fa30c6d service swift] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:23:10.410423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0fb6e-86ef-4d92-b555-028797e2558d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:23:10.411017 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0fb6e-86ef-4d92-b555-028797e2558d service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:10.411329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0fb6e-86ef-4d92-b555-028797e2558d service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:10.411601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0fb6e-86ef-4d92-b555-028797e2558d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:10.427174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0fb6e-86ef-4d92-b555-028797e2558d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:23:10.428859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0fb6e-86ef-4d92-b555-028797e2558d service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:23:10.439174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1253/2522] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:23:14.423131 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e150e8a-035b-45e7-ba02-b8593131fe98 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:14.423665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e150e8a-035b-45e7-ba02-b8593131fe98 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:14.423665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e150e8a-035b-45e7-ba02-b8593131fe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:14.449110 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9e150e8a-035b-45e7-ba02-b8593131fe98 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:23:14.452822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9e150e8a-035b-45e7-ba02-b8593131fe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:14.463649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1270/2523] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Sep 13 01:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:23:14.485278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0fb6e-86ef-4d92-b555-028797e2558d service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:23:14.496934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0fb6e-86ef-4d92-b555-028797e2558d service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:23:14.502700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771fd72-513d-432a-b258-e1ecf7aebb56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:23:14.503393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771fd72-513d-432a-b258-e1ecf7aebb56 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:14.503676 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771fd72-513d-432a-b258-e1ecf7aebb56 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:14.504008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771fd72-513d-432a-b258-e1ecf7aebb56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:14.513830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771fd72-513d-432a-b258-e1ecf7aebb56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:23:14.515854 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771fd72-513d-432a-b258-e1ecf7aebb56 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:23:14.527104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1254/2524] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:23:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:23:18.630036 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6f377-c8ec-4d47-9482-52cdd254755a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:18.630649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6f377-c8ec-4d47-9482-52cdd254755a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:18.630755 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6f377-c8ec-4d47-9482-52cdd254755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:18.651563 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3be6f377-c8ec-4d47-9482-52cdd254755a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:23:18.652768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3be6f377-c8ec-4d47-9482-52cdd254755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:18.660915 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1271/2525] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Sep 13 01:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:23:18.683817 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771fd72-513d-432a-b258-e1ecf7aebb56 service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:23:18.694749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771fd72-513d-432a-b258-e1ecf7aebb56 service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:23:18.701104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68791c64-d889-4af7-8b60-59e8a761e754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:23:18.701698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68791c64-d889-4af7-8b60-59e8a761e754 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:18.701977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68791c64-d889-4af7-8b60-59e8a761e754 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:18.702365 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68791c64-d889-4af7-8b60-59e8a761e754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:18.710734 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68791c64-d889-4af7-8b60-59e8a761e754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:23:18.713711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68791c64-d889-4af7-8b60-59e8a761e754 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:23:18.723740 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1255/2526] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:23:24.067384 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b19792-bb4d-476e-8dd1-5b56df64cc45 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:24.068380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b19792-bb4d-476e-8dd1-5b56df64cc45 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:24.068590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b19792-bb4d-476e-8dd1-5b56df64cc45 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:24.070647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1272/2527] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 13 01:23:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:23:24.078415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ad6f8-139b-4c96-b2a2-88f6a18270d7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:24.078967 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ad6f8-139b-4c96-b2a2-88f6a18270d7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:24.079091 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ad6f8-139b-4c96-b2a2-88f6a18270d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:24.104639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f90ad6f8-139b-4c96-b2a2-88f6a18270d7 None None] MFA Rules not processed for user `fadc83bec6be41979e1aa4d71f8fc2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:23:24.105966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f90ad6f8-139b-4c96-b2a2-88f6a18270d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:24.115973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1256/2528] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 13 01:23:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:23:24.127813 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b19792-bb4d-476e-8dd1-5b56df64cc45 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:23:24.129725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-76b19792-bb4d-476e-8dd1-5b56df64cc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:24.190912 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b19792-bb4d-476e-8dd1-5b56df64cc45 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:23:24.194509 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d513045-aeae-42a4-995e-65b7a4446fa3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c78d95e6774755b11508fc1954ad5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:23:24.195159 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d513045-aeae-42a4-995e-65b7a4446fa3 service glance] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:24.195434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d513045-aeae-42a4-995e-65b7a4446fa3 service glance] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:24.195710 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d513045-aeae-42a4-995e-65b7a4446fa3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:24.206161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d513045-aeae-42a4-995e-65b7a4446fa3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:23:24.207647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d513045-aeae-42a4-995e-65b7a4446fa3 service glance] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:23:24.219243 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1273/2529] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:23:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:23:24.286313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d610570-dccb-4094-8823-a1091b254aa7 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:24.286602 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d610570-dccb-4094-8823-a1091b254aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:24.286882 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d610570-dccb-4094-8823-a1091b254aa7 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:24.288294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1257/2530] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 13 01:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:23:24.293536 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34964661-87a9-4961-85a8-283e3af51eda None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:24.293826 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34964661-87a9-4961-85a8-283e3af51eda None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:24.294102 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34964661-87a9-4961-85a8-283e3af51eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:24.313541 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-34964661-87a9-4961-85a8-283e3af51eda None None] MFA Rules not processed for user `a672e63fa5e345679bac3d67301fe875`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:23:24.314752 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-34964661-87a9-4961-85a8-283e3af51eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:24.365600 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1274/2531] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 13 01:23:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:23:24.377530 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d610570-dccb-4094-8823-a1091b254aa7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:23:24.379250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7d610570-dccb-4094-8823-a1091b254aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:24.393176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d610570-dccb-4094-8823-a1091b254aa7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:23:24.396883 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c86cf3-c751-4a98-bf98-23df929735b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:23:24.397482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c86cf3-c751-4a98-bf98-23df929735b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:24.397762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c86cf3-c751-4a98-bf98-23df929735b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:24.398038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c86cf3-c751-4a98-bf98-23df929735b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:24.406031 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c86cf3-c751-4a98-bf98-23df929735b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:23:24.407501 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c86cf3-c751-4a98-bf98-23df929735b1 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:23:24.415663 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1258/2532] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:23:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:23:24.498230 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb8d66-16bd-4315-932b-f78434cb6803 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:24.498522 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb8d66-16bd-4315-932b-f78434cb6803 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:24.498796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb8d66-16bd-4315-932b-f78434cb6803 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:24.500185 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1275/2533] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 13 01:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:23:24.504977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a62dc1-2466-4a9d-b8fc-bbec751c06ca None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:24.505278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a62dc1-2466-4a9d-b8fc-bbec751c06ca None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:24.505549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a62dc1-2466-4a9d-b8fc-bbec751c06ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:24.526814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-65a62dc1-2466-4a9d-b8fc-bbec751c06ca None None] MFA Rules not processed for user `fadc83bec6be41979e1aa4d71f8fc2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:23:24.528076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-65a62dc1-2466-4a9d-b8fc-bbec751c06ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:24.537151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1259/2534] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 13 01:23:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:23:24.547569 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb8d66-16bd-4315-932b-f78434cb6803 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:23:24.558662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb8d66-16bd-4315-932b-f78434cb6803 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:23:24.562266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42430f75-c232-400a-b3c1-3b372859e4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:23:24.562861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430f75-c232-400a-b3c1-3b372859e4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:24.563173 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430f75-c232-400a-b3c1-3b372859e4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:24.563451 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430f75-c232-400a-b3c1-3b372859e4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:24.574164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42430f75-c232-400a-b3c1-3b372859e4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:23:24.575622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42430f75-c232-400a-b3c1-3b372859e4a4 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:23:24.586106 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1276/2535] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:23:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:23:24.876608 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a888-1f4d-48c1-a741-2cf94260b67e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:24.876897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a888-1f4d-48c1-a741-2cf94260b67e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:24.877185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a888-1f4d-48c1-a741-2cf94260b67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:24.897709 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-96d2a888-1f4d-48c1-a741-2cf94260b67e None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:23:24.898848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-96d2a888-1f4d-48c1-a741-2cf94260b67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:24.907612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1260/2536] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Sep 13 01:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:23:24.944121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42430f75-c232-400a-b3c1-3b372859e4a4 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:23:24.956779 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42430f75-c232-400a-b3c1-3b372859e4a4 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:23:24.962846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8503e-4c4e-49b5-88f5-cc0dc300f74c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:23:24.963482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8503e-4c4e-49b5-88f5-cc0dc300f74c service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:24.963766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8503e-4c4e-49b5-88f5-cc0dc300f74c service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:24.964040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8503e-4c4e-49b5-88f5-cc0dc300f74c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:24.972543 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8503e-4c4e-49b5-88f5-cc0dc300f74c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:23:24.974515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8503e-4c4e-49b5-88f5-cc0dc300f74c service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:23:24.984704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1277/2537] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:23:29.085428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84346a1-238e-452f-a528-4c75117f57af None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:29.085931 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84346a1-238e-452f-a528-4c75117f57af None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:29.086137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84346a1-238e-452f-a528-4c75117f57af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:29.093842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=72 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:29.107086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c84346a1-238e-452f-a528-4c75117f57af None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:23:29.108307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c84346a1-238e-452f-a528-4c75117f57af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:29.115487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1261/2538] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 13 01:23:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:23:29.128765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8503e-4c4e-49b5-88f5-cc0dc300f74c service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:23:29.136057 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:29.141304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8503e-4c4e-49b5-88f5-cc0dc300f74c service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:23:29.146868 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5dfca-1a77-4a87-90d4-30f1d30fe6b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:23:29.147844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5dfca-1a77-4a87-90d4-30f1d30fe6b1 service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:29.148473 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5dfca-1a77-4a87-90d4-30f1d30fe6b1 service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:29.148808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5dfca-1a77-4a87-90d4-30f1d30fe6b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:29.158986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5dfca-1a77-4a87-90d4-30f1d30fe6b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:23:29.160978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5dfca-1a77-4a87-90d4-30f1d30fe6b1 service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:23:29.170808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1278/2539] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:23:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 01:23:39.101184 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:39.166660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:56.887313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84346a1-238e-452f-a528-4c75117f57af None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:23:56.889290 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c84346a1-238e-452f-a528-4c75117f57af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:56.947275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84346a1-238e-452f-a528-4c75117f57af None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:23:56.950963 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be885ee-8571-4cd9-84da-116317d8892a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:23:56.951601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be885ee-8571-4cd9-84da-116317d8892a service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:56.951882 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be885ee-8571-4cd9-84da-116317d8892a service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:56.952153 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be885ee-8571-4cd9-84da-116317d8892a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:56.953870 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5be885ee-8571-4cd9-84da-116317d8892a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:56.967845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be885ee-8571-4cd9-84da-116317d8892a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:23:56.969267 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be885ee-8571-4cd9-84da-116317d8892a service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:23:56.980718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1262/2540] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:23:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:23:57.811997 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b9cd3-eb94-4d4e-bb20-bf4cd412e4da None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:57.812533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b9cd3-eb94-4d4e-bb20-bf4cd412e4da None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:57.812533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b9cd3-eb94-4d4e-bb20-bf4cd412e4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:57.834564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-639b9cd3-eb94-4d4e-bb20-bf4cd412e4da None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:23:57.835820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-639b9cd3-eb94-4d4e-bb20-bf4cd412e4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:57.860090 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1279/2541] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 13 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:23:57.860910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be885ee-8571-4cd9-84da-116317d8892a service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:23:57.884441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be885ee-8571-4cd9-84da-116317d8892a service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:23:57.901816 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32d998-ce77-45c1-a5a9-615dc018ab80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:23:57.902518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32d998-ce77-45c1-a5a9-615dc018ab80 service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:57.902863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32d998-ce77-45c1-a5a9-615dc018ab80 service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:57.903252 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32d998-ce77-45c1-a5a9-615dc018ab80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:57.916661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32d998-ce77-45c1-a5a9-615dc018ab80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:23:57.918415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32d998-ce77-45c1-a5a9-615dc018ab80 service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:23:57.934208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1263/2542] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:23:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 01:23:59.192447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b9cd3-eb94-4d4e-bb20-bf4cd412e4da None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:23:59.202809 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b9cd3-eb94-4d4e-bb20-bf4cd412e4da None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:23:59.206476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4f81d-4076-4e33-b99b-f25633cb5162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:23:59.207120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4f81d-4076-4e33-b99b-f25633cb5162 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:23:59.207407 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4f81d-4076-4e33-b99b-f25633cb5162 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:23:59.207685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4f81d-4076-4e33-b99b-f25633cb5162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:23:59.209477 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-34d4f81d-4076-4e33-b99b-f25633cb5162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:23:59.224159 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4f81d-4076-4e33-b99b-f25633cb5162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:23:59.225529 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4f81d-4076-4e33-b99b-f25633cb5162 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:23:59.245507 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1280/2543] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:23:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:24:07.923899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=32 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:09.237728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=9 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:13.934823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32d998-ce77-45c1-a5a9-615dc018ab80 service swift] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:24:13.946579 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32d998-ce77-45c1-a5a9-615dc018ab80 service swift] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:24:13.952813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa4202-61ce-48cf-ab9f-2cd5d7e10de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:24:13.953428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa4202-61ce-48cf-ab9f-2cd5d7e10de0 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:24:13.953708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa4202-61ce-48cf-ab9f-2cd5d7e10de0 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:24:13.953984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa4202-61ce-48cf-ab9f-2cd5d7e10de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:24:13.955770 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1aaa4202-61ce-48cf-ab9f-2cd5d7e10de0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:24:14.038202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa4202-61ce-48cf-ab9f-2cd5d7e10de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:24:14.043239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa4202-61ce-48cf-ab9f-2cd5d7e10de0 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:24:14.060354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1264/2544] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:24:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:24:19.272687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4f81d-4076-4e33-b99b-f25633cb5162 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:24:19.274186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-34d4f81d-4076-4e33-b99b-f25633cb5162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:24:19.288950 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4f81d-4076-4e33-b99b-f25633cb5162 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:24:19.293877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f74052-6b14-4861-95f9-aaeaa9615768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:24:19.294513 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f74052-6b14-4861-95f9-aaeaa9615768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:24:19.294795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f74052-6b14-4861-95f9-aaeaa9615768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:24:19.295093 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f74052-6b14-4861-95f9-aaeaa9615768 admin admin] PATH_INFO: `/v3/users/3170254d280d49dd8f4b9fa52e4d05b1` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:24:19.296272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f74052-6b14-4861-95f9-aaeaa9615768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3170254d280d49dd8f4b9fa52e4d05b1)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:24:19.298167 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f74052-6b14-4861-95f9-aaeaa9615768 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:24:19.346055 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e9f74052-6b14-4861-95f9-aaeaa9615768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3170254d280d49dd8f4b9fa52e4d05b1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:24:19.346709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e9f74052-6b14-4861-95f9-aaeaa9615768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3170254d280d49dd8f4b9fa52e4d05b1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:24:19.354477 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e9f74052-6b14-4861-95f9-aaeaa9615768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3170254d280d49dd8f4b9fa52e4d05b1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:24:19.366296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e9f74052-6b14-4861-95f9-aaeaa9615768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3170254d280d49dd8f4b9fa52e4d05b1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:24:19.367041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e9f74052-6b14-4861-95f9-aaeaa9615768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3170254d280d49dd8f4b9fa52e4d05b1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:24:19.381338 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1281/2545] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:24:19 2022] DELETE /identity/v3/users/3170254d280d49dd8f4b9fa52e4d05b1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:24:19.553737 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa4202-61ce-48cf-ab9f-2cd5d7e10de0 service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:24:19.565433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa4202-61ce-48cf-ab9f-2cd5d7e10de0 service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:24:19.627468 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:24:19.628112 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:24:19.628373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:24:19.628643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6 admin admin] PATH_INFO: `/v3/projects/4a39fde48f524053a4b31c5fb2c67b2e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:24:19.629741 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a39fde48f524053a4b31c5fb2c67b2e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:24:19.631672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:24:19.677760 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a39fde48f524053a4b31c5fb2c67b2e', 'request_id': 'req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:24:19.684278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a39fde48f524053a4b31c5fb2c67b2e', 'request_id': 'req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:24:19.689768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a39fde48f524053a4b31c5fb2c67b2e', 'request_id': 'req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:24:19.703330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6 admin admin] The token cache is being invalidate because project 4a39fde48f524053a4b31c5fb2c67b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:24:19.703641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:24:19.704393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:24:19.705998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1265/2546] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:24:19 2022] DELETE /identity/v3/projects/4a39fde48f524053a4b31c5fb2c67b2e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:24:24.065005 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207b2bb-7f19-426c-99cd-5a7870ced062 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:24:24.065551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207b2bb-7f19-426c-99cd-5a7870ced062 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:24:24.065551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207b2bb-7f19-426c-99cd-5a7870ced062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:24:24.084622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f207b2bb-7f19-426c-99cd-5a7870ced062 None None] MFA Rules not processed for user `00dbc8a1ee7645668360de8a7cc4ea92`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:24:24.085818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f207b2bb-7f19-426c-99cd-5a7870ced062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:24:24.140474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1282/2547] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:24:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:24:29.206303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:24:29.207885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:24:29.242470 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:29.272849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd4fdc-c68a-4185-9b0a-845e08a2a1f6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:24:29.277225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85510f-6ad9-478a-8a64-4bb1e7026066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:24:29.277862 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85510f-6ad9-478a-8a64-4bb1e7026066 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:24:29.278138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85510f-6ad9-478a-8a64-4bb1e7026066 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:24:29.278410 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85510f-6ad9-478a-8a64-4bb1e7026066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:24:29.280154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-cf85510f-6ad9-478a-8a64-4bb1e7026066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:24:29.291759 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85510f-6ad9-478a-8a64-4bb1e7026066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:24:29.293239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85510f-6ad9-478a-8a64-4bb1e7026066 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:24:29.301797 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1266/2548] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:24:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:24:31.136284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207b2bb-7f19-426c-99cd-5a7870ced062 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:24:31.137719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f207b2bb-7f19-426c-99cd-5a7870ced062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:24:31.214912 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207b2bb-7f19-426c-99cd-5a7870ced062 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:24:31.220733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c586419-445d-4dc4-beb2-c77074c945dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:24:31.221351 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c586419-445d-4dc4-beb2-c77074c945dd service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:24:31.221631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c586419-445d-4dc4-beb2-c77074c945dd service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:24:31.221903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c586419-445d-4dc4-beb2-c77074c945dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:24:31.223648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8c586419-445d-4dc4-beb2-c77074c945dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:24:31.235791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c586419-445d-4dc4-beb2-c77074c945dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:24:31.237373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c586419-445d-4dc4-beb2-c77074c945dd service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:24:31.247777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1283/2549] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:24:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:24:39.298564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=13 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:41.243440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:03.556750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc19ec-3096-4bfc-9eec-f1f0a35f68cb None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:03.557268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc19ec-3096-4bfc-9eec-f1f0a35f68cb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:03.557268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc19ec-3096-4bfc-9eec-f1f0a35f68cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:03.576611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1efc19ec-3096-4bfc-9eec-f1f0a35f68cb None None] MFA Rules not processed for user `26aad3a8d2fa462e9bedcd2a1203571c`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:25:03.577830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1efc19ec-3096-4bfc-9eec-f1f0a35f68cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:03.632892 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1267/2550] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:25:03.945218 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c586419-445d-4dc4-beb2-c77074c945dd service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:03.954702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c586419-445d-4dc4-beb2-c77074c945dd service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:03.958379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7a47f-349a-4514-bd06-5bdfa9636dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:03.958970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7a47f-349a-4514-bd06-5bdfa9636dfa service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:03.959284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7a47f-349a-4514-bd06-5bdfa9636dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:03.959635 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7a47f-349a-4514-bd06-5bdfa9636dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:03.962215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b0f7a47f-349a-4514-bd06-5bdfa9636dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:03.972045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7a47f-349a-4514-bd06-5bdfa9636dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:03.973475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7a47f-349a-4514-bd06-5bdfa9636dfa service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:03.981945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1284/2551] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:25:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:25:04.302272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc19ec-3096-4bfc-9eec-f1f0a35f68cb None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:04.303708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1efc19ec-3096-4bfc-9eec-f1f0a35f68cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:04.375881 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc19ec-3096-4bfc-9eec-f1f0a35f68cb None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:04.380808 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdee99-1db2-4355-befd-2779a29104a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c5e6dae854a44a0ad6628e7dd69dfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:04.381417 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdee99-1db2-4355-befd-2779a29104a0 service placement] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:04.381698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdee99-1db2-4355-befd-2779a29104a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:04.381976 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdee99-1db2-4355-befd-2779a29104a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:04.384233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4bcdee99-1db2-4355-befd-2779a29104a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:04.395598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdee99-1db2-4355-befd-2779a29104a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:04.397205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdee99-1db2-4355-befd-2779a29104a0 service placement] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:04.407743 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1268/2552] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:25:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:25:13.887977 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7a47f-349a-4514-bd06-5bdfa9636dfa service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:13.890190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b0f7a47f-349a-4514-bd06-5bdfa9636dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:13.908281 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7a47f-349a-4514-bd06-5bdfa9636dfa service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:13.923116 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e85d3-e4aa-438c-9a72-41ad38b4bb9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:13.924014 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e85d3-e4aa-438c-9a72-41ad38b4bb9e service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:13.924292 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e85d3-e4aa-438c-9a72-41ad38b4bb9e service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:13.924560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e85d3-e4aa-438c-9a72-41ad38b4bb9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:13.926449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e09e85d3-e4aa-438c-9a72-41ad38b4bb9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:13.939113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e85d3-e4aa-438c-9a72-41ad38b4bb9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:13.940929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e85d3-e4aa-438c-9a72-41ad38b4bb9e service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:13.954059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1285/2553] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:25:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:25:14.403575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=57 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:17.608652 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdee99-1db2-4355-befd-2779a29104a0 service placement] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:17.632482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdee99-1db2-4355-befd-2779a29104a0 service placement] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:17.638376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec21cd-9bee-48be-b445-7044f5a0f0cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:17.639002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec21cd-9bee-48be-b445-7044f5a0f0cf service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:17.639311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec21cd-9bee-48be-b445-7044f5a0f0cf service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:17.639613 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec21cd-9bee-48be-b445-7044f5a0f0cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:17.641379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ceec21cd-9bee-48be-b445-7044f5a0f0cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:17.654650 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec21cd-9bee-48be-b445-7044f5a0f0cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:17.656321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec21cd-9bee-48be-b445-7044f5a0f0cf service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:17.668075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1269/2554] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:25:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:25:19.663268 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e85d3-e4aa-438c-9a72-41ad38b4bb9e service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:19.665557 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e09e85d3-e4aa-438c-9a72-41ad38b4bb9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:19.726759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e85d3-e4aa-438c-9a72-41ad38b4bb9e service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:19.731848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d3877-11f1-40f5-904e-20f411b3437c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:19.732605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d3877-11f1-40f5-904e-20f411b3437c service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:19.732928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d3877-11f1-40f5-904e-20f411b3437c service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:19.733201 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d3877-11f1-40f5-904e-20f411b3437c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:19.735256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e16d3877-11f1-40f5-904e-20f411b3437c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:19.926249 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d3877-11f1-40f5-904e-20f411b3437c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:19.927789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d3877-11f1-40f5-904e-20f411b3437c service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:19.937799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1286/2555] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:25:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:25:27.662528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=6 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:27.740916 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b941a8-c3e3-4bae-b406-7afa59f93c1b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:27.741211 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b941a8-c3e3-4bae-b406-7afa59f93c1b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:27.741490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b941a8-c3e3-4bae-b406-7afa59f93c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:27.761764 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-51b941a8-c3e3-4bae-b406-7afa59f93c1b None None] MFA Rules not processed for user `2821b1a941c543a0aac6f56385c3c8be`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:25:27.762977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-51b941a8-c3e3-4bae-b406-7afa59f93c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:27.769837 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1270/2556] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:25:28.122930 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d3877-11f1-40f5-904e-20f411b3437c service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:28.132052 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d3877-11f1-40f5-904e-20f411b3437c service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:28.136183 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d373e5-316e-4754-a08a-3313ebc913c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:28.136781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d373e5-316e-4754-a08a-3313ebc913c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:28.137059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d373e5-316e-4754-a08a-3313ebc913c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:28.137328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d373e5-316e-4754-a08a-3313ebc913c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:28.139320 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-29d373e5-316e-4754-a08a-3313ebc913c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:28.151248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d373e5-316e-4754-a08a-3313ebc913c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:28.152662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d373e5-316e-4754-a08a-3313ebc913c9 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:28.161459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1287/2557] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:25:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:25:37.756244 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:38.157179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=66 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:52.435169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b941a8-c3e3-4bae-b406-7afa59f93c1b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:52.436561 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-51b941a8-c3e3-4bae-b406-7afa59f93c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:52.448670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b941a8-c3e3-4bae-b406-7afa59f93c1b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:52.452188 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c8277-d887-4a92-9761-2369554e0f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:52.452777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c8277-d887-4a92-9761-2369554e0f55 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:52.453051 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c8277-d887-4a92-9761-2369554e0f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:52.453321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c8277-d887-4a92-9761-2369554e0f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:52.454963 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8d2c8277-d887-4a92-9761-2369554e0f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:52.517521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c8277-d887-4a92-9761-2369554e0f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:52.518937 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c8277-d887-4a92-9761-2369554e0f55 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:52.529939 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1271/2558] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:25:55.724354 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d373e5-316e-4754-a08a-3313ebc913c9 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:55.725882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-29d373e5-316e-4754-a08a-3313ebc913c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:55.741594 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d373e5-316e-4754-a08a-3313ebc913c9 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:55.746408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df862275-671f-4086-ace2-3be24ad9d2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:55.747045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df862275-671f-4086-ace2-3be24ad9d2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:55.747354 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df862275-671f-4086-ace2-3be24ad9d2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:55.747626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df862275-671f-4086-ace2-3be24ad9d2b2 admin admin] PATH_INFO: `/v3/users/00dbc8a1ee7645668360de8a7cc4ea92` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:55.748761 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df862275-671f-4086-ace2-3be24ad9d2b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00dbc8a1ee7645668360de8a7cc4ea92)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:55.750664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df862275-671f-4086-ace2-3be24ad9d2b2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:55.796787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-df862275-671f-4086-ace2-3be24ad9d2b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00dbc8a1ee7645668360de8a7cc4ea92'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:25:55.797438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-df862275-671f-4086-ace2-3be24ad9d2b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00dbc8a1ee7645668360de8a7cc4ea92'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:25:55.804701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-df862275-671f-4086-ace2-3be24ad9d2b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00dbc8a1ee7645668360de8a7cc4ea92'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:25:55.816986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-df862275-671f-4086-ace2-3be24ad9d2b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00dbc8a1ee7645668360de8a7cc4ea92'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:25:55.817641 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-df862275-671f-4086-ace2-3be24ad9d2b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00dbc8a1ee7645668360de8a7cc4ea92'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:25:55.830453 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1288/2559] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:25:55 2022] DELETE /identity/v3/users/00dbc8a1ee7645668360de8a7cc4ea92 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:25:56.009070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c8277-d887-4a92-9761-2369554e0f55 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:56.020060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c8277-d887-4a92-9761-2369554e0f55 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:56.078158 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7b5bc-f6d7-4fba-bfd1-2150994d6ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:56.078784 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7b5bc-f6d7-4fba-bfd1-2150994d6ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:56.079088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7b5bc-f6d7-4fba-bfd1-2150994d6ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:56.079359 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7b5bc-f6d7-4fba-bfd1-2150994d6ecc admin admin] PATH_INFO: `/v3/projects/dd3afbb360cd434d9afbde71b1680a27` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:56.080477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7b5bc-f6d7-4fba-bfd1-2150994d6ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3afbb360cd434d9afbde71b1680a27)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:56.082378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7b5bc-f6d7-4fba-bfd1-2150994d6ecc admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:56.128166 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-64c7b5bc-f6d7-4fba-bfd1-2150994d6ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3afbb360cd434d9afbde71b1680a27', 'request_id': 'req-64c7b5bc-f6d7-4fba-bfd1-2150994d6ecc'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:25:56.134800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-64c7b5bc-f6d7-4fba-bfd1-2150994d6ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3afbb360cd434d9afbde71b1680a27', 'request_id': 'req-64c7b5bc-f6d7-4fba-bfd1-2150994d6ecc'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:25:56.140716 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-64c7b5bc-f6d7-4fba-bfd1-2150994d6ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3afbb360cd434d9afbde71b1680a27', 'request_id': 'req-64c7b5bc-f6d7-4fba-bfd1-2150994d6ecc'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:25:56.153618 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-64c7b5bc-f6d7-4fba-bfd1-2150994d6ecc admin admin] The token cache is being invalidate because project dd3afbb360cd434d9afbde71b1680a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:25:56.154022 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-64c7b5bc-f6d7-4fba-bfd1-2150994d6ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:25:56.154657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-64c7b5bc-f6d7-4fba-bfd1-2150994d6ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:25:56.156199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1272/2560] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:25:56 2022] DELETE /identity/v3/projects/dd3afbb360cd434d9afbde71b1680a27 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:25:56.161086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d8753-b434-4857-93e0-73bb57353262 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:56.161416 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d8753-b434-4857-93e0-73bb57353262 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:56.161694 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d8753-b434-4857-93e0-73bb57353262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:56.181433 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f87d8753-b434-4857-93e0-73bb57353262 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:25:56.182623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f87d8753-b434-4857-93e0-73bb57353262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:56.240364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1289/2561] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:25:56.248570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa635c26-b9d5-42f2-9922-74c6d79c1269 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:56.248862 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa635c26-b9d5-42f2-9922-74c6d79c1269 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:56.249148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa635c26-b9d5-42f2-9922-74c6d79c1269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:56.270471 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-fa635c26-b9d5-42f2-9922-74c6d79c1269 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:25:56.271742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fa635c26-b9d5-42f2-9922-74c6d79c1269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:56.280231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1273/2562] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:25:56.284457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d8753-b434-4857-93e0-73bb57353262 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:56.295307 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d8753-b434-4857-93e0-73bb57353262 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:56.300025 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa16ac-2dce-4030-80fe-08f79801e845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:56.300610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa16ac-2dce-4030-80fe-08f79801e845 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:56.300882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa16ac-2dce-4030-80fe-08f79801e845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:56.301149 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa16ac-2dce-4030-80fe-08f79801e845 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:56.301885 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa16ac-2dce-4030-80fe-08f79801e845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:25:56.302182 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa16ac-2dce-4030-80fe-08f79801e845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:56.304018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa16ac-2dce-4030-80fe-08f79801e845 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:56.316000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1290/2563] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:25:56.320188 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa635c26-b9d5-42f2-9922-74c6d79c1269 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:56.329384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa635c26-b9d5-42f2-9922-74c6d79c1269 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:56.334009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95ea50-4ef1-4a3d-aa52-d1e3dd5954b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:56.334597 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95ea50-4ef1-4a3d-aa52-d1e3dd5954b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:56.334882 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95ea50-4ef1-4a3d-aa52-d1e3dd5954b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:56.335205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95ea50-4ef1-4a3d-aa52-d1e3dd5954b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:56.336369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95ea50-4ef1-4a3d-aa52-d1e3dd5954b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:56.338518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95ea50-4ef1-4a3d-aa52-d1e3dd5954b3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:56.354074 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:56.367871 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1274/2564] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:25:56 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:25:56.371984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa16ac-2dce-4030-80fe-08f79801e845 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:56.381569 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa16ac-2dce-4030-80fe-08f79801e845 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:56.438311 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492474b-5845-4d63-9353-8468ec608176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:56.438914 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492474b-5845-4d63-9353-8468ec608176 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:56.439222 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492474b-5845-4d63-9353-8468ec608176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:56.439490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492474b-5845-4d63-9353-8468ec608176 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:56.440121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492474b-5845-4d63-9353-8468ec608176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:56.441990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492474b-5845-4d63-9353-8468ec608176 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:56.450286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:56.465555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1291/2565] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:25:56 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:25:56.469697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95ea50-4ef1-4a3d-aa52-d1e3dd5954b3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:56.482674 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95ea50-4ef1-4a3d-aa52-d1e3dd5954b3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:56.487351 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660607b-0347-463c-a0b2-9f6f251fd0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:56.487956 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660607b-0347-463c-a0b2-9f6f251fd0be admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:56.488233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660607b-0347-463c-a0b2-9f6f251fd0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:56.488508 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660607b-0347-463c-a0b2-9f6f251fd0be admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:56.489166 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660607b-0347-463c-a0b2-9f6f251fd0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:56.490848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660607b-0347-463c-a0b2-9f6f251fd0be admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:56.501597 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1275/2566] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:25:56.505580 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492474b-5845-4d63-9353-8468ec608176 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:56.515317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492474b-5845-4d63-9353-8468ec608176 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:56.520164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70012f2-c2a7-4d82-8ec4-7fdba8313baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:56.520753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70012f2-c2a7-4d82-8ec4-7fdba8313baf admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:56.521056 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70012f2-c2a7-4d82-8ec4-7fdba8313baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:56.521325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70012f2-c2a7-4d82-8ec4-7fdba8313baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:56.521963 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70012f2-c2a7-4d82-8ec4-7fdba8313baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:56.524346 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70012f2-c2a7-4d82-8ec4-7fdba8313baf admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:56.534384 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1292/2567] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:25:56.538654 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660607b-0347-463c-a0b2-9f6f251fd0be admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:56.549154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660607b-0347-463c-a0b2-9f6f251fd0be admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:56.553659 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8d1fc-9073-4e0f-9bd8-2182ba630dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:56.554409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8d1fc-9073-4e0f-9bd8-2182ba630dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:56.554922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8d1fc-9073-4e0f-9bd8-2182ba630dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:56.555304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8d1fc-9073-4e0f-9bd8-2182ba630dcd admin admin] PATH_INFO: `/v3/projects/37ae67d448c74141b995f8072dea4d9a/users/a5c11ed9bfa84d01892d5d0c3025139b/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:56.569330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8d1fc-9073-4e0f-9bd8-2182ba630dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ae67d448c74141b995f8072dea4d9a, user_id=a5c11ed9bfa84d01892d5d0c3025139b, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:56.572805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8d1fc-9073-4e0f-9bd8-2182ba630dcd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:56.585087 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1276/2568] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:25:56 2022] PUT /identity/v3/projects/37ae67d448c74141b995f8072dea4d9a/users/a5c11ed9bfa84d01892d5d0c3025139b/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:25:56.597306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4dc18-f6c5-43f9-87be-9ff818b1fbfc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:56.597615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4dc18-f6c5-43f9-87be-9ff818b1fbfc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:56.597913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4dc18-f6c5-43f9-87be-9ff818b1fbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:56.626449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-beb4dc18-f6c5-43f9-87be-9ff818b1fbfc None None] MFA Rules not processed for user `a5c11ed9bfa84d01892d5d0c3025139b`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:25:56.627679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-beb4dc18-f6c5-43f9-87be-9ff818b1fbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:56.692072 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1293/2569] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:25:56.703254 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8d1fc-9073-4e0f-9bd8-2182ba630dcd admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:25:56.705013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-10d8d1fc-9073-4e0f-9bd8-2182ba630dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:25:56.764003 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8d1fc-9073-4e0f-9bd8-2182ba630dcd admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:25:56.767703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1329d7b-6368-4ed2-9b74-f307c1a07cda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:25:56.768314 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1329d7b-6368-4ed2-9b74-f307c1a07cda service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:25:56.768592 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1329d7b-6368-4ed2-9b74-f307c1a07cda service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:25:56.768863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1329d7b-6368-4ed2-9b74-f307c1a07cda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:25:56.777155 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1329d7b-6368-4ed2-9b74-f307c1a07cda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:25:56.778584 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1329d7b-6368-4ed2-9b74-f307c1a07cda service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:25:56.787304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1277/2570] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:25:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:26:05.153367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4dc18-f6c5-43f9-87be-9ff818b1fbfc None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:05.218824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4dc18-f6c5-43f9-87be-9ff818b1fbfc None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:05.223353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c833f0-7178-4d7b-bf21-9ce1862944f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:05.223977 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c833f0-7178-4d7b-bf21-9ce1862944f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:05.224256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c833f0-7178-4d7b-bf21-9ce1862944f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:05.224536 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c833f0-7178-4d7b-bf21-9ce1862944f9 admin admin] PATH_INFO: `/v3/users/a5c11ed9bfa84d01892d5d0c3025139b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:05.225647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c833f0-7178-4d7b-bf21-9ce1862944f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5c11ed9bfa84d01892d5d0c3025139b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:05.227914 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c833f0-7178-4d7b-bf21-9ce1862944f9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:05.274222 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c1c833f0-7178-4d7b-bf21-9ce1862944f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5c11ed9bfa84d01892d5d0c3025139b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:05.274871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c1c833f0-7178-4d7b-bf21-9ce1862944f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5c11ed9bfa84d01892d5d0c3025139b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:05.281955 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c1c833f0-7178-4d7b-bf21-9ce1862944f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5c11ed9bfa84d01892d5d0c3025139b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:05.292183 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:05.294671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c1c833f0-7178-4d7b-bf21-9ce1862944f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5c11ed9bfa84d01892d5d0c3025139b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:05.295879 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c1c833f0-7178-4d7b-bf21-9ce1862944f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5c11ed9bfa84d01892d5d0c3025139b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:05.309081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1294/2571] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:26:05 2022] DELETE /identity/v3/users/a5c11ed9bfa84d01892d5d0c3025139b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:26:05.313685 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e562aa-c13e-4c00-9ac8-4d84ef753013 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:05.314171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e562aa-c13e-4c00-9ac8-4d84ef753013 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:05.314300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e562aa-c13e-4c00-9ac8-4d84ef753013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:05.334074 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-85e562aa-c13e-4c00-9ac8-4d84ef753013 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:05.335330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-85e562aa-c13e-4c00-9ac8-4d84ef753013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:05.393988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1278/2572] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:05.403800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c833f0-7178-4d7b-bf21-9ce1862944f9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:05.405190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c1c833f0-7178-4d7b-bf21-9ce1862944f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:05.463504 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c833f0-7178-4d7b-bf21-9ce1862944f9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:05.467035 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f21df-59dd-4f05-bdfa-81e792e417d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:05.467656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f21df-59dd-4f05-bdfa-81e792e417d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:05.467934 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f21df-59dd-4f05-bdfa-81e792e417d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:05.468209 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f21df-59dd-4f05-bdfa-81e792e417d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:05.476995 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f21df-59dd-4f05-bdfa-81e792e417d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:05.478409 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f21df-59dd-4f05-bdfa-81e792e417d2 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:05.487871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1295/2573] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:26:05.758341 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e562aa-c13e-4c00-9ac8-4d84ef753013 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:05.759803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-85e562aa-c13e-4c00-9ac8-4d84ef753013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:05.771779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e562aa-c13e-4c00-9ac8-4d84ef753013 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:05.776731 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82465b42-eed7-4892-ae75-a45a5d931e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:05.777383 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82465b42-eed7-4892-ae75-a45a5d931e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:05.777649 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82465b42-eed7-4892-ae75-a45a5d931e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:05.777921 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82465b42-eed7-4892-ae75-a45a5d931e91 admin admin] PATH_INFO: `/v3/projects/37ae67d448c74141b995f8072dea4d9a` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:05.779043 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82465b42-eed7-4892-ae75-a45a5d931e91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ae67d448c74141b995f8072dea4d9a)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:05.780991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82465b42-eed7-4892-ae75-a45a5d931e91 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:05.829640 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-82465b42-eed7-4892-ae75-a45a5d931e91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ae67d448c74141b995f8072dea4d9a', 'request_id': 'req-82465b42-eed7-4892-ae75-a45a5d931e91'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:05.835762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-82465b42-eed7-4892-ae75-a45a5d931e91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ae67d448c74141b995f8072dea4d9a', 'request_id': 'req-82465b42-eed7-4892-ae75-a45a5d931e91'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:05.839987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:05.842010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-82465b42-eed7-4892-ae75-a45a5d931e91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ae67d448c74141b995f8072dea4d9a', 'request_id': 'req-82465b42-eed7-4892-ae75-a45a5d931e91'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:05.856357 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-82465b42-eed7-4892-ae75-a45a5d931e91 admin admin] The token cache is being invalidate because project 37ae67d448c74141b995f8072dea4d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:26:05.856641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-82465b42-eed7-4892-ae75-a45a5d931e91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:05.857257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-82465b42-eed7-4892-ae75-a45a5d931e91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:05.858834 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1279/2574] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:26:05 2022] DELETE /identity/v3/projects/37ae67d448c74141b995f8072dea4d9a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:26:05.864788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc0c8a-f9bc-4d82-8e46-c4db104ea678 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:05.865081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc0c8a-f9bc-4d82-8e46-c4db104ea678 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:05.865360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc0c8a-f9bc-4d82-8e46-c4db104ea678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:05.886202 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-84bc0c8a-f9bc-4d82-8e46-c4db104ea678 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:05.887446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-84bc0c8a-f9bc-4d82-8e46-c4db104ea678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:05.946223 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1296/2575] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:05.954148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b019b-81e2-4eaa-87c3-7a8550650011 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:05.954433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b019b-81e2-4eaa-87c3-7a8550650011 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:05.954708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b019b-81e2-4eaa-87c3-7a8550650011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:05.975217 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e11b019b-81e2-4eaa-87c3-7a8550650011 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:05.977026 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e11b019b-81e2-4eaa-87c3-7a8550650011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:05.984895 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1280/2576] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:05.989405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc0c8a-f9bc-4d82-8e46-c4db104ea678 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:05.999234 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc0c8a-f9bc-4d82-8e46-c4db104ea678 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:06.003636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5270f9-448c-4d63-867c-2375085f0dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:06.004272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5270f9-448c-4d63-867c-2375085f0dff admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:06.004551 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5270f9-448c-4d63-867c-2375085f0dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:06.004820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5270f9-448c-4d63-867c-2375085f0dff admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:06.005458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5270f9-448c-4d63-867c-2375085f0dff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:26:06.005753 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5270f9-448c-4d63-867c-2375085f0dff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:06.007511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5270f9-448c-4d63-867c-2375085f0dff admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:06.018762 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1297/2577] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:26:06.023441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b019b-81e2-4eaa-87c3-7a8550650011 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:06.032585 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b019b-81e2-4eaa-87c3-7a8550650011 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:06.037262 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2028d19-4016-44e7-a987-3e6daec923e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:06.037856 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2028d19-4016-44e7-a987-3e6daec923e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:06.038139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2028d19-4016-44e7-a987-3e6daec923e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:06.039052 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2028d19-4016-44e7-a987-3e6daec923e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:06.039851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2028d19-4016-44e7-a987-3e6daec923e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:06.041748 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2028d19-4016-44e7-a987-3e6daec923e0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:06.068603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1281/2578] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:26:06 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:26:06.072734 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5270f9-448c-4d63-867c-2375085f0dff admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:06.082489 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5270f9-448c-4d63-867c-2375085f0dff admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:06.137756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac576a48-5cba-4225-9b15-85e18b415493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:06.138342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac576a48-5cba-4225-9b15-85e18b415493 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:06.138614 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac576a48-5cba-4225-9b15-85e18b415493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:06.138878 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac576a48-5cba-4225-9b15-85e18b415493 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:06.139535 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac576a48-5cba-4225-9b15-85e18b415493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:06.141409 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac576a48-5cba-4225-9b15-85e18b415493 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:06.162973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1298/2579] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:26:06 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:26:06.167524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2028d19-4016-44e7-a987-3e6daec923e0 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:06.180093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2028d19-4016-44e7-a987-3e6daec923e0 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:06.185075 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98643d0-0747-4e67-b58d-044fa5197fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:06.185893 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98643d0-0747-4e67-b58d-044fa5197fed admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:06.186186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98643d0-0747-4e67-b58d-044fa5197fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:06.186464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98643d0-0747-4e67-b58d-044fa5197fed admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:06.187138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98643d0-0747-4e67-b58d-044fa5197fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:06.188728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98643d0-0747-4e67-b58d-044fa5197fed admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:06.198660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1282/2580] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:26:06.202723 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac576a48-5cba-4225-9b15-85e18b415493 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:06.213064 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac576a48-5cba-4225-9b15-85e18b415493 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:06.218341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23ef06-1674-408f-a834-3f01f94c9d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:06.218951 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ef06-1674-408f-a834-3f01f94c9d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:06.219262 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ef06-1674-408f-a834-3f01f94c9d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:06.219536 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ef06-1674-408f-a834-3f01f94c9d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:06.220178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23ef06-1674-408f-a834-3f01f94c9d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:06.221777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23ef06-1674-408f-a834-3f01f94c9d62 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:06.223020 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:06.235203 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1299/2581] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:26:06.238963 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98643d0-0747-4e67-b58d-044fa5197fed admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:06.249202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98643d0-0747-4e67-b58d-044fa5197fed admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:06.253774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aecd2-883d-4a2e-9db5-e4540678da16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:06.254412 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aecd2-883d-4a2e-9db5-e4540678da16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:06.254692 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aecd2-883d-4a2e-9db5-e4540678da16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:06.254967 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aecd2-883d-4a2e-9db5-e4540678da16 admin admin] PATH_INFO: `/v3/projects/616babefdaab48d997f0f1c29b007cbf/users/79ac24f0e5494bc287a27d3b50b4def5/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:06.269318 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aecd2-883d-4a2e-9db5-e4540678da16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=616babefdaab48d997f0f1c29b007cbf, user_id=79ac24f0e5494bc287a27d3b50b4def5, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:06.271979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aecd2-883d-4a2e-9db5-e4540678da16 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:06.286137 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1283/2582] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:26:06 2022] PUT /identity/v3/projects/616babefdaab48d997f0f1c29b007cbf/users/79ac24f0e5494bc287a27d3b50b4def5/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:26:06.297329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f7261-621f-4166-861e-268c4273d4b2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:06.297613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f7261-621f-4166-861e-268c4273d4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:06.297885 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f7261-621f-4166-861e-268c4273d4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:06.326008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d97f7261-621f-4166-861e-268c4273d4b2 None None] MFA Rules not processed for user `79ac24f0e5494bc287a27d3b50b4def5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:06.327260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d97f7261-621f-4166-861e-268c4273d4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:06.390822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1300/2583] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:06.395292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aecd2-883d-4a2e-9db5-e4540678da16 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:06.457567 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aecd2-883d-4a2e-9db5-e4540678da16 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:06.462914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15edd9e-2b91-4f59-ae21-48ef5ed4f404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:06.463820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15edd9e-2b91-4f59-ae21-48ef5ed4f404 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:06.464098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15edd9e-2b91-4f59-ae21-48ef5ed4f404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:06.464375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15edd9e-2b91-4f59-ae21-48ef5ed4f404 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:06.465007 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15edd9e-2b91-4f59-ae21-48ef5ed4f404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:06.466894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15edd9e-2b91-4f59-ae21-48ef5ed4f404 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:06.492680 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1284/2584] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:26:06 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:26:06.496765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f7261-621f-4166-861e-268c4273d4b2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:06.508490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f7261-621f-4166-861e-268c4273d4b2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:06.565812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae20cf4-7145-4234-a09a-7c7292ea9f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:06.566480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae20cf4-7145-4234-a09a-7c7292ea9f40 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:06.566787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae20cf4-7145-4234-a09a-7c7292ea9f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:06.567086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae20cf4-7145-4234-a09a-7c7292ea9f40 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:06.567737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae20cf4-7145-4234-a09a-7c7292ea9f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:06.570248 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae20cf4-7145-4234-a09a-7c7292ea9f40 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:06.592599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1301/2585] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:26:06 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:26:06.596721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15edd9e-2b91-4f59-ae21-48ef5ed4f404 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:06.607153 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15edd9e-2b91-4f59-ae21-48ef5ed4f404 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:06.611863 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff734a-877f-455b-9438-4179378455cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:06.612539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff734a-877f-455b-9438-4179378455cb admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:06.612886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff734a-877f-455b-9438-4179378455cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:06.613230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff734a-877f-455b-9438-4179378455cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:06.613931 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff734a-877f-455b-9438-4179378455cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:06.615657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff734a-877f-455b-9438-4179378455cb admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:06.626657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1285/2586] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:26:06.630856 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae20cf4-7145-4234-a09a-7c7292ea9f40 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:06.641686 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae20cf4-7145-4234-a09a-7c7292ea9f40 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:06.646245 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bc2df-9c94-45ee-bfad-baa3ccba493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:06.646882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bc2df-9c94-45ee-bfad-baa3ccba493b admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:06.647191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bc2df-9c94-45ee-bfad-baa3ccba493b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:06.647464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bc2df-9c94-45ee-bfad-baa3ccba493b admin admin] PATH_INFO: `/v3/projects/9d921a17dbe2480ea34a92f33ecc70b0/users/118f1e437b7141c5b973f38ac5681a23/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:06.662473 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bc2df-9c94-45ee-bfad-baa3ccba493b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d921a17dbe2480ea34a92f33ecc70b0, user_id=118f1e437b7141c5b973f38ac5681a23, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:06.665385 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bc2df-9c94-45ee-bfad-baa3ccba493b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:06.678191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1302/2587] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:26:06 2022] PUT /identity/v3/projects/9d921a17dbe2480ea34a92f33ecc70b0/users/118f1e437b7141c5b973f38ac5681a23/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:26:06.683430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff734a-877f-455b-9438-4179378455cb admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:06.693294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff734a-877f-455b-9438-4179378455cb admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:06.745521 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:06.752324 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0f90d-a749-4e11-b9c9-e0b0a6e0049d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:06.753020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0f90d-a749-4e11-b9c9-e0b0a6e0049d admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:06.753524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0f90d-a749-4e11-b9c9-e0b0a6e0049d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:06.754008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0f90d-a749-4e11-b9c9-e0b0a6e0049d admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:06.754730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0f90d-a749-4e11-b9c9-e0b0a6e0049d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:06.756539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0f90d-a749-4e11-b9c9-e0b0a6e0049d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:06.767697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1286/2588] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:26:06.772200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bc2df-9c94-45ee-bfad-baa3ccba493b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:06.782500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bc2df-9c94-45ee-bfad-baa3ccba493b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:06.787060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420f67-6113-4804-b395-db79abf73811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:06.787731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420f67-6113-4804-b395-db79abf73811 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:06.788011 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420f67-6113-4804-b395-db79abf73811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:06.788336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420f67-6113-4804-b395-db79abf73811 admin admin] PATH_INFO: `/v3/projects/9d921a17dbe2480ea34a92f33ecc70b0/users/118f1e437b7141c5b973f38ac5681a23/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:06.790604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b420f67-6113-4804-b395-db79abf73811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d921a17dbe2480ea34a92f33ecc70b0, user_id=118f1e437b7141c5b973f38ac5681a23, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:06.793253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b420f67-6113-4804-b395-db79abf73811 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:06.803267 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1303/2589] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:26:06 2022] PUT /identity/v3/projects/9d921a17dbe2480ea34a92f33ecc70b0/users/118f1e437b7141c5b973f38ac5681a23/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:26:06.818080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70889f-66b0-4eaf-b6fc-053aa1262c41 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:06.818372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70889f-66b0-4eaf-b6fc-053aa1262c41 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:06.818654 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70889f-66b0-4eaf-b6fc-053aa1262c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:06.848128 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-cc70889f-66b0-4eaf-b6fc-053aa1262c41 None None] MFA Rules not processed for user `118f1e437b7141c5b973f38ac5681a23`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:06.849350 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-cc70889f-66b0-4eaf-b6fc-053aa1262c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:06.918633 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1287/2590] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:06.929902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420f67-6113-4804-b395-db79abf73811 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:06.931655 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3b420f67-6113-4804-b395-db79abf73811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:06.973882 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:06.989498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420f67-6113-4804-b395-db79abf73811 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:06.993836 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756c46f-bb7c-4614-9f09-f6440f8c70ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:06.994430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756c46f-bb7c-4614-9f09-f6440f8c70ac service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:06.994705 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756c46f-bb7c-4614-9f09-f6440f8c70ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:06.994971 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756c46f-bb7c-4614-9f09-f6440f8c70ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:07.003855 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756c46f-bb7c-4614-9f09-f6440f8c70ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:07.005217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756c46f-bb7c-4614-9f09-f6440f8c70ac service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:07.015879 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1304/2591] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:26:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:26:07.421285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70889f-66b0-4eaf-b6fc-053aa1262c41 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:07.489592 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70889f-66b0-4eaf-b6fc-053aa1262c41 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:07.494204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21762e-4cb8-47b6-a98d-cb3fc2febc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:07.494827 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21762e-4cb8-47b6-a98d-cb3fc2febc4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:07.495139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21762e-4cb8-47b6-a98d-cb3fc2febc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:07.495423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21762e-4cb8-47b6-a98d-cb3fc2febc4a admin admin] PATH_INFO: `/v3/users/79ac24f0e5494bc287a27d3b50b4def5` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:07.496530 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21762e-4cb8-47b6-a98d-cb3fc2febc4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ac24f0e5494bc287a27d3b50b4def5)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:07.498447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21762e-4cb8-47b6-a98d-cb3fc2febc4a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:07.545528 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3e21762e-4cb8-47b6-a98d-cb3fc2febc4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ac24f0e5494bc287a27d3b50b4def5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:07.546095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3e21762e-4cb8-47b6-a98d-cb3fc2febc4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ac24f0e5494bc287a27d3b50b4def5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:07.552918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3e21762e-4cb8-47b6-a98d-cb3fc2febc4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ac24f0e5494bc287a27d3b50b4def5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:07.565083 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3e21762e-4cb8-47b6-a98d-cb3fc2febc4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ac24f0e5494bc287a27d3b50b4def5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:07.565711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3e21762e-4cb8-47b6-a98d-cb3fc2febc4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ac24f0e5494bc287a27d3b50b4def5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:07.574138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:07.580844 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1288/2592] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:26:07 2022] DELETE /identity/v3/users/79ac24f0e5494bc287a27d3b50b4def5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:26:07.585286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e8a71-cb2a-4112-a21b-df6cc1544221 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:07.585806 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e8a71-cb2a-4112-a21b-df6cc1544221 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:07.585906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e8a71-cb2a-4112-a21b-df6cc1544221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:07.605822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c86e8a71-cb2a-4112-a21b-df6cc1544221 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:07.607016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c86e8a71-cb2a-4112-a21b-df6cc1544221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:07.665896 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1305/2593] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:26:07.675762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21762e-4cb8-47b6-a98d-cb3fc2febc4a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:07.677284 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3e21762e-4cb8-47b6-a98d-cb3fc2febc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:07.734881 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21762e-4cb8-47b6-a98d-cb3fc2febc4a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:07.738530 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46fb17-dd28-4352-a819-127b20cd3558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:07.739163 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46fb17-dd28-4352-a819-127b20cd3558 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:07.739448 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46fb17-dd28-4352-a819-127b20cd3558 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:07.739722 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46fb17-dd28-4352-a819-127b20cd3558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:07.749338 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46fb17-dd28-4352-a819-127b20cd3558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:07.750830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46fb17-dd28-4352-a819-127b20cd3558 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:07.760471 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1289/2594] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:26:08.020128 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e8a71-cb2a-4112-a21b-df6cc1544221 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:08.021647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c86e8a71-cb2a-4112-a21b-df6cc1544221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:08.043094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e8a71-cb2a-4112-a21b-df6cc1544221 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:08.046151 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85540199-1f1f-4478-adb5-844b6115f00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:08.046782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85540199-1f1f-4478-adb5-844b6115f00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:08.047123 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85540199-1f1f-4478-adb5-844b6115f00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:08.047403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85540199-1f1f-4478-adb5-844b6115f00e admin admin] PATH_INFO: `/v3/projects/616babefdaab48d997f0f1c29b007cbf` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:08.048562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85540199-1f1f-4478-adb5-844b6115f00e admin admin] RBAC: Authorizing `identity:delete_project(project_id=616babefdaab48d997f0f1c29b007cbf)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:08.051018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85540199-1f1f-4478-adb5-844b6115f00e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:08.099380 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-85540199-1f1f-4478-adb5-844b6115f00e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616babefdaab48d997f0f1c29b007cbf', 'request_id': 'req-85540199-1f1f-4478-adb5-844b6115f00e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:08.106347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-85540199-1f1f-4478-adb5-844b6115f00e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616babefdaab48d997f0f1c29b007cbf', 'request_id': 'req-85540199-1f1f-4478-adb5-844b6115f00e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:08.112442 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-85540199-1f1f-4478-adb5-844b6115f00e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616babefdaab48d997f0f1c29b007cbf', 'request_id': 'req-85540199-1f1f-4478-adb5-844b6115f00e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:08.122756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-85540199-1f1f-4478-adb5-844b6115f00e admin admin] The token cache is being invalidate because project 616babefdaab48d997f0f1c29b007cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:26:08.123040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-85540199-1f1f-4478-adb5-844b6115f00e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:08.123691 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-85540199-1f1f-4478-adb5-844b6115f00e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:08.125186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1306/2595] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:26:08 2022] DELETE /identity/v3/projects/616babefdaab48d997f0f1c29b007cbf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:26:08.129205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46fb17-dd28-4352-a819-127b20cd3558 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:08.139549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46fb17-dd28-4352-a819-127b20cd3558 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:08.197941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f6dd5-6e84-4873-8fd2-327dcfbf6d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:08.198572 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f6dd5-6e84-4873-8fd2-327dcfbf6d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:08.198880 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f6dd5-6e84-4873-8fd2-327dcfbf6d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:08.199190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f6dd5-6e84-4873-8fd2-327dcfbf6d1e admin admin] PATH_INFO: `/v3/users/118f1e437b7141c5b973f38ac5681a23` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:08.200388 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f6dd5-6e84-4873-8fd2-327dcfbf6d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=118f1e437b7141c5b973f38ac5681a23)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:08.202340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f6dd5-6e84-4873-8fd2-327dcfbf6d1e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:08.248472 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b41f6dd5-6e84-4873-8fd2-327dcfbf6d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118f1e437b7141c5b973f38ac5681a23'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:08.249138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b41f6dd5-6e84-4873-8fd2-327dcfbf6d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118f1e437b7141c5b973f38ac5681a23'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:08.256130 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b41f6dd5-6e84-4873-8fd2-327dcfbf6d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118f1e437b7141c5b973f38ac5681a23'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:08.268489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b41f6dd5-6e84-4873-8fd2-327dcfbf6d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118f1e437b7141c5b973f38ac5681a23'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:08.269189 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b41f6dd5-6e84-4873-8fd2-327dcfbf6d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118f1e437b7141c5b973f38ac5681a23'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:08.281967 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1290/2596] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:26:08 2022] DELETE /identity/v3/users/118f1e437b7141c5b973f38ac5681a23 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:26:08.557422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85540199-1f1f-4478-adb5-844b6115f00e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:08.558966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-85540199-1f1f-4478-adb5-844b6115f00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:08.572294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85540199-1f1f-4478-adb5-844b6115f00e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:08.629467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbf34b-fb6a-40d1-9c17-5e7d146f696f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:08.630103 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbf34b-fb6a-40d1-9c17-5e7d146f696f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:08.630282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbf34b-fb6a-40d1-9c17-5e7d146f696f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:08.630553 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbf34b-fb6a-40d1-9c17-5e7d146f696f admin admin] PATH_INFO: `/v3/projects/9d921a17dbe2480ea34a92f33ecc70b0` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:08.631673 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbf34b-fb6a-40d1-9c17-5e7d146f696f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d921a17dbe2480ea34a92f33ecc70b0)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:08.633768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbf34b-fb6a-40d1-9c17-5e7d146f696f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:08.639913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:08.681983 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0abbf34b-fb6a-40d1-9c17-5e7d146f696f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d921a17dbe2480ea34a92f33ecc70b0', 'request_id': 'req-0abbf34b-fb6a-40d1-9c17-5e7d146f696f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:08.689293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0abbf34b-fb6a-40d1-9c17-5e7d146f696f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d921a17dbe2480ea34a92f33ecc70b0', 'request_id': 'req-0abbf34b-fb6a-40d1-9c17-5e7d146f696f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:08.696193 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0abbf34b-fb6a-40d1-9c17-5e7d146f696f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d921a17dbe2480ea34a92f33ecc70b0', 'request_id': 'req-0abbf34b-fb6a-40d1-9c17-5e7d146f696f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:08.706652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0abbf34b-fb6a-40d1-9c17-5e7d146f696f admin admin] The token cache is being invalidate because project 9d921a17dbe2480ea34a92f33ecc70b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:26:08.706941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0abbf34b-fb6a-40d1-9c17-5e7d146f696f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:08.707649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0abbf34b-fb6a-40d1-9c17-5e7d146f696f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:08.709160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1307/2597] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:26:08 2022] DELETE /identity/v3/projects/9d921a17dbe2480ea34a92f33ecc70b0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:26:08.715969 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0906f2-2645-40e9-be1f-3ec989907bc2 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:08.716449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0906f2-2645-40e9-be1f-3ec989907bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:08.716572 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0906f2-2645-40e9-be1f-3ec989907bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:08.736819 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6d0906f2-2645-40e9-be1f-3ec989907bc2 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:08.738046 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6d0906f2-2645-40e9-be1f-3ec989907bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:08.751681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:08.801900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1291/2598] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:08.810098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb800e-1685-4064-b440-368cb047e9a4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:08.810381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb800e-1685-4064-b440-368cb047e9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:08.810654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb800e-1685-4064-b440-368cb047e9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:08.831644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-edcb800e-1685-4064-b440-368cb047e9a4 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:08.832833 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-edcb800e-1685-4064-b440-368cb047e9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:08.841769 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1308/2599] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:08.845994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0906f2-2645-40e9-be1f-3ec989907bc2 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:08.855888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0906f2-2645-40e9-be1f-3ec989907bc2 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:08.862736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd647022-3832-40da-ad21-4cd398158a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:08.863360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd647022-3832-40da-ad21-4cd398158a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:08.863639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd647022-3832-40da-ad21-4cd398158a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:08.863913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd647022-3832-40da-ad21-4cd398158a96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:08.864557 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd647022-3832-40da-ad21-4cd398158a96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:26:08.864859 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd647022-3832-40da-ad21-4cd398158a96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:08.866464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd647022-3832-40da-ad21-4cd398158a96 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:08.878007 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1292/2600] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:26:08.882257 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb800e-1685-4064-b440-368cb047e9a4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:08.891912 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb800e-1685-4064-b440-368cb047e9a4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:08.897029 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3ab18-38c6-4d60-99ed-fec446e52a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:08.897617 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3ab18-38c6-4d60-99ed-fec446e52a24 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:08.897919 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3ab18-38c6-4d60-99ed-fec446e52a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:08.898245 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3ab18-38c6-4d60-99ed-fec446e52a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:08.899654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3ab18-38c6-4d60-99ed-fec446e52a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:08.901522 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3ab18-38c6-4d60-99ed-fec446e52a24 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:08.929011 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1309/2601] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:26:08 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:26:08.933850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd647022-3832-40da-ad21-4cd398158a96 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:08.944029 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd647022-3832-40da-ad21-4cd398158a96 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:09.001001 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9958ff-5f25-4ee6-b485-eeefa4b8cf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:09.001598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9958ff-5f25-4ee6-b485-eeefa4b8cf24 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:09.001874 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9958ff-5f25-4ee6-b485-eeefa4b8cf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:09.002144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9958ff-5f25-4ee6-b485-eeefa4b8cf24 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:09.002762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9958ff-5f25-4ee6-b485-eeefa4b8cf24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:09.004697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9958ff-5f25-4ee6-b485-eeefa4b8cf24 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:09.026169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1293/2602] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:26:08 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:26:09.030379 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3ab18-38c6-4d60-99ed-fec446e52a24 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:09.040721 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3ab18-38c6-4d60-99ed-fec446e52a24 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:09.045256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4567ce6-bf3d-44cb-a29e-0c449e9b3aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:09.045848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4567ce6-bf3d-44cb-a29e-0c449e9b3aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:09.046125 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4567ce6-bf3d-44cb-a29e-0c449e9b3aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:09.046396 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4567ce6-bf3d-44cb-a29e-0c449e9b3aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:09.047032 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4567ce6-bf3d-44cb-a29e-0c449e9b3aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:09.048636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4567ce6-bf3d-44cb-a29e-0c449e9b3aa2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:09.059025 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1310/2603] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:26:09.062947 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9958ff-5f25-4ee6-b485-eeefa4b8cf24 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:09.073522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9958ff-5f25-4ee6-b485-eeefa4b8cf24 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:09.078114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d9fbf-1ee2-42d5-8800-0e5503a0149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:09.078715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d9fbf-1ee2-42d5-8800-0e5503a0149a admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:09.078994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d9fbf-1ee2-42d5-8800-0e5503a0149a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:09.079300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d9fbf-1ee2-42d5-8800-0e5503a0149a admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:09.079936 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d9fbf-1ee2-42d5-8800-0e5503a0149a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:09.081531 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d9fbf-1ee2-42d5-8800-0e5503a0149a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:09.092338 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1294/2604] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:26:09.096277 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4567ce6-bf3d-44cb-a29e-0c449e9b3aa2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:09.105991 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4567ce6-bf3d-44cb-a29e-0c449e9b3aa2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:09.110515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ac91a-f0ec-44db-a3b1-9984a57a7800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:09.111174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ac91a-f0ec-44db-a3b1-9984a57a7800 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:09.111456 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ac91a-f0ec-44db-a3b1-9984a57a7800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:09.111729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ac91a-f0ec-44db-a3b1-9984a57a7800 admin admin] PATH_INFO: `/v3/projects/4a9aeedfb17044f4b9b8609867dd5d9a/users/e372cf18b98040dda32827d05c204d32/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:09.128619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ac91a-f0ec-44db-a3b1-9984a57a7800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9aeedfb17044f4b9b8609867dd5d9a, user_id=e372cf18b98040dda32827d05c204d32, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:09.131270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ac91a-f0ec-44db-a3b1-9984a57a7800 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:09.144717 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1311/2605] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:26:09 2022] PUT /identity/v3/projects/4a9aeedfb17044f4b9b8609867dd5d9a/users/e372cf18b98040dda32827d05c204d32/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:26:09.154927 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447288f-3660-4c88-a408-280c2827469a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:09.155258 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447288f-3660-4c88-a408-280c2827469a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:09.155539 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447288f-3660-4c88-a408-280c2827469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:09.185185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e447288f-3660-4c88-a408-280c2827469a None None] MFA Rules not processed for user `e372cf18b98040dda32827d05c204d32`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:09.186404 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e447288f-3660-4c88-a408-280c2827469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:09.249738 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1295/2606] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:09.262669 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ac91a-f0ec-44db-a3b1-9984a57a7800 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:09.264363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-236ac91a-f0ec-44db-a3b1-9984a57a7800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:09.321095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ac91a-f0ec-44db-a3b1-9984a57a7800 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:09.324737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c23eb-52fc-477c-80f4-2fc093102b28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:09.325316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c23eb-52fc-477c-80f4-2fc093102b28 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:09.325597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c23eb-52fc-477c-80f4-2fc093102b28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:09.325870 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c23eb-52fc-477c-80f4-2fc093102b28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:09.333978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c23eb-52fc-477c-80f4-2fc093102b28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:09.335437 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c23eb-52fc-477c-80f4-2fc093102b28 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:09.345069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1312/2607] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:26:09 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:26:14.330067 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447288f-3660-4c88-a408-280c2827469a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:14.347215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:14.393299 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447288f-3660-4c88-a408-280c2827469a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:14.397731 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1742f56-080d-4f44-bed6-3756e3da1053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:14.398358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742f56-080d-4f44-bed6-3756e3da1053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:14.398815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742f56-080d-4f44-bed6-3756e3da1053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:14.399235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742f56-080d-4f44-bed6-3756e3da1053 admin admin] PATH_INFO: `/v3/users/e372cf18b98040dda32827d05c204d32` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:14.400349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1742f56-080d-4f44-bed6-3756e3da1053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e372cf18b98040dda32827d05c204d32)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:14.402237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1742f56-080d-4f44-bed6-3756e3da1053 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:14.448835 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c1742f56-080d-4f44-bed6-3756e3da1053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e372cf18b98040dda32827d05c204d32'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:14.449473 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c1742f56-080d-4f44-bed6-3756e3da1053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e372cf18b98040dda32827d05c204d32'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:14.456598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c1742f56-080d-4f44-bed6-3756e3da1053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e372cf18b98040dda32827d05c204d32'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:14.469117 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c1742f56-080d-4f44-bed6-3756e3da1053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e372cf18b98040dda32827d05c204d32'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:14.469757 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c1742f56-080d-4f44-bed6-3756e3da1053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e372cf18b98040dda32827d05c204d32'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:14.482516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1296/2608] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:26:14 2022] DELETE /identity/v3/users/e372cf18b98040dda32827d05c204d32 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:26:14.486995 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edb783-e18f-49da-9930-2187068cb584 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:14.487496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edb783-e18f-49da-9930-2187068cb584 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:14.487626 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edb783-e18f-49da-9930-2187068cb584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:14.506781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-70edb783-e18f-49da-9930-2187068cb584 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:14.508558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-70edb783-e18f-49da-9930-2187068cb584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:14.536575 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:14.568294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1313/2609] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:14.577701 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1742f56-080d-4f44-bed6-3756e3da1053 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:14.579149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c1742f56-080d-4f44-bed6-3756e3da1053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:14.645021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1742f56-080d-4f44-bed6-3756e3da1053 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:14.648861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9e1fd-b874-44d0-baf1-00d8c92cccdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:14.649556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9e1fd-b874-44d0-baf1-00d8c92cccdd service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:14.649839 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9e1fd-b874-44d0-baf1-00d8c92cccdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:14.650289 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9e1fd-b874-44d0-baf1-00d8c92cccdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:14.659624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9e1fd-b874-44d0-baf1-00d8c92cccdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:14.661147 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9e1fd-b874-44d0-baf1-00d8c92cccdd service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:14.672083 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1297/2610] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:26:14.952375 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edb783-e18f-49da-9930-2187068cb584 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:14.953819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-70edb783-e18f-49da-9930-2187068cb584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:14.968135 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edb783-e18f-49da-9930-2187068cb584 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:14.972966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce80ecd-bd2e-4d69-a9a9-0ca8e8825802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:14.974325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce80ecd-bd2e-4d69-a9a9-0ca8e8825802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:14.974620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce80ecd-bd2e-4d69-a9a9-0ca8e8825802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:14.974894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce80ecd-bd2e-4d69-a9a9-0ca8e8825802 admin admin] PATH_INFO: `/v3/projects/4a9aeedfb17044f4b9b8609867dd5d9a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:14.976053 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce80ecd-bd2e-4d69-a9a9-0ca8e8825802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a9aeedfb17044f4b9b8609867dd5d9a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:14.978700 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce80ecd-bd2e-4d69-a9a9-0ca8e8825802 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:15.025607 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9ce80ecd-bd2e-4d69-a9a9-0ca8e8825802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9aeedfb17044f4b9b8609867dd5d9a', 'request_id': 'req-9ce80ecd-bd2e-4d69-a9a9-0ca8e8825802'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:15.032306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9ce80ecd-bd2e-4d69-a9a9-0ca8e8825802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9aeedfb17044f4b9b8609867dd5d9a', 'request_id': 'req-9ce80ecd-bd2e-4d69-a9a9-0ca8e8825802'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:15.038489 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9ce80ecd-bd2e-4d69-a9a9-0ca8e8825802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9aeedfb17044f4b9b8609867dd5d9a', 'request_id': 'req-9ce80ecd-bd2e-4d69-a9a9-0ca8e8825802'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:15.049210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9ce80ecd-bd2e-4d69-a9a9-0ca8e8825802 admin admin] The token cache is being invalidate because project 4a9aeedfb17044f4b9b8609867dd5d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:26:15.049492 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9ce80ecd-bd2e-4d69-a9a9-0ca8e8825802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:15.050113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9ce80ecd-bd2e-4d69-a9a9-0ca8e8825802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:26:15.051622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1314/2611] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:26:14 2022] DELETE /identity/v3/projects/4a9aeedfb17044f4b9b8609867dd5d9a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:26:15.057583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caee32-53f8-4519-842e-9a425a6abc50 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:15.057867 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caee32-53f8-4519-842e-9a425a6abc50 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:15.058141 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caee32-53f8-4519-842e-9a425a6abc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:15.077413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b9caee32-53f8-4519-842e-9a425a6abc50 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:15.078533 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b9caee32-53f8-4519-842e-9a425a6abc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:15.111566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:15.139209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1298/2612] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:15.146847 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1adc71-cb5e-4b3e-ac75-2000435c94a5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:15.147188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1adc71-cb5e-4b3e-ac75-2000435c94a5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:15.147459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1adc71-cb5e-4b3e-ac75-2000435c94a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:15.167993 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7e1adc71-cb5e-4b3e-ac75-2000435c94a5 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:15.169181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7e1adc71-cb5e-4b3e-ac75-2000435c94a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:15.177314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1315/2613] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:15.181855 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caee32-53f8-4519-842e-9a425a6abc50 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:15.191360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caee32-53f8-4519-842e-9a425a6abc50 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:15.196171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105de9a4-471b-48ee-ab2f-19eb49c75a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:15.196762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de9a4-471b-48ee-ab2f-19eb49c75a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:15.197035 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de9a4-471b-48ee-ab2f-19eb49c75a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:15.197303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de9a4-471b-48ee-ab2f-19eb49c75a38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:15.197941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105de9a4-471b-48ee-ab2f-19eb49c75a38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:26:15.198238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105de9a4-471b-48ee-ab2f-19eb49c75a38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:15.199868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105de9a4-471b-48ee-ab2f-19eb49c75a38 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:15.211943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1299/2614] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:26:15.216438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1adc71-cb5e-4b3e-ac75-2000435c94a5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:15.225669 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1adc71-cb5e-4b3e-ac75-2000435c94a5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:15.231324 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001df1c-03ab-415c-b4a0-7c21052103a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:15.231923 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001df1c-03ab-415c-b4a0-7c21052103a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:15.232201 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001df1c-03ab-415c-b4a0-7c21052103a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:15.232475 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001df1c-03ab-415c-b4a0-7c21052103a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:15.233098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001df1c-03ab-415c-b4a0-7c21052103a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:15.234992 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001df1c-03ab-415c-b4a0-7c21052103a6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:15.261920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1316/2615] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:26:15 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:26:15.266069 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105de9a4-471b-48ee-ab2f-19eb49c75a38 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:15.276718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105de9a4-471b-48ee-ab2f-19eb49c75a38 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:15.333203 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c55e8-1807-497f-b287-8a9920064888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:15.333817 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c55e8-1807-497f-b287-8a9920064888 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:15.333990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c55e8-1807-497f-b287-8a9920064888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:15.334262 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c55e8-1807-497f-b287-8a9920064888 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:15.334890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c55e8-1807-497f-b287-8a9920064888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:15.337213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c55e8-1807-497f-b287-8a9920064888 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:15.360085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1300/2616] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:26:15 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:26:15.364185 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001df1c-03ab-415c-b4a0-7c21052103a6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:15.375742 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001df1c-03ab-415c-b4a0-7c21052103a6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:15.380500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03e97-38aa-48da-b304-b60614976d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:15.381132 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03e97-38aa-48da-b304-b60614976d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:15.381442 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03e97-38aa-48da-b304-b60614976d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:15.381716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03e97-38aa-48da-b304-b60614976d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:15.382347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb03e97-38aa-48da-b304-b60614976d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:15.384329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb03e97-38aa-48da-b304-b60614976d87 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:15.394402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1317/2617] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:26:15.398181 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c55e8-1807-497f-b287-8a9920064888 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:15.408768 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c55e8-1807-497f-b287-8a9920064888 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:15.413557 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df45a0-272c-465f-b16d-fbb9c40ac614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:15.415156 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df45a0-272c-465f-b16d-fbb9c40ac614 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:15.415156 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df45a0-272c-465f-b16d-fbb9c40ac614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:15.415416 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df45a0-272c-465f-b16d-fbb9c40ac614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:15.416029 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df45a0-272c-465f-b16d-fbb9c40ac614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:15.417660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df45a0-272c-465f-b16d-fbb9c40ac614 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:15.433423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1301/2618] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:26:15.437660 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03e97-38aa-48da-b304-b60614976d87 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:15.447845 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03e97-38aa-48da-b304-b60614976d87 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:15.452457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcf7ee-8a57-4b9b-af7c-e6511356f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:15.453106 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcf7ee-8a57-4b9b-af7c-e6511356f330 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:15.453393 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcf7ee-8a57-4b9b-af7c-e6511356f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:15.453672 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcf7ee-8a57-4b9b-af7c-e6511356f330 admin admin] PATH_INFO: `/v3/projects/95810dc0be054d44b5b0deea9e3a0a8a/users/03f85d2218824876a423a85a837e44a9/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:15.469295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcf7ee-8a57-4b9b-af7c-e6511356f330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95810dc0be054d44b5b0deea9e3a0a8a, user_id=03f85d2218824876a423a85a837e44a9, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:15.471967 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcf7ee-8a57-4b9b-af7c-e6511356f330 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:15.485600 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1318/2619] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:26:15 2022] PUT /identity/v3/projects/95810dc0be054d44b5b0deea9e3a0a8a/users/03f85d2218824876a423a85a837e44a9/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:26:15.490667 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa7006-88c8-42d0-a97e-5fc2f1508473 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:15.490938 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa7006-88c8-42d0-a97e-5fc2f1508473 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:15.491253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa7006-88c8-42d0-a97e-5fc2f1508473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:15.510756 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-94fa7006-88c8-42d0-a97e-5fc2f1508473 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:15.512017 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-94fa7006-88c8-42d0-a97e-5fc2f1508473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:15.571318 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1302/2620] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:15.580957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcf7ee-8a57-4b9b-af7c-e6511356f330 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:15.582719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7cdcf7ee-8a57-4b9b-af7c-e6511356f330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:15.639118 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcf7ee-8a57-4b9b-af7c-e6511356f330 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:15.642670 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8cade-7998-4179-aa1c-c8348e5903ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:15.643298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8cade-7998-4179-aa1c-c8348e5903ff service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:15.643578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8cade-7998-4179-aa1c-c8348e5903ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:15.643849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8cade-7998-4179-aa1c-c8348e5903ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:15.650612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:15.652959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8cade-7998-4179-aa1c-c8348e5903ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:15.654733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8cade-7998-4179-aa1c-c8348e5903ff service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:15.666136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1319/2621] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:26:19.777080 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de9ebc-ea4c-4fdc-9de5-948c2e92019c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:19.777538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de9ebc-ea4c-4fdc-9de5-948c2e92019c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:19.777646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de9ebc-ea4c-4fdc-9de5-948c2e92019c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:19.808994 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f6de9ebc-ea4c-4fdc-9de5-948c2e92019c None None] MFA Rules not processed for user `03f85d2218824876a423a85a837e44a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:19.810227 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f6de9ebc-ea4c-4fdc-9de5-948c2e92019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:19.861897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:19.901584 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1303/2622] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:19.906127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8cade-7998-4179-aa1c-c8348e5903ff service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:19.916476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8cade-7998-4179-aa1c-c8348e5903ff service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:19.921330 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973689-c042-44c4-8d6f-3d6d9c380d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:19.921941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973689-c042-44c4-8d6f-3d6d9c380d1f admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:19.922226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973689-c042-44c4-8d6f-3d6d9c380d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:19.922501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973689-c042-44c4-8d6f-3d6d9c380d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:19.923193 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973689-c042-44c4-8d6f-3d6d9c380d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:19.925095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973689-c042-44c4-8d6f-3d6d9c380d1f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:19.958719 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1320/2623] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:26:19 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:26:19.963139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de9ebc-ea4c-4fdc-9de5-948c2e92019c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:19.974369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de9ebc-ea4c-4fdc-9de5-948c2e92019c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:20.036204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a21186-055a-4857-8838-a767772f7b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:20.036828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a21186-055a-4857-8838-a767772f7b79 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:20.037111 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a21186-055a-4857-8838-a767772f7b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:20.037412 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a21186-055a-4857-8838-a767772f7b79 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:20.038055 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a21186-055a-4857-8838-a767772f7b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:20.040098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a21186-055a-4857-8838-a767772f7b79 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:20.066809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1304/2624] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:26:19 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:26:20.071498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973689-c042-44c4-8d6f-3d6d9c380d1f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:20.082154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973689-c042-44c4-8d6f-3d6d9c380d1f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:20.087739 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d0e7c-2529-4c41-8e79-eee756851f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:20.088609 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d0e7c-2529-4c41-8e79-eee756851f1c admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:20.088898 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d0e7c-2529-4c41-8e79-eee756851f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:20.089169 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d0e7c-2529-4c41-8e79-eee756851f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:20.089815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d0e7c-2529-4c41-8e79-eee756851f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:20.091453 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d0e7c-2529-4c41-8e79-eee756851f1c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:20.102840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1321/2625] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:26:20.107045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a21186-055a-4857-8838-a767772f7b79 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:20.117690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a21186-055a-4857-8838-a767772f7b79 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:20.122409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb67f5-c938-41e4-86aa-51ca52695517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:20.123095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb67f5-c938-41e4-86aa-51ca52695517 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:20.123404 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb67f5-c938-41e4-86aa-51ca52695517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:20.123679 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb67f5-c938-41e4-86aa-51ca52695517 admin admin] PATH_INFO: `/v3/projects/c0c024e5e9904153831866d60e12aa54/users/a8cb6958b83f418d8f1023ce8cd7fc3a/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:20.140223 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb67f5-c938-41e4-86aa-51ca52695517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c024e5e9904153831866d60e12aa54, user_id=a8cb6958b83f418d8f1023ce8cd7fc3a, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:20.142871 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb67f5-c938-41e4-86aa-51ca52695517 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:20.157296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1305/2626] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:26:20 2022] PUT /identity/v3/projects/c0c024e5e9904153831866d60e12aa54/users/a8cb6958b83f418d8f1023ce8cd7fc3a/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:26:20.161279 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d0e7c-2529-4c41-8e79-eee756851f1c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:20.171711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d0e7c-2529-4c41-8e79-eee756851f1c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:20.234532 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1387e-7b0e-4c92-85c9-5952d380952e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:20.235187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1387e-7b0e-4c92-85c9-5952d380952e admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:20.235470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1387e-7b0e-4c92-85c9-5952d380952e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:20.235741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1387e-7b0e-4c92-85c9-5952d380952e admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:20.236414 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1387e-7b0e-4c92-85c9-5952d380952e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:20.238042 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1387e-7b0e-4c92-85c9-5952d380952e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:20.253949 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1322/2627] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:26:20.255177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb67f5-c938-41e4-86aa-51ca52695517 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:20.269335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb67f5-c938-41e4-86aa-51ca52695517 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:20.281234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bd54f-5345-4fce-bec7-7da935bafddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:20.281914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bd54f-5345-4fce-bec7-7da935bafddf admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:20.282194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bd54f-5345-4fce-bec7-7da935bafddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:20.282487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bd54f-5345-4fce-bec7-7da935bafddf admin admin] PATH_INFO: `/v3/projects/c0c024e5e9904153831866d60e12aa54/users/a8cb6958b83f418d8f1023ce8cd7fc3a/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:20.284446 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3bd54f-5345-4fce-bec7-7da935bafddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c024e5e9904153831866d60e12aa54, user_id=a8cb6958b83f418d8f1023ce8cd7fc3a, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:20.287173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3bd54f-5345-4fce-bec7-7da935bafddf admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:20.298896 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1306/2628] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:26:20 2022] PUT /identity/v3/projects/c0c024e5e9904153831866d60e12aa54/users/a8cb6958b83f418d8f1023ce8cd7fc3a/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:26:24.684457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452db51-bb3e-493c-a248-8fc0fd751d36 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:24.684967 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452db51-bb3e-493c-a248-8fc0fd751d36 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:24.685070 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452db51-bb3e-493c-a248-8fc0fd751d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:24.713929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e452db51-bb3e-493c-a248-8fc0fd751d36 None None] MFA Rules not processed for user `a8cb6958b83f418d8f1023ce8cd7fc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:24.715199 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e452db51-bb3e-493c-a248-8fc0fd751d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:24.793695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1323/2629] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:24.801980 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bd54f-5345-4fce-bec7-7da935bafddf admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:24.803594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4b3bd54f-5345-4fce-bec7-7da935bafddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:24.866476 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bd54f-5345-4fce-bec7-7da935bafddf admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:24.870844 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e0823-2605-4ee5-b77a-21cf329df21a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c78d95e6774755b11508fc1954ad5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:24.871511 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e0823-2605-4ee5-b77a-21cf329df21a service glance] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:24.871794 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e0823-2605-4ee5-b77a-21cf329df21a service glance] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:24.872195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e0823-2605-4ee5-b77a-21cf329df21a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:24.920128 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:24.942228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e0823-2605-4ee5-b77a-21cf329df21a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:24.943896 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e0823-2605-4ee5-b77a-21cf329df21a service glance] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:24.956052 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1307/2630] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:26:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:26:25.105422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ba1c6-73fc-4838-8136-137bef719a14 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:25.105709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ba1c6-73fc-4838-8136-137bef719a14 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:25.105985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ba1c6-73fc-4838-8136-137bef719a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:25.146583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c73ba1c6-73fc-4838-8136-137bef719a14 None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:25.147821 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c73ba1c6-73fc-4838-8136-137bef719a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:25.193328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:25.209643 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1324/2631] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 13 01:26:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:25.262972 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e0823-2605-4ee5-b77a-21cf329df21a service glance] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:25.264432 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bd5e0823-2605-4ee5-b77a-21cf329df21a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:25.340822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e0823-2605-4ee5-b77a-21cf329df21a service glance] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:25.345862 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caada8e1-d88d-49d6-b1c2-0854511f49da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:25.346481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caada8e1-d88d-49d6-b1c2-0854511f49da service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:25.346759 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caada8e1-d88d-49d6-b1c2-0854511f49da service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:25.347033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caada8e1-d88d-49d6-b1c2-0854511f49da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:25.357249 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caada8e1-d88d-49d6-b1c2-0854511f49da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:25.358849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caada8e1-d88d-49d6-b1c2-0854511f49da service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:25.369341 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1308/2632] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:26:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 01:26:33.953078 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ba1c6-73fc-4838-8136-137bef719a14 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:33.954520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c73ba1c6-73fc-4838-8136-137bef719a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:34.036154 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ba1c6-73fc-4838-8136-137bef719a14 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:34.043351 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeccbb9-cb12-49a2-906d-623f2234cdc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:34.044037 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeccbb9-cb12-49a2-906d-623f2234cdc0 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:34.044397 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeccbb9-cb12-49a2-906d-623f2234cdc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:34.044671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeccbb9-cb12-49a2-906d-623f2234cdc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:34.046700 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7eeccbb9-cb12-49a2-906d-623f2234cdc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:34.108976 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624afae-8596-4590-b735-1d51bcf136bd None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:34.109546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624afae-8596-4590-b735-1d51bcf136bd None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:34.109800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624afae-8596-4590-b735-1d51bcf136bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:34.119569 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeccbb9-cb12-49a2-906d-623f2234cdc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:34.121200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeccbb9-cb12-49a2-906d-623f2234cdc0 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:34.130291 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7624afae-8596-4590-b735-1d51bcf136bd None None] MFA Rules not processed for user `03f85d2218824876a423a85a837e44a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:34.130465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1325/2633] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:26:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:26:34.131538 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7624afae-8596-4590-b735-1d51bcf136bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:34.138805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1309/2634] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:26:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:26:36.202515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea7e09-d973-4610-aebf-dbd582aa4563 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:36.203013 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea7e09-d973-4610-aebf-dbd582aa4563 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:36.203164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea7e09-d973-4610-aebf-dbd582aa4563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:36.223780 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-99ea7e09-d973-4610-aebf-dbd582aa4563 None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:26:36.224985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-99ea7e09-d973-4610-aebf-dbd582aa4563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:26:36.233368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1326/2635] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 13 01:26:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:26:36.245573 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624afae-8596-4590-b735-1d51bcf136bd None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:26:36.257642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624afae-8596-4590-b735-1d51bcf136bd None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:26:36.262872 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bc004-aa96-4d4d-83fa-66780473bedb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:26:36.263535 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bc004-aa96-4d4d-83fa-66780473bedb service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:26:36.263845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bc004-aa96-4d4d-83fa-66780473bedb service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:26:36.264123 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bc004-aa96-4d4d-83fa-66780473bedb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:26:36.272490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bc004-aa96-4d4d-83fa-66780473bedb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:26:36.274598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bc004-aa96-4d4d-83fa-66780473bedb service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:26:36.283166 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1310/2636] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:26:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 01:26:46.218367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=64 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:46.279734 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=50 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:03.490527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea7e09-d973-4610-aebf-dbd582aa4563 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:03.563757 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea7e09-d973-4610-aebf-dbd582aa4563 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:03.567339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ba905-b80c-47ff-8641-78ca207124dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:03.567941 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ba905-b80c-47ff-8641-78ca207124dd service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:03.568223 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ba905-b80c-47ff-8641-78ca207124dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:03.568496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ba905-b80c-47ff-8641-78ca207124dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:03.599722 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ba905-b80c-47ff-8641-78ca207124dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:03.601143 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ba905-b80c-47ff-8641-78ca207124dd service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:03.610655 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1327/2637] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:27:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:27:07.163555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479e295-b91c-4a82-856a-281763f8ab5b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:07.164067 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479e295-b91c-4a82-856a-281763f8ab5b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:07.164067 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479e295-b91c-4a82-856a-281763f8ab5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:07.205677 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f479e295-b91c-4a82-856a-281763f8ab5b None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:27:07.206880 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f479e295-b91c-4a82-856a-281763f8ab5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:07.222039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1311/2638] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 13 01:27:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:27:07.235631 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ba905-b80c-47ff-8641-78ca207124dd service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:07.247906 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ba905-b80c-47ff-8641-78ca207124dd service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:07.253182 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797055a7-aa5a-40b6-af03-21c5e7f49d56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:07.253791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797055a7-aa5a-40b6-af03-21c5e7f49d56 service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:07.254077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797055a7-aa5a-40b6-af03-21c5e7f49d56 service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:07.254349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797055a7-aa5a-40b6-af03-21c5e7f49d56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:07.263464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797055a7-aa5a-40b6-af03-21c5e7f49d56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:07.265200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797055a7-aa5a-40b6-af03-21c5e7f49d56 service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:07.273715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1328/2639] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:27:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 01:27:17.215451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=14 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:17.270300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=50 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:21.913875 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c017a1-eaa9-491f-9f37-717a1d25b20c None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:21.914420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c017a1-eaa9-491f-9f37-717a1d25b20c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:21.914420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c017a1-eaa9-491f-9f37-717a1d25b20c None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:21.915813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1312/2640] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 13 01:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:27:21.922903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcda3a0-1c53-4eb1-b4d3-626436f1730c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:21.923786 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcda3a0-1c53-4eb1-b4d3-626436f1730c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:21.924231 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcda3a0-1c53-4eb1-b4d3-626436f1730c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:21.979350 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cfcda3a0-1c53-4eb1-b4d3-626436f1730c None None] MFA Rules not processed for user `fadc83bec6be41979e1aa4d71f8fc2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:27:21.981094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cfcda3a0-1c53-4eb1-b4d3-626436f1730c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:22.004594 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1329/2641] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 13 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:27:22.019782 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c017a1-eaa9-491f-9f37-717a1d25b20c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:22.032242 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c017a1-eaa9-491f-9f37-717a1d25b20c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:22.047512 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7be218-b83e-4092-bafa-4a382227b5df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c78d95e6774755b11508fc1954ad5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:22.048100 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7be218-b83e-4092-bafa-4a382227b5df service glance] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:22.048369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7be218-b83e-4092-bafa-4a382227b5df service glance] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:22.049014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7be218-b83e-4092-bafa-4a382227b5df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:22.067816 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7be218-b83e-4092-bafa-4a382227b5df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:22.069297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7be218-b83e-4092-bafa-4a382227b5df service glance] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:22.081690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1313/2642] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:27:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:27:22.153930 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5ec5d-a1a6-4924-b105-5d7d0cb6be2c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:22.154219 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5ec5d-a1a6-4924-b105-5d7d0cb6be2c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:22.154489 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5ec5d-a1a6-4924-b105-5d7d0cb6be2c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:22.155884 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1330/2643] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 13 01:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:27:22.160631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaee2e-3771-44c1-ab47-d36734d75a5a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:22.161068 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaee2e-3771-44c1-ab47-d36734d75a5a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:22.161354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaee2e-3771-44c1-ab47-d36734d75a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:22.195425 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3deaee2e-3771-44c1-ab47-d36734d75a5a None None] MFA Rules not processed for user `a672e63fa5e345679bac3d67301fe875`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:27:22.196650 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3deaee2e-3771-44c1-ab47-d36734d75a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:22.214336 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1314/2644] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 13 01:27:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:27:22.226228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5ec5d-a1a6-4924-b105-5d7d0cb6be2c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:22.237201 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5ec5d-a1a6-4924-b105-5d7d0cb6be2c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:22.241015 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e7e76-9c0f-4f20-b1ca-5416ca5a7911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:22.246767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e7e76-9c0f-4f20-b1ca-5416ca5a7911 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:22.247374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e7e76-9c0f-4f20-b1ca-5416ca5a7911 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:22.247834 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e7e76-9c0f-4f20-b1ca-5416ca5a7911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:22.255487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e7e76-9c0f-4f20-b1ca-5416ca5a7911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:22.256897 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e7e76-9c0f-4f20-b1ca-5416ca5a7911 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:22.265565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1331/2645] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:27:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:27:22.349786 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfc33b-f333-4ef9-8bc9-93d1633f8e6b None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:22.350070 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfc33b-f333-4ef9-8bc9-93d1633f8e6b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:22.350344 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfc33b-f333-4ef9-8bc9-93d1633f8e6b None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:22.351739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1315/2646] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 13 01:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 01:27:22.358418 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4569ca-7ffa-433f-9256-59c3e75b673b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:22.358800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4569ca-7ffa-433f-9256-59c3e75b673b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:22.359175 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4569ca-7ffa-433f-9256-59c3e75b673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:22.380633 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3a4569ca-7ffa-433f-9256-59c3e75b673b None None] MFA Rules not processed for user `fadc83bec6be41979e1aa4d71f8fc2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:27:22.381861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3a4569ca-7ffa-433f-9256-59c3e75b673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:22.391931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1332/2647] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 13 01:27:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:27:22.403097 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfc33b-f333-4ef9-8bc9-93d1633f8e6b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:22.414885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfc33b-f333-4ef9-8bc9-93d1633f8e6b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:22.419596 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c29c72-5480-4f18-9bf3-2877e79aa902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:22.420275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c29c72-5480-4f18-9bf3-2877e79aa902 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:22.420619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c29c72-5480-4f18-9bf3-2877e79aa902 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:22.420979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c29c72-5480-4f18-9bf3-2877e79aa902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:22.436560 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c29c72-5480-4f18-9bf3-2877e79aa902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:22.439487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c29c72-5480-4f18-9bf3-2877e79aa902 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:22.451984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1316/2648] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:27:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:27:24.949861 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491d919-08c0-4591-a4b8-062c6995cae3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:24.950354 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491d919-08c0-4591-a4b8-062c6995cae3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:24.950572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491d919-08c0-4591-a4b8-062c6995cae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:24.971345 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4491d919-08c0-4591-a4b8-062c6995cae3 None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:27:24.972623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4491d919-08c0-4591-a4b8-062c6995cae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:24.980971 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1333/2649] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 13 01:27:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:27:25.005201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c29c72-5480-4f18-9bf3-2877e79aa902 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:25.016574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c29c72-5480-4f18-9bf3-2877e79aa902 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:25.021542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f69c58-558e-47fd-b158-85886d752d42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:25.022125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f69c58-558e-47fd-b158-85886d752d42 service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:25.022428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f69c58-558e-47fd-b158-85886d752d42 service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:25.022685 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f69c58-558e-47fd-b158-85886d752d42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:25.031218 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f69c58-558e-47fd-b158-85886d752d42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:25.032752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f69c58-558e-47fd-b158-85886d752d42 service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:25.041036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1317/2650] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:27:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 01:27:26.150253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491d919-08c0-4591-a4b8-062c6995cae3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:26.159935 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491d919-08c0-4591-a4b8-062c6995cae3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:26.163561 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586e2e5-9507-4fed-b12e-8a4d5cfdb8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:26.164156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586e2e5-9507-4fed-b12e-8a4d5cfdb8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:26.164432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586e2e5-9507-4fed-b12e-8a4d5cfdb8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:26.164704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586e2e5-9507-4fed-b12e-8a4d5cfdb8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:26.166416 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4586e2e5-9507-4fed-b12e-8a4d5cfdb8e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:26.232944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586e2e5-9507-4fed-b12e-8a4d5cfdb8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:26.234373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586e2e5-9507-4fed-b12e-8a4d5cfdb8e5 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:26.243592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1334/2651] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:27:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:27:35.037744 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=30 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:36.239868 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=56 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:43.931387 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f69c58-558e-47fd-b158-85886d752d42 service swift] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:43.933171 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-36f69c58-558e-47fd-b158-85886d752d42 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:44.032095 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f69c58-558e-47fd-b158-85886d752d42 service swift] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:44.037257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d4dd6-9c16-4290-b6a2-7c691db26cba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c5e6dae854a44a0ad6628e7dd69dfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:44.037864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d4dd6-9c16-4290-b6a2-7c691db26cba service placement] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:44.038148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d4dd6-9c16-4290-b6a2-7c691db26cba service placement] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:44.038427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d4dd6-9c16-4290-b6a2-7c691db26cba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:44.040235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-097d4dd6-9c16-4290-b6a2-7c691db26cba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:44.054115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d4dd6-9c16-4290-b6a2-7c691db26cba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:44.057066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d4dd6-9c16-4290-b6a2-7c691db26cba service placement] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:44.069053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1318/2652] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:27:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:27:45.765548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586e2e5-9507-4fed-b12e-8a4d5cfdb8e5 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:45.767390 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4586e2e5-9507-4fed-b12e-8a4d5cfdb8e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:45.785366 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586e2e5-9507-4fed-b12e-8a4d5cfdb8e5 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:45.793366 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd2b94-e161-4092-90a2-ae6f8448ec59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:45.793985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd2b94-e161-4092-90a2-ae6f8448ec59 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:45.794294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd2b94-e161-4092-90a2-ae6f8448ec59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:45.794567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd2b94-e161-4092-90a2-ae6f8448ec59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:45.796481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f2fd2b94-e161-4092-90a2-ae6f8448ec59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:45.885674 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd2b94-e161-4092-90a2-ae6f8448ec59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:45.887307 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd2b94-e161-4092-90a2-ae6f8448ec59 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:45.907318 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1335/2653] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:27:48.975702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8646a-7059-41b5-8bc7-bb33c0beed83 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:48.976199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8646a-7059-41b5-8bc7-bb33c0beed83 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:48.976199 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8646a-7059-41b5-8bc7-bb33c0beed83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:49.003008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1cd8646a-7059-41b5-8bc7-bb33c0beed83 None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:27:49.003947 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1cd8646a-7059-41b5-8bc7-bb33c0beed83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:49.013658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1319/2654] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 13 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:27:49.028894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd2b94-e161-4092-90a2-ae6f8448ec59 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:49.041616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd2b94-e161-4092-90a2-ae6f8448ec59 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:49.046873 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980020f-ccca-44e1-ac7e-cb75a58b296c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:49.047539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980020f-ccca-44e1-ac7e-cb75a58b296c service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:49.047818 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980020f-ccca-44e1-ac7e-cb75a58b296c service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:49.048088 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980020f-ccca-44e1-ac7e-cb75a58b296c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:49.059343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980020f-ccca-44e1-ac7e-cb75a58b296c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:49.059741 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980020f-ccca-44e1-ac7e-cb75a58b296c service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:49.078249 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1336/2655] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:27:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 01:27:49.106708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8646a-7059-41b5-8bc7-bb33c0beed83 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:49.119584 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8646a-7059-41b5-8bc7-bb33c0beed83 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:49.125946 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265e0be-67ec-4abe-afd0-4f4e5d45db4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c5e6dae854a44a0ad6628e7dd69dfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:49.126724 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265e0be-67ec-4abe-afd0-4f4e5d45db4f service placement] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:49.127268 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265e0be-67ec-4abe-afd0-4f4e5d45db4f service placement] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:49.127600 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265e0be-67ec-4abe-afd0-4f4e5d45db4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:49.129610 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4265e0be-67ec-4abe-afd0-4f4e5d45db4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:49.143456 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265e0be-67ec-4abe-afd0-4f4e5d45db4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:49.145063 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265e0be-67ec-4abe-afd0-4f4e5d45db4f service placement] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:49.157106 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1320/2656] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:27:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:27:52.753949 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980020f-ccca-44e1-ac7e-cb75a58b296c service swift] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:52.755420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e980020f-ccca-44e1-ac7e-cb75a58b296c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:52.771725 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980020f-ccca-44e1-ac7e-cb75a58b296c service swift] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:52.776931 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f7202-0a0b-4114-9737-829daf57099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:52.777635 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f7202-0a0b-4114-9737-829daf57099d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:52.777920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f7202-0a0b-4114-9737-829daf57099d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:52.778193 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f7202-0a0b-4114-9737-829daf57099d admin admin] PATH_INFO: `/v3/users/f668854151ce49e1bd5de651e731f989` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:52.779345 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f7202-0a0b-4114-9737-829daf57099d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f668854151ce49e1bd5de651e731f989)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:52.781226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f7202-0a0b-4114-9737-829daf57099d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:52.828426 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-034f7202-0a0b-4114-9737-829daf57099d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f668854151ce49e1bd5de651e731f989'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:52.829079 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-034f7202-0a0b-4114-9737-829daf57099d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f668854151ce49e1bd5de651e731f989'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:52.835873 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-034f7202-0a0b-4114-9737-829daf57099d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f668854151ce49e1bd5de651e731f989'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:52.848658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-034f7202-0a0b-4114-9737-829daf57099d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f668854151ce49e1bd5de651e731f989'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:52.849251 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-034f7202-0a0b-4114-9737-829daf57099d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f668854151ce49e1bd5de651e731f989'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:52.862430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1337/2657] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:27:52 2022] DELETE /identity/v3/users/f668854151ce49e1bd5de651e731f989 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:27:53.035686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265e0be-67ec-4abe-afd0-4f4e5d45db4f service placement] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:53.048868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265e0be-67ec-4abe-afd0-4f4e5d45db4f service placement] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:53.231590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425f10c-734d-405e-a93b-932f42eea766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:53.232119 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425f10c-734d-405e-a93b-932f42eea766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:53.232394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425f10c-734d-405e-a93b-932f42eea766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:53.232664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425f10c-734d-405e-a93b-932f42eea766 admin admin] PATH_INFO: `/v3/projects/a0c7f685ea3445d9b54d7f455fe0f01b` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:53.233750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425f10c-734d-405e-a93b-932f42eea766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0c7f685ea3445d9b54d7f455fe0f01b)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:53.235689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425f10c-734d-405e-a93b-932f42eea766 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:53.281758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b425f10c-734d-405e-a93b-932f42eea766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0c7f685ea3445d9b54d7f455fe0f01b', 'request_id': 'req-b425f10c-734d-405e-a93b-932f42eea766'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:53.283637 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:53.288191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b425f10c-734d-405e-a93b-932f42eea766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0c7f685ea3445d9b54d7f455fe0f01b', 'request_id': 'req-b425f10c-734d-405e-a93b-932f42eea766'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:53.294819 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b425f10c-734d-405e-a93b-932f42eea766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0c7f685ea3445d9b54d7f455fe0f01b', 'request_id': 'req-b425f10c-734d-405e-a93b-932f42eea766'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:53.306355 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b425f10c-734d-405e-a93b-932f42eea766 admin admin] The token cache is being invalidate because project a0c7f685ea3445d9b54d7f455fe0f01b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:27:53.306638 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b425f10c-734d-405e-a93b-932f42eea766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:53.307273 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b425f10c-734d-405e-a93b-932f42eea766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:53.308983 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1321/2658] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:27:53 2022] DELETE /identity/v3/projects/a0c7f685ea3445d9b54d7f455fe0f01b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:27:53.313291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f7202-0a0b-4114-9737-829daf57099d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:53.320990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-034f7202-0a0b-4114-9737-829daf57099d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:53.334840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f7202-0a0b-4114-9737-829daf57099d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:53.355189 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:53.392098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16916ee2-8838-4c4c-adfa-568c7e85af4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:53.392722 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16916ee2-8838-4c4c-adfa-568c7e85af4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:53.392998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16916ee2-8838-4c4c-adfa-568c7e85af4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:53.393270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16916ee2-8838-4c4c-adfa-568c7e85af4e admin admin] PATH_INFO: `/v3/users/820ead1cf5b04798b2dfe2da95a8571f` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:53.394398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16916ee2-8838-4c4c-adfa-568c7e85af4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=820ead1cf5b04798b2dfe2da95a8571f)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:53.396339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16916ee2-8838-4c4c-adfa-568c7e85af4e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:53.457353 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-16916ee2-8838-4c4c-adfa-568c7e85af4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820ead1cf5b04798b2dfe2da95a8571f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:53.458044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-16916ee2-8838-4c4c-adfa-568c7e85af4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820ead1cf5b04798b2dfe2da95a8571f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:53.467665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-16916ee2-8838-4c4c-adfa-568c7e85af4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820ead1cf5b04798b2dfe2da95a8571f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:53.483047 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-16916ee2-8838-4c4c-adfa-568c7e85af4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820ead1cf5b04798b2dfe2da95a8571f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:53.483766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-16916ee2-8838-4c4c-adfa-568c7e85af4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820ead1cf5b04798b2dfe2da95a8571f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:53.501419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1338/2659] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:27:53 2022] DELETE /identity/v3/users/820ead1cf5b04798b2dfe2da95a8571f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:27:53.693321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425f10c-734d-405e-a93b-932f42eea766 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:53.694766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b425f10c-734d-405e-a93b-932f42eea766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:53.710953 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425f10c-734d-405e-a93b-932f42eea766 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:53.772364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:53.772987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:53.773288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:53.773554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29 admin admin] PATH_INFO: `/v3/projects/b0656ad6848344b18e4ff63975fc3879` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:53.774684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0656ad6848344b18e4ff63975fc3879)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:53.777626 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:53.825592 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0656ad6848344b18e4ff63975fc3879', 'request_id': 'req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:53.831844 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0656ad6848344b18e4ff63975fc3879', 'request_id': 'req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:53.837554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0656ad6848344b18e4ff63975fc3879', 'request_id': 'req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:53.851489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29 admin admin] The token cache is being invalidate because project b0656ad6848344b18e4ff63975fc3879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:27:53.851777 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:53.852399 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:53.853872 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1322/2660] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:27:53 2022] DELETE /identity/v3/projects/b0656ad6848344b18e4ff63975fc3879 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:27:55.879420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16916ee2-8838-4c4c-adfa-568c7e85af4e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:55.880823 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-16916ee2-8838-4c4c-adfa-568c7e85af4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:55.937572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16916ee2-8838-4c4c-adfa-568c7e85af4e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:55.985095 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf3f8-5e61-43f8-9049-a6967bc6bd72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:55.985697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf3f8-5e61-43f8-9049-a6967bc6bd72 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:55.985977 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf3f8-5e61-43f8-9049-a6967bc6bd72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:55.986251 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf3f8-5e61-43f8-9049-a6967bc6bd72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:55.987986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dccaf3f8-5e61-43f8-9049-a6967bc6bd72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:56.001098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:56.052501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaf3f8-5e61-43f8-9049-a6967bc6bd72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:56.053856 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaf3f8-5e61-43f8-9049-a6967bc6bd72 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:56.064120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1339/2661] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:27:59.152598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:59.154060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:59.167186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3527a7-f8fa-4f38-ac51-d6c51bd1ee29 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:59.171437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd30e4-ca1b-4d7a-a4b1-673be54cd5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:59.172060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd30e4-ca1b-4d7a-a4b1-673be54cd5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:59.172338 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd30e4-ca1b-4d7a-a4b1-673be54cd5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:59.172612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd30e4-ca1b-4d7a-a4b1-673be54cd5be admin admin] PATH_INFO: `/v3/users/2821b1a941c543a0aac6f56385c3c8be` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:59.173719 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd30e4-ca1b-4d7a-a4b1-673be54cd5be admin admin] RBAC: Authorizing `identity:delete_user(user_id=2821b1a941c543a0aac6f56385c3c8be)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:59.175655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd30e4-ca1b-4d7a-a4b1-673be54cd5be admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:59.224385 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73bd30e4-ca1b-4d7a-a4b1-673be54cd5be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2821b1a941c543a0aac6f56385c3c8be'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:59.225030 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73bd30e4-ca1b-4d7a-a4b1-673be54cd5be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2821b1a941c543a0aac6f56385c3c8be'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:59.232179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73bd30e4-ca1b-4d7a-a4b1-673be54cd5be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2821b1a941c543a0aac6f56385c3c8be'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:59.239162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:59.245457 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73bd30e4-ca1b-4d7a-a4b1-673be54cd5be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2821b1a941c543a0aac6f56385c3c8be'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:59.246345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73bd30e4-ca1b-4d7a-a4b1-673be54cd5be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2821b1a941c543a0aac6f56385c3c8be'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:59.260099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1323/2662] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:27:59 2022] DELETE /identity/v3/users/2821b1a941c543a0aac6f56385c3c8be => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:27:59.445103 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf3f8-5e61-43f8-9049-a6967bc6bd72 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:59.458640 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf3f8-5e61-43f8-9049-a6967bc6bd72 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:59.523109 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f75b5f-b9f6-4924-8e36-95309baee23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:59.523745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f75b5f-b9f6-4924-8e36-95309baee23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:59.524021 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f75b5f-b9f6-4924-8e36-95309baee23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:59.524286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f75b5f-b9f6-4924-8e36-95309baee23b admin admin] PATH_INFO: `/v3/projects/a94e9c8d555a4657ab9699b9274862c8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:59.525457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f75b5f-b9f6-4924-8e36-95309baee23b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94e9c8d555a4657ab9699b9274862c8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:59.527933 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f75b5f-b9f6-4924-8e36-95309baee23b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:59.577699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-38f75b5f-b9f6-4924-8e36-95309baee23b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94e9c8d555a4657ab9699b9274862c8', 'request_id': 'req-38f75b5f-b9f6-4924-8e36-95309baee23b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:59.585209 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-38f75b5f-b9f6-4924-8e36-95309baee23b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94e9c8d555a4657ab9699b9274862c8', 'request_id': 'req-38f75b5f-b9f6-4924-8e36-95309baee23b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:59.591948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-38f75b5f-b9f6-4924-8e36-95309baee23b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94e9c8d555a4657ab9699b9274862c8', 'request_id': 'req-38f75b5f-b9f6-4924-8e36-95309baee23b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:59.602438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-38f75b5f-b9f6-4924-8e36-95309baee23b admin admin] The token cache is being invalidate because project a94e9c8d555a4657ab9699b9274862c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:27:59.602727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-38f75b5f-b9f6-4924-8e36-95309baee23b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:59.603384 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-38f75b5f-b9f6-4924-8e36-95309baee23b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:27:59.604876 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1340/2663] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:27:59 2022] DELETE /identity/v3/projects/a94e9c8d555a4657ab9699b9274862c8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:27:59.609868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04d212-94ae-4549-8bd1-51649824383c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:59.610152 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04d212-94ae-4549-8bd1-51649824383c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:59.610427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04d212-94ae-4549-8bd1-51649824383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:59.658356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-9d04d212-94ae-4549-8bd1-51649824383c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:27:59.659595 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9d04d212-94ae-4549-8bd1-51649824383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:59.717489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1324/2664] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:27:59.725538 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db72b1-2519-4c3f-bcc5-275c5e857ba3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:59.725819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db72b1-2519-4c3f-bcc5-275c5e857ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:59.726119 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db72b1-2519-4c3f-bcc5-275c5e857ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:59.746343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a7db72b1-2519-4c3f-bcc5-275c5e857ba3 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:27:59.747620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a7db72b1-2519-4c3f-bcc5-275c5e857ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:27:59.755549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1341/2665] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:27:59.759661 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04d212-94ae-4549-8bd1-51649824383c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:59.769901 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04d212-94ae-4549-8bd1-51649824383c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:59.774520 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03d4ae-d835-4496-b583-b0badadf2ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:59.775140 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03d4ae-d835-4496-b583-b0badadf2ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:59.775418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03d4ae-d835-4496-b583-b0badadf2ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:59.775690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03d4ae-d835-4496-b583-b0badadf2ae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:59.776737 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03d4ae-d835-4496-b583-b0badadf2ae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:27:59.777104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03d4ae-d835-4496-b583-b0badadf2ae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:59.778697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03d4ae-d835-4496-b583-b0badadf2ae4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:59.790419 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1325/2666] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:27:59.794839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db72b1-2519-4c3f-bcc5-275c5e857ba3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:59.804143 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db72b1-2519-4c3f-bcc5-275c5e857ba3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:59.809446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0c507-e1ff-4db7-9c56-f3f2a1c8e814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:59.809982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0c507-e1ff-4db7-9c56-f3f2a1c8e814 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:59.810259 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0c507-e1ff-4db7-9c56-f3f2a1c8e814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:59.810531 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0c507-e1ff-4db7-9c56-f3f2a1c8e814 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:59.811190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0c507-e1ff-4db7-9c56-f3f2a1c8e814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:59.813082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0c507-e1ff-4db7-9c56-f3f2a1c8e814 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:59.840391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1342/2667] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:27:59 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:27:59.844484 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03d4ae-d835-4496-b583-b0badadf2ae4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:59.854861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03d4ae-d835-4496-b583-b0badadf2ae4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:59.910459 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47244e9d-cf03-4dd3-9e94-b7be8f3c90b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:59.911084 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47244e9d-cf03-4dd3-9e94-b7be8f3c90b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:59.911359 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47244e9d-cf03-4dd3-9e94-b7be8f3c90b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:59.911627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47244e9d-cf03-4dd3-9e94-b7be8f3c90b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:59.912255 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47244e9d-cf03-4dd3-9e94-b7be8f3c90b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:59.914132 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47244e9d-cf03-4dd3-9e94-b7be8f3c90b3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:59.936417 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1326/2668] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:27:59 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:27:59.940557 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0c507-e1ff-4db7-9c56-f3f2a1c8e814 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:59.951040 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0c507-e1ff-4db7-9c56-f3f2a1c8e814 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:59.955599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa5fe9-4a4a-4caf-8b65-9e463993f354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:59.956194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa5fe9-4a4a-4caf-8b65-9e463993f354 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:59.956474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa5fe9-4a4a-4caf-8b65-9e463993f354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:59.956747 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa5fe9-4a4a-4caf-8b65-9e463993f354 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:59.957388 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa5fe9-4a4a-4caf-8b65-9e463993f354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:59.958972 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa5fe9-4a4a-4caf-8b65-9e463993f354 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:27:59.964283 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:59.970045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1343/2669] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:27:59.973849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47244e9d-cf03-4dd3-9e94-b7be8f3c90b3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:27:59.984664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47244e9d-cf03-4dd3-9e94-b7be8f3c90b3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:27:59.989390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebf300-cdc2-48d7-97a8-ba0478866417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:27:59.990027 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebf300-cdc2-48d7-97a8-ba0478866417 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:27:59.990339 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebf300-cdc2-48d7-97a8-ba0478866417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:27:59.990613 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebf300-cdc2-48d7-97a8-ba0478866417 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:27:59.991369 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebf300-cdc2-48d7-97a8-ba0478866417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:27:59.992941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebf300-cdc2-48d7-97a8-ba0478866417 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:00.003854 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1327/2670] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:28:00.008056 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa5fe9-4a4a-4caf-8b65-9e463993f354 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:00.018299 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa5fe9-4a4a-4caf-8b65-9e463993f354 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:00.022837 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e45374-e110-44a8-b538-3708f602d889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:00.023516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e45374-e110-44a8-b538-3708f602d889 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:00.023796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e45374-e110-44a8-b538-3708f602d889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:00.024068 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e45374-e110-44a8-b538-3708f602d889 admin admin] PATH_INFO: `/v3/projects/b902feddb56443dbb4483390648719cc/users/0dae2a1dae1947f2be48c65fb9c503ce/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:00.038533 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e45374-e110-44a8-b538-3708f602d889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b902feddb56443dbb4483390648719cc, user_id=0dae2a1dae1947f2be48c65fb9c503ce, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:00.041179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e45374-e110-44a8-b538-3708f602d889 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:00.054418 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1344/2671] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:28:00 2022] PUT /identity/v3/projects/b902feddb56443dbb4483390648719cc/users/0dae2a1dae1947f2be48c65fb9c503ce/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:28:00.059999 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5713bf-9e2a-4968-af43-ae50ae0e1c31 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:00.060273 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5713bf-9e2a-4968-af43-ae50ae0e1c31 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:00.060548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5713bf-9e2a-4968-af43-ae50ae0e1c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:00.080213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1d5713bf-9e2a-4968-af43-ae50ae0e1c31 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:28:00.081450 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1d5713bf-9e2a-4968-af43-ae50ae0e1c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:00.101494 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:00.141015 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1328/2672] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:28:00.150559 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e45374-e110-44a8-b538-3708f602d889 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:00.152700 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-56e45374-e110-44a8-b538-3708f602d889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:00.212081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e45374-e110-44a8-b538-3708f602d889 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:00.216545 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e29ff-379e-4d63-b10b-0cce1a3dda73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:00.217150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e29ff-379e-4d63-b10b-0cce1a3dda73 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:00.217430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e29ff-379e-4d63-b10b-0cce1a3dda73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:00.217706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e29ff-379e-4d63-b10b-0cce1a3dda73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:00.226605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e29ff-379e-4d63-b10b-0cce1a3dda73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:00.228053 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e29ff-379e-4d63-b10b-0cce1a3dda73 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:00.237894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1345/2673] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:28:04.306011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ee24d-9b88-4b10-b869-12ff7c0a588a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:04.306598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ee24d-9b88-4b10-b869-12ff7c0a588a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:04.306832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ee24d-9b88-4b10-b869-12ff7c0a588a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:04.340831 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a96ee24d-9b88-4b10-b869-12ff7c0a588a None None] MFA Rules not processed for user `0dae2a1dae1947f2be48c65fb9c503ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:28:04.342042 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a96ee24d-9b88-4b10-b869-12ff7c0a588a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:04.416329 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1329/2674] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:28:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:28:04.431241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e29ff-379e-4d63-b10b-0cce1a3dda73 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:04.433342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-130e29ff-379e-4d63-b10b-0cce1a3dda73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:04.511962 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e29ff-379e-4d63-b10b-0cce1a3dda73 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:04.518208 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7b26d-8c13-4501-a6f8-1b6d79797657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:04.518830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7b26d-8c13-4501-a6f8-1b6d79797657 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:04.519146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7b26d-8c13-4501-a6f8-1b6d79797657 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:04.519574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7b26d-8c13-4501-a6f8-1b6d79797657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:04.529135 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7b26d-8c13-4501-a6f8-1b6d79797657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:04.530736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7b26d-8c13-4501-a6f8-1b6d79797657 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:04.540539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1346/2675] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:28:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:28:05.901377 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7000840-5b6d-4a9a-83e2-27833c6dc3f9 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:05.901921 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7000840-5b6d-4a9a-83e2-27833c6dc3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:05.902122 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7000840-5b6d-4a9a-83e2-27833c6dc3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:05.930673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b7000840-5b6d-4a9a-83e2-27833c6dc3f9 None None] MFA Rules not processed for user `0dae2a1dae1947f2be48c65fb9c503ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:28:05.932138 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b7000840-5b6d-4a9a-83e2-27833c6dc3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:05.944593 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1330/2676] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:28:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:28:14.536209 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=70,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:15.925394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=50 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:53.492496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7b26d-8c13-4501-a6f8-1b6d79797657 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:53.493891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ecd7b26d-8c13-4501-a6f8-1b6d79797657 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:53.506168 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7b26d-8c13-4501-a6f8-1b6d79797657 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:53.509604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a36979-4f4f-45cb-8db8-9391109f2e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:53.510187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a36979-4f4f-45cb-8db8-9391109f2e4a service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:53.510461 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a36979-4f4f-45cb-8db8-9391109f2e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:53.510746 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a36979-4f4f-45cb-8db8-9391109f2e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:53.513350 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-16a36979-4f4f-45cb-8db8-9391109f2e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:53.524702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a36979-4f4f-45cb-8db8-9391109f2e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:53.526097 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a36979-4f4f-45cb-8db8-9391109f2e4a service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:53.536041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1347/2677] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:28:56.800355 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7000840-5b6d-4a9a-83e2-27833c6dc3f9 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:56.801902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b7000840-5b6d-4a9a-83e2-27833c6dc3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:56.816631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7000840-5b6d-4a9a-83e2-27833c6dc3f9 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:56.821270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1330c-e668-41f2-a11c-3b76cd49e8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:56.821924 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1330c-e668-41f2-a11c-3b76cd49e8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:56.822195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1330c-e668-41f2-a11c-3b76cd49e8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:56.822461 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1330c-e668-41f2-a11c-3b76cd49e8fc admin admin] PATH_INFO: `/v3/users/26aad3a8d2fa462e9bedcd2a1203571c` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:56.824136 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1330c-e668-41f2-a11c-3b76cd49e8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=26aad3a8d2fa462e9bedcd2a1203571c)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:56.825995 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1330c-e668-41f2-a11c-3b76cd49e8fc admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:56.870271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0bf1330c-e668-41f2-a11c-3b76cd49e8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26aad3a8d2fa462e9bedcd2a1203571c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:56.870858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0bf1330c-e668-41f2-a11c-3b76cd49e8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26aad3a8d2fa462e9bedcd2a1203571c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:56.877792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0bf1330c-e668-41f2-a11c-3b76cd49e8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26aad3a8d2fa462e9bedcd2a1203571c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:56.890884 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0bf1330c-e668-41f2-a11c-3b76cd49e8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26aad3a8d2fa462e9bedcd2a1203571c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:56.891606 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0bf1330c-e668-41f2-a11c-3b76cd49e8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26aad3a8d2fa462e9bedcd2a1203571c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:56.905681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1331/2678] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:28:56 2022] DELETE /identity/v3/users/26aad3a8d2fa462e9bedcd2a1203571c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:28:57.078791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a36979-4f4f-45cb-8db8-9391109f2e4a service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:57.088713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a36979-4f4f-45cb-8db8-9391109f2e4a service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:57.147745 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41325a4-b127-4d7b-a138-50c62ab82a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:57.148299 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41325a4-b127-4d7b-a138-50c62ab82a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:57.148576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41325a4-b127-4d7b-a138-50c62ab82a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:57.148843 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41325a4-b127-4d7b-a138-50c62ab82a2c admin admin] PATH_INFO: `/v3/projects/69b8cc86889b43659cbd4fe01b578643` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:57.149937 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41325a4-b127-4d7b-a138-50c62ab82a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b8cc86889b43659cbd4fe01b578643)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:57.152787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41325a4-b127-4d7b-a138-50c62ab82a2c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:57.199394 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b41325a4-b127-4d7b-a138-50c62ab82a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b8cc86889b43659cbd4fe01b578643', 'request_id': 'req-b41325a4-b127-4d7b-a138-50c62ab82a2c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:57.206682 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b41325a4-b127-4d7b-a138-50c62ab82a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b8cc86889b43659cbd4fe01b578643', 'request_id': 'req-b41325a4-b127-4d7b-a138-50c62ab82a2c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:57.212918 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b41325a4-b127-4d7b-a138-50c62ab82a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b8cc86889b43659cbd4fe01b578643', 'request_id': 'req-b41325a4-b127-4d7b-a138-50c62ab82a2c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:57.223735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b41325a4-b127-4d7b-a138-50c62ab82a2c admin admin] The token cache is being invalidate because project 69b8cc86889b43659cbd4fe01b578643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:28:57.224019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b41325a4-b127-4d7b-a138-50c62ab82a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:57.224641 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b41325a4-b127-4d7b-a138-50c62ab82a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:57.226284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1348/2679] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:28:57 2022] DELETE /identity/v3/projects/69b8cc86889b43659cbd4fe01b578643 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:28:57.231534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397fbf1-660e-40d9-9f74-75d20dca5681 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:57.231816 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397fbf1-660e-40d9-9f74-75d20dca5681 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:57.232088 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397fbf1-660e-40d9-9f74-75d20dca5681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:57.251868 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3397fbf1-660e-40d9-9f74-75d20dca5681 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:28:57.253056 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3397fbf1-660e-40d9-9f74-75d20dca5681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:57.310468 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1332/2680] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:28:57.318377 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f23d1-4cb3-4fcf-a800-e8194758402a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:57.318653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f23d1-4cb3-4fcf-a800-e8194758402a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:57.318923 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f23d1-4cb3-4fcf-a800-e8194758402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:57.339447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a78f23d1-4cb3-4fcf-a800-e8194758402a None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:28:57.340923 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a78f23d1-4cb3-4fcf-a800-e8194758402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:57.348797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1349/2681] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:28:57.352870 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397fbf1-660e-40d9-9f74-75d20dca5681 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:57.363113 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397fbf1-660e-40d9-9f74-75d20dca5681 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:57.367866 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d114822-5043-4237-abc4-2e902ec24e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:57.368464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d114822-5043-4237-abc4-2e902ec24e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:57.368744 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d114822-5043-4237-abc4-2e902ec24e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:57.369015 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d114822-5043-4237-abc4-2e902ec24e16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:57.369655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d114822-5043-4237-abc4-2e902ec24e16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:28:57.369957 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d114822-5043-4237-abc4-2e902ec24e16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:57.372489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d114822-5043-4237-abc4-2e902ec24e16 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:57.383974 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1333/2682] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:28:57.389070 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f23d1-4cb3-4fcf-a800-e8194758402a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:57.398134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f23d1-4cb3-4fcf-a800-e8194758402a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:57.402756 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8376ce-9d34-4f11-8784-212c800254e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:57.403371 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8376ce-9d34-4f11-8784-212c800254e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:57.403742 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8376ce-9d34-4f11-8784-212c800254e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:57.404016 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8376ce-9d34-4f11-8784-212c800254e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:57.404740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8376ce-9d34-4f11-8784-212c800254e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:57.406675 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8376ce-9d34-4f11-8784-212c800254e4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:57.443398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1350/2683] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:28:57 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:28:57.447803 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d114822-5043-4237-abc4-2e902ec24e16 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:57.458958 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d114822-5043-4237-abc4-2e902ec24e16 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:57.517244 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3c40c-53d1-4f44-8681-aaf443917b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:57.517900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3c40c-53d1-4f44-8681-aaf443917b48 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:57.518231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3c40c-53d1-4f44-8681-aaf443917b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:57.518411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3c40c-53d1-4f44-8681-aaf443917b48 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:57.519039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3c40c-53d1-4f44-8681-aaf443917b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:57.520981 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3c40c-53d1-4f44-8681-aaf443917b48 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:57.529105 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:57.547209 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1334/2684] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:28:57 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:28:57.551150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8376ce-9d34-4f11-8784-212c800254e4 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:57.562744 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8376ce-9d34-4f11-8784-212c800254e4 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:57.568341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0021412-cea5-424e-a3c6-eb27dc4d0b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:57.569053 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0021412-cea5-424e-a3c6-eb27dc4d0b61 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:57.569459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0021412-cea5-424e-a3c6-eb27dc4d0b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:57.569795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0021412-cea5-424e-a3c6-eb27dc4d0b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:57.570505 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0021412-cea5-424e-a3c6-eb27dc4d0b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:57.572189 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0021412-cea5-424e-a3c6-eb27dc4d0b61 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:57.582621 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1351/2685] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:28:57.586728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3c40c-53d1-4f44-8681-aaf443917b48 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:57.597172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3c40c-53d1-4f44-8681-aaf443917b48 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:57.601688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146bca1-ac2c-4dcd-947e-389a38126abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:57.602275 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146bca1-ac2c-4dcd-947e-389a38126abb admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:57.602551 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146bca1-ac2c-4dcd-947e-389a38126abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:57.602820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146bca1-ac2c-4dcd-947e-389a38126abb admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:57.603492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146bca1-ac2c-4dcd-947e-389a38126abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:57.605933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146bca1-ac2c-4dcd-947e-389a38126abb admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:57.616292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1335/2686] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:28:57.621296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0021412-cea5-424e-a3c6-eb27dc4d0b61 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:57.631831 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0021412-cea5-424e-a3c6-eb27dc4d0b61 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:57.636956 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66307b-671b-4c49-8e3e-0655779d5826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:57.637590 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66307b-671b-4c49-8e3e-0655779d5826 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:57.637866 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66307b-671b-4c49-8e3e-0655779d5826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:57.638137 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66307b-671b-4c49-8e3e-0655779d5826 admin admin] PATH_INFO: `/v3/projects/ad304d2f96394bdbaefcd1f5780ddb52/users/3bffc46781c84fb3916a2a7da866d61a/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:57.654247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66307b-671b-4c49-8e3e-0655779d5826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad304d2f96394bdbaefcd1f5780ddb52, user_id=3bffc46781c84fb3916a2a7da866d61a, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:57.656868 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66307b-671b-4c49-8e3e-0655779d5826 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:57.670195 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1352/2687] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:28:57 2022] PUT /identity/v3/projects/ad304d2f96394bdbaefcd1f5780ddb52/users/3bffc46781c84fb3916a2a7da866d61a/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:28:57.681561 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c148b-8d9e-48d8-aeac-dab2f6906009 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:57.681842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c148b-8d9e-48d8-aeac-dab2f6906009 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:57.682110 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c148b-8d9e-48d8-aeac-dab2f6906009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:57.710332 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ef7c148b-8d9e-48d8-aeac-dab2f6906009 None None] MFA Rules not processed for user `3bffc46781c84fb3916a2a7da866d61a`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:28:57.711591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ef7c148b-8d9e-48d8-aeac-dab2f6906009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:57.775703 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1336/2688] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:28:57 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:28:57.780881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66307b-671b-4c49-8e3e-0655779d5826 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:57.786361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:57.844133 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66307b-671b-4c49-8e3e-0655779d5826 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:57.848684 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f1524-6429-40ee-9f34-1f843a6997e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:57.849275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f1524-6429-40ee-9f34-1f843a6997e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:57.849548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f1524-6429-40ee-9f34-1f843a6997e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:57.849814 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f1524-6429-40ee-9f34-1f843a6997e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:57.850468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f1524-6429-40ee-9f34-1f843a6997e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:57.852339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f1524-6429-40ee-9f34-1f843a6997e5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:57.878774 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1353/2689] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:28:57 2022] POST /identity/v3/projects => generated 403 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:28:57.882830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c148b-8d9e-48d8-aeac-dab2f6906009 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:57.893899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c148b-8d9e-48d8-aeac-dab2f6906009 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:57.950889 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ec494-bed2-420f-9a9d-477157d973c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:57.951436 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ec494-bed2-420f-9a9d-477157d973c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:57.951726 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ec494-bed2-420f-9a9d-477157d973c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:57.951978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ec494-bed2-420f-9a9d-477157d973c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:57.952621 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ec494-bed2-420f-9a9d-477157d973c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:57.954492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ec494-bed2-420f-9a9d-477157d973c6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:57.975125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1337/2690] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:28:57 2022] POST /identity/v3/users => generated 308 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:28:57.979196 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f1524-6429-40ee-9f34-1f843a6997e5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:57.989767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f1524-6429-40ee-9f34-1f843a6997e5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:57.994322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69e106-6869-4a00-ae5b-8a5f324b09ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:57.994911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69e106-6869-4a00-ae5b-8a5f324b09ea admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:57.995293 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69e106-6869-4a00-ae5b-8a5f324b09ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:57.995712 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69e106-6869-4a00-ae5b-8a5f324b09ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:57.996352 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69e106-6869-4a00-ae5b-8a5f324b09ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:57.997939 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69e106-6869-4a00-ae5b-8a5f324b09ea admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:58.008283 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1354/2691] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:28:58.012376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ec494-bed2-420f-9a9d-477157d973c6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:58.022079 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ec494-bed2-420f-9a9d-477157d973c6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:58.027121 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced16ed8-5876-49fe-9514-f17f7f401c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:58.027761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced16ed8-5876-49fe-9514-f17f7f401c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:58.028037 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced16ed8-5876-49fe-9514-f17f7f401c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:58.028311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced16ed8-5876-49fe-9514-f17f7f401c59 admin admin] PATH_INFO: `/v3/projects/4958ca7569574b898b5669f7b31b4a56/users/cf58a749715145d2a4ec123958a44a15/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:58.043407 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced16ed8-5876-49fe-9514-f17f7f401c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4958ca7569574b898b5669f7b31b4a56, user_id=cf58a749715145d2a4ec123958a44a15, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:58.046016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced16ed8-5876-49fe-9514-f17f7f401c59 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:58.058266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1338/2692] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:28:58 2022] PUT /identity/v3/projects/4958ca7569574b898b5669f7b31b4a56/users/cf58a749715145d2a4ec123958a44a15/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:28:58.062174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69e106-6869-4a00-ae5b-8a5f324b09ea admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:58.072195 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69e106-6869-4a00-ae5b-8a5f324b09ea admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:58.128033 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a81f4-0dab-4cc5-9ec1-e34f8138f0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:58.128644 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a81f4-0dab-4cc5-9ec1-e34f8138f0af admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:58.128898 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a81f4-0dab-4cc5-9ec1-e34f8138f0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:58.129171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a81f4-0dab-4cc5-9ec1-e34f8138f0af admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:58.129803 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a81f4-0dab-4cc5-9ec1-e34f8138f0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:58.131424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a81f4-0dab-4cc5-9ec1-e34f8138f0af admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:58.141140 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1355/2693] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:28:58.145668 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced16ed8-5876-49fe-9514-f17f7f401c59 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:58.157772 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced16ed8-5876-49fe-9514-f17f7f401c59 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:58.162986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc33c5-ecad-4b85-9c93-6156c44c28e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:58.163727 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc33c5-ecad-4b85-9c93-6156c44c28e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:58.164007 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc33c5-ecad-4b85-9c93-6156c44c28e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:58.164281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc33c5-ecad-4b85-9c93-6156c44c28e1 admin admin] PATH_INFO: `/v3/projects/4958ca7569574b898b5669f7b31b4a56/users/cf58a749715145d2a4ec123958a44a15/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:58.166249 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc33c5-ecad-4b85-9c93-6156c44c28e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4958ca7569574b898b5669f7b31b4a56, user_id=cf58a749715145d2a4ec123958a44a15, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:58.169825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc33c5-ecad-4b85-9c93-6156c44c28e1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:58.180225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1339/2694] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:28:58 2022] PUT /identity/v3/projects/4958ca7569574b898b5669f7b31b4a56/users/cf58a749715145d2a4ec123958a44a15/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:28:58.190710 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcca48-aaec-45e2-a6a3-384ae20d7ffb None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:58.191024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcca48-aaec-45e2-a6a3-384ae20d7ffb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:58.191329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcca48-aaec-45e2-a6a3-384ae20d7ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:58.219022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4cdcca48-aaec-45e2-a6a3-384ae20d7ffb None None] MFA Rules not processed for user `cf58a749715145d2a4ec123958a44a15`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:28:58.220222 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4cdcca48-aaec-45e2-a6a3-384ae20d7ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:58.284440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:58.288595 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1356/2695] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:28:58 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:28:58.298938 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc33c5-ecad-4b85-9c93-6156c44c28e1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:58.300678 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fbdc33c5-ecad-4b85-9c93-6156c44c28e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:58.324418 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:58.382110 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc33c5-ecad-4b85-9c93-6156c44c28e1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:58.386279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f25076-345d-4591-9320-303653b4a593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:58.387049 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f25076-345d-4591-9320-303653b4a593 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:58.387373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f25076-345d-4591-9320-303653b4a593 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:58.387647 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f25076-345d-4591-9320-303653b4a593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:58.396600 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f25076-345d-4591-9320-303653b4a593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:58.398020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f25076-345d-4591-9320-303653b4a593 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:58.408176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1340/2696] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:28:58 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:28:58.555678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcca48-aaec-45e2-a6a3-384ae20d7ffb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:58.616815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcca48-aaec-45e2-a6a3-384ae20d7ffb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:58.621532 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dea75d-5c57-4a92-8fb1-8b1cf78b6989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:58.622152 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dea75d-5c57-4a92-8fb1-8b1cf78b6989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:58.622429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dea75d-5c57-4a92-8fb1-8b1cf78b6989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:58.622701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dea75d-5c57-4a92-8fb1-8b1cf78b6989 admin admin] PATH_INFO: `/v3/users/3bffc46781c84fb3916a2a7da866d61a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:58.623844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dea75d-5c57-4a92-8fb1-8b1cf78b6989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bffc46781c84fb3916a2a7da866d61a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:58.625788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dea75d-5c57-4a92-8fb1-8b1cf78b6989 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:58.672423 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c6dea75d-5c57-4a92-8fb1-8b1cf78b6989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bffc46781c84fb3916a2a7da866d61a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:58.673075 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c6dea75d-5c57-4a92-8fb1-8b1cf78b6989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bffc46781c84fb3916a2a7da866d61a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:58.679972 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c6dea75d-5c57-4a92-8fb1-8b1cf78b6989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bffc46781c84fb3916a2a7da866d61a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:58.692046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c6dea75d-5c57-4a92-8fb1-8b1cf78b6989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bffc46781c84fb3916a2a7da866d61a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:58.692685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c6dea75d-5c57-4a92-8fb1-8b1cf78b6989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bffc46781c84fb3916a2a7da866d61a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:58.705647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1357/2697] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:28:58 2022] DELETE /identity/v3/users/3bffc46781c84fb3916a2a7da866d61a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:28:58.710525 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27165e-2f84-43b3-b1bd-c558dbf39e10 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:58.710813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27165e-2f84-43b3-b1bd-c558dbf39e10 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:58.711104 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27165e-2f84-43b3-b1bd-c558dbf39e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:58.731682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8b27165e-2f84-43b3-b1bd-c558dbf39e10 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:28:58.732808 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8b27165e-2f84-43b3-b1bd-c558dbf39e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:58.790364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1341/2698] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:28:58.800812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dea75d-5c57-4a92-8fb1-8b1cf78b6989 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:58.802222 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c6dea75d-5c57-4a92-8fb1-8b1cf78b6989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:58.859395 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dea75d-5c57-4a92-8fb1-8b1cf78b6989 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:58.862943 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4e1a1-3f57-47a8-8bb5-f2fe8f9bd105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:58.863565 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4e1a1-3f57-47a8-8bb5-f2fe8f9bd105 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:58.863840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4e1a1-3f57-47a8-8bb5-f2fe8f9bd105 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:58.864110 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4e1a1-3f57-47a8-8bb5-f2fe8f9bd105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:58.873784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4e1a1-3f57-47a8-8bb5-f2fe8f9bd105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:58.875219 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4e1a1-3f57-47a8-8bb5-f2fe8f9bd105 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:58.884404 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1358/2699] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:28:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:28:59.155488 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27165e-2f84-43b3-b1bd-c558dbf39e10 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:59.156997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8b27165e-2f84-43b3-b1bd-c558dbf39e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:59.169493 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27165e-2f84-43b3-b1bd-c558dbf39e10 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:59.175028 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bba2ae-b7cb-4804-add1-aadf36708de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:59.175699 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bba2ae-b7cb-4804-add1-aadf36708de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:59.175972 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bba2ae-b7cb-4804-add1-aadf36708de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:59.176242 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bba2ae-b7cb-4804-add1-aadf36708de4 admin admin] PATH_INFO: `/v3/projects/ad304d2f96394bdbaefcd1f5780ddb52` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:59.177354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bba2ae-b7cb-4804-add1-aadf36708de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad304d2f96394bdbaefcd1f5780ddb52)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:59.179289 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bba2ae-b7cb-4804-add1-aadf36708de4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:59.228587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-34bba2ae-b7cb-4804-add1-aadf36708de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad304d2f96394bdbaefcd1f5780ddb52', 'request_id': 'req-34bba2ae-b7cb-4804-add1-aadf36708de4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:59.235201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-34bba2ae-b7cb-4804-add1-aadf36708de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad304d2f96394bdbaefcd1f5780ddb52', 'request_id': 'req-34bba2ae-b7cb-4804-add1-aadf36708de4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:59.240751 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-34bba2ae-b7cb-4804-add1-aadf36708de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad304d2f96394bdbaefcd1f5780ddb52', 'request_id': 'req-34bba2ae-b7cb-4804-add1-aadf36708de4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:59.253546 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-34bba2ae-b7cb-4804-add1-aadf36708de4 admin admin] The token cache is being invalidate because project ad304d2f96394bdbaefcd1f5780ddb52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:28:59.253828 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-34bba2ae-b7cb-4804-add1-aadf36708de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:59.254436 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-34bba2ae-b7cb-4804-add1-aadf36708de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:59.255924 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1342/2700] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:28:59 2022] DELETE /identity/v3/projects/ad304d2f96394bdbaefcd1f5780ddb52 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:28:59.259992 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4e1a1-3f57-47a8-8bb5-f2fe8f9bd105 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:59.269520 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4e1a1-3f57-47a8-8bb5-f2fe8f9bd105 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:59.287743 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:59.327336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0eab9-e34d-4149-aa8a-3d0822035dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:59.327963 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0eab9-e34d-4149-aa8a-3d0822035dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:59.328239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0eab9-e34d-4149-aa8a-3d0822035dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:59.328511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0eab9-e34d-4149-aa8a-3d0822035dc1 admin admin] PATH_INFO: `/v3/users/cf58a749715145d2a4ec123958a44a15` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:59.329619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0eab9-e34d-4149-aa8a-3d0822035dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf58a749715145d2a4ec123958a44a15)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:59.331558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0eab9-e34d-4149-aa8a-3d0822035dc1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:59.378094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-eef0eab9-e34d-4149-aa8a-3d0822035dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf58a749715145d2a4ec123958a44a15'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:59.378751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-eef0eab9-e34d-4149-aa8a-3d0822035dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf58a749715145d2a4ec123958a44a15'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:59.386120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-eef0eab9-e34d-4149-aa8a-3d0822035dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf58a749715145d2a4ec123958a44a15'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:59.397957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-eef0eab9-e34d-4149-aa8a-3d0822035dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf58a749715145d2a4ec123958a44a15'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:59.398672 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-eef0eab9-e34d-4149-aa8a-3d0822035dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf58a749715145d2a4ec123958a44a15'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:59.411881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1359/2701] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:28:59 2022] DELETE /identity/v3/users/cf58a749715145d2a4ec123958a44a15 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:28:59.682651 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bba2ae-b7cb-4804-add1-aadf36708de4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:59.684177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-34bba2ae-b7cb-4804-add1-aadf36708de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:59.699643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bba2ae-b7cb-4804-add1-aadf36708de4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:59.726790 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:59.761934 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8d1b1-86fc-4dc4-8080-303831897a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:59.762660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d1b1-86fc-4dc4-8080-303831897a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:59.762943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d1b1-86fc-4dc4-8080-303831897a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:59.763248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d1b1-86fc-4dc4-8080-303831897a71 admin admin] PATH_INFO: `/v3/projects/4958ca7569574b898b5669f7b31b4a56` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:59.764375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8d1b1-86fc-4dc4-8080-303831897a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4958ca7569574b898b5669f7b31b4a56)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:59.766276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8d1b1-86fc-4dc4-8080-303831897a71 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:59.811477 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7eb8d1b1-86fc-4dc4-8080-303831897a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4958ca7569574b898b5669f7b31b4a56', 'request_id': 'req-7eb8d1b1-86fc-4dc4-8080-303831897a71'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:59.817409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7eb8d1b1-86fc-4dc4-8080-303831897a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4958ca7569574b898b5669f7b31b4a56', 'request_id': 'req-7eb8d1b1-86fc-4dc4-8080-303831897a71'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:59.822888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7eb8d1b1-86fc-4dc4-8080-303831897a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4958ca7569574b898b5669f7b31b4a56', 'request_id': 'req-7eb8d1b1-86fc-4dc4-8080-303831897a71'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:59.835557 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7eb8d1b1-86fc-4dc4-8080-303831897a71 admin admin] The token cache is being invalidate because project 4958ca7569574b898b5669f7b31b4a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:28:59.835847 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7eb8d1b1-86fc-4dc4-8080-303831897a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:59.836465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7eb8d1b1-86fc-4dc4-8080-303831897a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:28:59.837949 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1343/2702] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:28:59 2022] DELETE /identity/v3/projects/4958ca7569574b898b5669f7b31b4a56 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:28:59.844103 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8277a6-0bea-4622-907b-5e8406404e0c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:59.844427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8277a6-0bea-4622-907b-5e8406404e0c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:59.844708 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8277a6-0bea-4622-907b-5e8406404e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:59.864024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8c8277a6-0bea-4622-907b-5e8406404e0c None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:28:59.865238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8c8277a6-0bea-4622-907b-5e8406404e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:59.924348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1360/2703] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:28:59.932289 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2f242-bad3-4b65-9db2-6e884451712d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:59.932627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2f242-bad3-4b65-9db2-6e884451712d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:59.932910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2f242-bad3-4b65-9db2-6e884451712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:59.952368 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-68c2f242-bad3-4b65-9db2-6e884451712d None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:28:59.953556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-68c2f242-bad3-4b65-9db2-6e884451712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:28:59.961249 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1344/2704] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:28:59.966403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8277a6-0bea-4622-907b-5e8406404e0c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:28:59.975929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8277a6-0bea-4622-907b-5e8406404e0c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:28:59.980496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dec0ae-5ffb-4476-9909-6970839d1c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:28:59.981082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dec0ae-5ffb-4476-9909-6970839d1c0d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:28:59.981359 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dec0ae-5ffb-4476-9909-6970839d1c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:28:59.981628 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dec0ae-5ffb-4476-9909-6970839d1c0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:28:59.982267 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dec0ae-5ffb-4476-9909-6970839d1c0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:28:59.982567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dec0ae-5ffb-4476-9909-6970839d1c0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:28:59.984180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dec0ae-5ffb-4476-9909-6970839d1c0d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:28:59.995767 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1361/2705] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:29:00.000190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2f242-bad3-4b65-9db2-6e884451712d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:00.009182 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2f242-bad3-4b65-9db2-6e884451712d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:00.014569 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b8906-1a5e-498d-b3f5-2a05cf2dc7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:00.015186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b8906-1a5e-498d-b3f5-2a05cf2dc7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:00.015463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b8906-1a5e-498d-b3f5-2a05cf2dc7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:00.015732 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b8906-1a5e-498d-b3f5-2a05cf2dc7d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:00.016358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b8906-1a5e-498d-b3f5-2a05cf2dc7d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:00.018216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b8906-1a5e-498d-b3f5-2a05cf2dc7d2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:00.045864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1345/2706] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:28:59 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:29:00.050120 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dec0ae-5ffb-4476-9909-6970839d1c0d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:00.060221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dec0ae-5ffb-4476-9909-6970839d1c0d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:00.086136 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:00.118933 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7407493-f182-41ff-a892-3fc2750ecbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:00.119569 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7407493-f182-41ff-a892-3fc2750ecbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:00.119873 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7407493-f182-41ff-a892-3fc2750ecbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:00.120194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7407493-f182-41ff-a892-3fc2750ecbb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:00.121247 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7407493-f182-41ff-a892-3fc2750ecbb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:00.123322 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7407493-f182-41ff-a892-3fc2750ecbb7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:00.144627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1362/2707] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:29:00 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:29:00.148904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b8906-1a5e-498d-b3f5-2a05cf2dc7d2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:00.159958 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b8906-1a5e-498d-b3f5-2a05cf2dc7d2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:00.164417 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d395f8c-af73-47f1-843d-b33bc48b008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:00.165032 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d395f8c-af73-47f1-843d-b33bc48b008a admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:00.165307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d395f8c-af73-47f1-843d-b33bc48b008a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:00.165575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d395f8c-af73-47f1-843d-b33bc48b008a admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:00.166202 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d395f8c-af73-47f1-843d-b33bc48b008a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:00.168236 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d395f8c-af73-47f1-843d-b33bc48b008a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:00.177897 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1346/2708] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:00.181842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7407493-f182-41ff-a892-3fc2750ecbb7 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:00.192207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7407493-f182-41ff-a892-3fc2750ecbb7 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:00.196786 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a45af-8679-4461-a292-f7d6bc00f4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:00.197374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a45af-8679-4461-a292-f7d6bc00f4fc admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:00.197656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a45af-8679-4461-a292-f7d6bc00f4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:00.197930 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a45af-8679-4461-a292-f7d6bc00f4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:00.199139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a45af-8679-4461-a292-f7d6bc00f4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:00.200715 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a45af-8679-4461-a292-f7d6bc00f4fc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:00.211005 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1363/2709] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:29:00.215542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d395f8c-af73-47f1-843d-b33bc48b008a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:00.225349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d395f8c-af73-47f1-843d-b33bc48b008a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:00.230111 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2fd4e-2787-4fa5-97a3-1042ef199545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:00.230860 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2fd4e-2787-4fa5-97a3-1042ef199545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:00.231169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2fd4e-2787-4fa5-97a3-1042ef199545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:00.231442 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2fd4e-2787-4fa5-97a3-1042ef199545 admin admin] PATH_INFO: `/v3/projects/65bdfa9a435b4d538580c4c1667414d5/users/c4c2a7774c624b65a3ccac40773cf0c7/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:00.246129 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2fd4e-2787-4fa5-97a3-1042ef199545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65bdfa9a435b4d538580c4c1667414d5, user_id=c4c2a7774c624b65a3ccac40773cf0c7, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:00.248855 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2fd4e-2787-4fa5-97a3-1042ef199545 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:00.262242 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1347/2710] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:29:00 2022] PUT /identity/v3/projects/65bdfa9a435b4d538580c4c1667414d5/users/c4c2a7774c624b65a3ccac40773cf0c7/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:00.267231 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0614220-2da1-4b1d-877a-1e779cd19a40 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:00.267683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0614220-2da1-4b1d-877a-1e779cd19a40 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:00.267797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0614220-2da1-4b1d-877a-1e779cd19a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:00.286787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b0614220-2da1-4b1d-877a-1e779cd19a40 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:00.288022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b0614220-2da1-4b1d-877a-1e779cd19a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:00.345207 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1364/2711] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:00.355325 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2fd4e-2787-4fa5-97a3-1042ef199545 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:00.357010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-21b2fd4e-2787-4fa5-97a3-1042ef199545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:00.415154 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2fd4e-2787-4fa5-97a3-1042ef199545 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:00.418840 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d33c48-5ea2-41bb-ab7c-3184b633e91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:00.419475 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d33c48-5ea2-41bb-ab7c-3184b633e91f service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:00.419751 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d33c48-5ea2-41bb-ab7c-3184b633e91f service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:00.420017 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d33c48-5ea2-41bb-ab7c-3184b633e91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:00.429597 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:00.432134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d33c48-5ea2-41bb-ab7c-3184b633e91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:00.434718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d33c48-5ea2-41bb-ab7c-3184b633e91f service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:00.446078 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1348/2712] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:29:01.053221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747be81a-50ed-43c2-8b08-70e8d477b4ea None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:01.053514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747be81a-50ed-43c2-8b08-70e8d477b4ea None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:01.053789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747be81a-50ed-43c2-8b08-70e8d477b4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:01.083651 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-747be81a-50ed-43c2-8b08-70e8d477b4ea None None] MFA Rules not processed for user `c4c2a7774c624b65a3ccac40773cf0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:01.085022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-747be81a-50ed-43c2-8b08-70e8d477b4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:01.152422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1365/2713] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:01 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:29:01.156655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d33c48-5ea2-41bb-ab7c-3184b633e91f service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:01.166837 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d33c48-5ea2-41bb-ab7c-3184b633e91f service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:01.172013 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e713f-0827-4c16-a9a8-4054332322d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:01.172603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e713f-0827-4c16-a9a8-4054332322d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:01.172877 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e713f-0827-4c16-a9a8-4054332322d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:01.173140 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e713f-0827-4c16-a9a8-4054332322d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:01.173904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e713f-0827-4c16-a9a8-4054332322d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:01.175885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e713f-0827-4c16-a9a8-4054332322d5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:01.204705 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1349/2714] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:29:01 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:29:01.208949 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747be81a-50ed-43c2-8b08-70e8d477b4ea None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:01.220384 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747be81a-50ed-43c2-8b08-70e8d477b4ea None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:01.254205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:01.278357 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f533f-3384-4b37-be28-d6a0833b4709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:01.278989 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f533f-3384-4b37-be28-d6a0833b4709 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:01.279262 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f533f-3384-4b37-be28-d6a0833b4709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:01.279534 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f533f-3384-4b37-be28-d6a0833b4709 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:01.280176 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f533f-3384-4b37-be28-d6a0833b4709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:01.282072 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f533f-3384-4b37-be28-d6a0833b4709 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:01.302495 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1366/2715] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:29:01 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:29:01.306664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e713f-0827-4c16-a9a8-4054332322d5 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:01.317967 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e713f-0827-4c16-a9a8-4054332322d5 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:01.322548 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6eeff-0ccd-4933-a83f-f3c14ef81d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:01.323179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6eeff-0ccd-4933-a83f-f3c14ef81d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:01.323502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6eeff-0ccd-4933-a83f-f3c14ef81d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:01.323832 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6eeff-0ccd-4933-a83f-f3c14ef81d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:01.324458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6eeff-0ccd-4933-a83f-f3c14ef81d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:01.326037 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6eeff-0ccd-4933-a83f-f3c14ef81d03 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:01.336333 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1350/2716] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:01.340875 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f533f-3384-4b37-be28-d6a0833b4709 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:01.350711 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f533f-3384-4b37-be28-d6a0833b4709 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:01.356209 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77ed4e-6c19-4dde-93f0-0482d9582fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:01.356848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ed4e-6c19-4dde-93f0-0482d9582fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:01.357126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ed4e-6c19-4dde-93f0-0482d9582fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:01.357398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ed4e-6c19-4dde-93f0-0482d9582fd9 admin admin] PATH_INFO: `/v3/projects/e86af665b5094ec7ba65b42d7e9ce3fc/users/e0e3c1bac50243b28bfebc133a5af5d3/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:01.372290 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77ed4e-6c19-4dde-93f0-0482d9582fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86af665b5094ec7ba65b42d7e9ce3fc, user_id=e0e3c1bac50243b28bfebc133a5af5d3, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:01.374916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77ed4e-6c19-4dde-93f0-0482d9582fd9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:01.388316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1367/2717] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:29:01 2022] PUT /identity/v3/projects/e86af665b5094ec7ba65b42d7e9ce3fc/users/e0e3c1bac50243b28bfebc133a5af5d3/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:01.392239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6eeff-0ccd-4933-a83f-f3c14ef81d03 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:01.402636 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6eeff-0ccd-4933-a83f-f3c14ef81d03 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:01.462082 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72b317-edb0-49a2-bfae-6d15366e11bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:01.462693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b317-edb0-49a2-bfae-6d15366e11bb admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:01.462986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b317-edb0-49a2-bfae-6d15366e11bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:01.463304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b317-edb0-49a2-bfae-6d15366e11bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:01.464532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72b317-edb0-49a2-bfae-6d15366e11bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:01.466527 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72b317-edb0-49a2-bfae-6d15366e11bb admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:01.476249 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1351/2718] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:01.480841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77ed4e-6c19-4dde-93f0-0482d9582fd9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:01.490850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77ed4e-6c19-4dde-93f0-0482d9582fd9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:01.495755 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf603e6-d497-438e-8da3-f62aaf0ea36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:01.496421 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf603e6-d497-438e-8da3-f62aaf0ea36f admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:01.496700 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf603e6-d497-438e-8da3-f62aaf0ea36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:01.496973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf603e6-d497-438e-8da3-f62aaf0ea36f admin admin] PATH_INFO: `/v3/projects/e86af665b5094ec7ba65b42d7e9ce3fc/users/e0e3c1bac50243b28bfebc133a5af5d3/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:01.498891 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf603e6-d497-438e-8da3-f62aaf0ea36f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86af665b5094ec7ba65b42d7e9ce3fc, user_id=e0e3c1bac50243b28bfebc133a5af5d3, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:01.501517 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf603e6-d497-438e-8da3-f62aaf0ea36f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:01.512240 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1368/2719] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:29:01 2022] PUT /identity/v3/projects/e86af665b5094ec7ba65b42d7e9ce3fc/users/e0e3c1bac50243b28bfebc133a5af5d3/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:29:02.141423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222a29a-2efc-4d25-9a97-7c2df570a36e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:02.141710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222a29a-2efc-4d25-9a97-7c2df570a36e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:02.141985 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222a29a-2efc-4d25-9a97-7c2df570a36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:02.170641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7222a29a-2efc-4d25-9a97-7c2df570a36e None None] MFA Rules not processed for user `e0e3c1bac50243b28bfebc133a5af5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:02.171898 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7222a29a-2efc-4d25-9a97-7c2df570a36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:02.241233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1352/2720] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:02 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:03.449761 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf603e6-d497-438e-8da3-f62aaf0ea36f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:03.451846 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-acf603e6-d497-438e-8da3-f62aaf0ea36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:03.514697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222a29a-2efc-4d25-9a97-7c2df570a36e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:03.528990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf603e6-d497-438e-8da3-f62aaf0ea36f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:03.534634 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fefb4-6681-4d0e-b02c-056d59669344 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c5e6dae854a44a0ad6628e7dd69dfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:03.535304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fefb4-6681-4d0e-b02c-056d59669344 service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:03.535583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fefb4-6681-4d0e-b02c-056d59669344 service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:03.535857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fefb4-6681-4d0e-b02c-056d59669344 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:03.537615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0d8fefb4-6681-4d0e-b02c-056d59669344 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:03.551552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fefb4-6681-4d0e-b02c-056d59669344 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:03.553215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fefb4-6681-4d0e-b02c-056d59669344 service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:03.564649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1369/2721] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:29:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:29:03.569575 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:03.588281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222a29a-2efc-4d25-9a97-7c2df570a36e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:03.593043 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b81c20-6bfa-464d-a731-7c0fba1cd575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:03.593672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b81c20-6bfa-464d-a731-7c0fba1cd575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:03.593949 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b81c20-6bfa-464d-a731-7c0fba1cd575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:03.594222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b81c20-6bfa-464d-a731-7c0fba1cd575 admin admin] PATH_INFO: `/v3/users/c4c2a7774c624b65a3ccac40773cf0c7` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:03.595585 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b81c20-6bfa-464d-a731-7c0fba1cd575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c2a7774c624b65a3ccac40773cf0c7)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:03.597562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b81c20-6bfa-464d-a731-7c0fba1cd575 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:03.644165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73b81c20-6bfa-464d-a731-7c0fba1cd575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c2a7774c624b65a3ccac40773cf0c7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:03.644730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73b81c20-6bfa-464d-a731-7c0fba1cd575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c2a7774c624b65a3ccac40773cf0c7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:03.652314 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73b81c20-6bfa-464d-a731-7c0fba1cd575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c2a7774c624b65a3ccac40773cf0c7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:03.663990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73b81c20-6bfa-464d-a731-7c0fba1cd575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c2a7774c624b65a3ccac40773cf0c7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:03.664725 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73b81c20-6bfa-464d-a731-7c0fba1cd575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c2a7774c624b65a3ccac40773cf0c7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:03.678364 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1353/2722] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:29:03 2022] DELETE /identity/v3/users/c4c2a7774c624b65a3ccac40773cf0c7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:03.867852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fefb4-6681-4d0e-b02c-056d59669344 service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:03.880261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fefb4-6681-4d0e-b02c-056d59669344 service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:03.937914 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1869-8218-4a84-8a7e-11f43accd62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:03.938535 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1869-8218-4a84-8a7e-11f43accd62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:03.938812 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1869-8218-4a84-8a7e-11f43accd62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:03.939107 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1869-8218-4a84-8a7e-11f43accd62c admin admin] PATH_INFO: `/v3/projects/65bdfa9a435b4d538580c4c1667414d5` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:03.940211 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc1869-8218-4a84-8a7e-11f43accd62c admin admin] RBAC: Authorizing `identity:delete_project(project_id=65bdfa9a435b4d538580c4c1667414d5)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:03.942081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc1869-8218-4a84-8a7e-11f43accd62c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:03.966759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:03.990356 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-06cc1869-8218-4a84-8a7e-11f43accd62c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65bdfa9a435b4d538580c4c1667414d5', 'request_id': 'req-06cc1869-8218-4a84-8a7e-11f43accd62c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:03.997549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-06cc1869-8218-4a84-8a7e-11f43accd62c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65bdfa9a435b4d538580c4c1667414d5', 'request_id': 'req-06cc1869-8218-4a84-8a7e-11f43accd62c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:04.004251 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-06cc1869-8218-4a84-8a7e-11f43accd62c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65bdfa9a435b4d538580c4c1667414d5', 'request_id': 'req-06cc1869-8218-4a84-8a7e-11f43accd62c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:04.014841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-06cc1869-8218-4a84-8a7e-11f43accd62c admin admin] The token cache is being invalidate because project 65bdfa9a435b4d538580c4c1667414d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:29:04.015174 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-06cc1869-8218-4a84-8a7e-11f43accd62c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:04.015816 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-06cc1869-8218-4a84-8a7e-11f43accd62c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:04.017281 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1370/2723] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:29:03 2022] DELETE /identity/v3/projects/65bdfa9a435b4d538580c4c1667414d5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:04.021228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b81c20-6bfa-464d-a731-7c0fba1cd575 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:04.022610 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-73b81c20-6bfa-464d-a731-7c0fba1cd575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:04.035989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b81c20-6bfa-464d-a731-7c0fba1cd575 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:04.092428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b5237-f628-459b-9bc7-0e63c07d3cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:04.093064 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b5237-f628-459b-9bc7-0e63c07d3cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:04.093345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b5237-f628-459b-9bc7-0e63c07d3cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:04.093620 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b5237-f628-459b-9bc7-0e63c07d3cdd admin admin] PATH_INFO: `/v3/users/e0e3c1bac50243b28bfebc133a5af5d3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:04.094759 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b5237-f628-459b-9bc7-0e63c07d3cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e3c1bac50243b28bfebc133a5af5d3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:04.096739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b5237-f628-459b-9bc7-0e63c07d3cdd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:04.142783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f27b5237-f628-459b-9bc7-0e63c07d3cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e3c1bac50243b28bfebc133a5af5d3'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:04.143449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f27b5237-f628-459b-9bc7-0e63c07d3cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e3c1bac50243b28bfebc133a5af5d3'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:04.150456 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f27b5237-f628-459b-9bc7-0e63c07d3cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e3c1bac50243b28bfebc133a5af5d3'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:04.157908 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:04.165125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f27b5237-f628-459b-9bc7-0e63c07d3cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e3c1bac50243b28bfebc133a5af5d3'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:04.165918 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f27b5237-f628-459b-9bc7-0e63c07d3cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e3c1bac50243b28bfebc133a5af5d3'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:04.179416 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1354/2724] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:29:04 2022] DELETE /identity/v3/users/e0e3c1bac50243b28bfebc133a5af5d3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:04.347142 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1869-8218-4a84-8a7e-11f43accd62c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:04.348852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-06cc1869-8218-4a84-8a7e-11f43accd62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:04.367052 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1869-8218-4a84-8a7e-11f43accd62c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:04.423235 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba44df-86e7-4841-93db-23f939809c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:04.423804 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba44df-86e7-4841-93db-23f939809c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:04.424081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba44df-86e7-4841-93db-23f939809c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:04.424354 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba44df-86e7-4841-93db-23f939809c1a admin admin] PATH_INFO: `/v3/projects/e86af665b5094ec7ba65b42d7e9ce3fc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:04.425477 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba44df-86e7-4841-93db-23f939809c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86af665b5094ec7ba65b42d7e9ce3fc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:04.427391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba44df-86e7-4841-93db-23f939809c1a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:04.474639 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-28ba44df-86e7-4841-93db-23f939809c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86af665b5094ec7ba65b42d7e9ce3fc', 'request_id': 'req-28ba44df-86e7-4841-93db-23f939809c1a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:04.481669 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-28ba44df-86e7-4841-93db-23f939809c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86af665b5094ec7ba65b42d7e9ce3fc', 'request_id': 'req-28ba44df-86e7-4841-93db-23f939809c1a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:04.487781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-28ba44df-86e7-4841-93db-23f939809c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86af665b5094ec7ba65b42d7e9ce3fc', 'request_id': 'req-28ba44df-86e7-4841-93db-23f939809c1a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:04.498260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-28ba44df-86e7-4841-93db-23f939809c1a admin admin] The token cache is being invalidate because project e86af665b5094ec7ba65b42d7e9ce3fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:29:04.498552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-28ba44df-86e7-4841-93db-23f939809c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:04.499220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-28ba44df-86e7-4841-93db-23f939809c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:04.500679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1371/2725] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:29:04 2022] DELETE /identity/v3/projects/e86af665b5094ec7ba65b42d7e9ce3fc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:04.505555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732aab7-51b8-421d-a63d-f0149ae8f201 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:04.505838 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732aab7-51b8-421d-a63d-f0149ae8f201 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:04.506118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732aab7-51b8-421d-a63d-f0149ae8f201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:04.525599 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5732aab7-51b8-421d-a63d-f0149ae8f201 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:04.527414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5732aab7-51b8-421d-a63d-f0149ae8f201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:04.584492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1355/2726] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:04.593344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0710f-9e1a-4c80-a827-69f39007e7fd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:04.593648 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0710f-9e1a-4c80-a827-69f39007e7fd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:04.593947 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0710f-9e1a-4c80-a827-69f39007e7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:04.613329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5bd0710f-9e1a-4c80-a827-69f39007e7fd None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:04.614525 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5bd0710f-9e1a-4c80-a827-69f39007e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:04.622623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1372/2727] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:04.626931 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732aab7-51b8-421d-a63d-f0149ae8f201 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:04.637207 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732aab7-51b8-421d-a63d-f0149ae8f201 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:04.641735 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e268d4-3308-46de-b6f2-e6982c287a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:04.642349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e268d4-3308-46de-b6f2-e6982c287a94 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:04.642627 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e268d4-3308-46de-b6f2-e6982c287a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:04.642899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e268d4-3308-46de-b6f2-e6982c287a94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:04.643572 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e268d4-3308-46de-b6f2-e6982c287a94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:29:04.643873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e268d4-3308-46de-b6f2-e6982c287a94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:04.645464 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e268d4-3308-46de-b6f2-e6982c287a94 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:04.657746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1356/2728] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:29:04.662003 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0710f-9e1a-4c80-a827-69f39007e7fd None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:04.671320 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0710f-9e1a-4c80-a827-69f39007e7fd None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:04.675987 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c04c0-65c7-4138-822a-8b05d150b129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:04.676522 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c04c0-65c7-4138-822a-8b05d150b129 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:04.676802 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c04c0-65c7-4138-822a-8b05d150b129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:04.677076 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c04c0-65c7-4138-822a-8b05d150b129 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:04.677733 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c04c0-65c7-4138-822a-8b05d150b129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:04.679657 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c04c0-65c7-4138-822a-8b05d150b129 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:04.706892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1373/2729] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:29:04 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:29:04.711023 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e268d4-3308-46de-b6f2-e6982c287a94 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:04.721272 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e268d4-3308-46de-b6f2-e6982c287a94 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:04.777381 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be725a4-59ca-49d2-91c3-1a6ea3f3e682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:04.778094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be725a4-59ca-49d2-91c3-1a6ea3f3e682 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:04.778384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be725a4-59ca-49d2-91c3-1a6ea3f3e682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:04.778656 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be725a4-59ca-49d2-91c3-1a6ea3f3e682 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:04.779330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be725a4-59ca-49d2-91c3-1a6ea3f3e682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:04.781222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be725a4-59ca-49d2-91c3-1a6ea3f3e682 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:04.801904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1357/2730] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:29:04 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:29:04.806030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c04c0-65c7-4138-822a-8b05d150b129 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:04.816591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c04c0-65c7-4138-822a-8b05d150b129 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:04.821221 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85a85d-a401-4448-9022-ae3f915e5d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:04.821814 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85a85d-a401-4448-9022-ae3f915e5d84 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:04.822092 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85a85d-a401-4448-9022-ae3f915e5d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:04.822363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85a85d-a401-4448-9022-ae3f915e5d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:04.822998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85a85d-a401-4448-9022-ae3f915e5d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:04.825416 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85a85d-a401-4448-9022-ae3f915e5d84 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:04.830547 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:04.835794 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1374/2731] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:04.839996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be725a4-59ca-49d2-91c3-1a6ea3f3e682 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:04.850284 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be725a4-59ca-49d2-91c3-1a6ea3f3e682 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:04.855208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9bd6f-08b1-4db1-bf59-60eb8ba21783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:04.855805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9bd6f-08b1-4db1-bf59-60eb8ba21783 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:04.856085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9bd6f-08b1-4db1-bf59-60eb8ba21783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:04.856357 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9bd6f-08b1-4db1-bf59-60eb8ba21783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:04.856990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9bd6f-08b1-4db1-bf59-60eb8ba21783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:04.858581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9bd6f-08b1-4db1-bf59-60eb8ba21783 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:04.870504 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1358/2732] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:04.874694 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85a85d-a401-4448-9022-ae3f915e5d84 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:04.884419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85a85d-a401-4448-9022-ae3f915e5d84 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:04.889606 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5792c-6519-4f71-9e73-8a6ed422ccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:04.890246 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5792c-6519-4f71-9e73-8a6ed422ccac admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:04.890525 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5792c-6519-4f71-9e73-8a6ed422ccac admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:04.890798 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5792c-6519-4f71-9e73-8a6ed422ccac admin admin] PATH_INFO: `/v3/projects/5800e966773a410eab842703e4b0e356/users/7236ac7574ff46329d0419993c3ea6d1/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:04.905050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5792c-6519-4f71-9e73-8a6ed422ccac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5800e966773a410eab842703e4b0e356, user_id=7236ac7574ff46329d0419993c3ea6d1, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:04.907696 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5792c-6519-4f71-9e73-8a6ed422ccac admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:04.920947 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1375/2733] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:29:04 2022] PUT /identity/v3/projects/5800e966773a410eab842703e4b0e356/users/7236ac7574ff46329d0419993c3ea6d1/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:04.932186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64968815-8976-4336-99fc-7af776514751 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:04.932414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64968815-8976-4336-99fc-7af776514751 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:04.933232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64968815-8976-4336-99fc-7af776514751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:04.961267 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-64968815-8976-4336-99fc-7af776514751 None None] MFA Rules not processed for user `7236ac7574ff46329d0419993c3ea6d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:04.962456 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-64968815-8976-4336-99fc-7af776514751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:04.999704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:05.028148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1359/2734] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:05.032828 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5792c-6519-4f71-9e73-8a6ed422ccac admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:05.094172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5792c-6519-4f71-9e73-8a6ed422ccac admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:05.098696 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188c63a-ad20-4ad2-b07b-548e2f49de67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:05.099313 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188c63a-ad20-4ad2-b07b-548e2f49de67 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:05.099591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188c63a-ad20-4ad2-b07b-548e2f49de67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:05.099862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188c63a-ad20-4ad2-b07b-548e2f49de67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:05.100491 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188c63a-ad20-4ad2-b07b-548e2f49de67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:05.102413 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188c63a-ad20-4ad2-b07b-548e2f49de67 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:05.129026 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1376/2735] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:29:05 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:29:05.133194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64968815-8976-4336-99fc-7af776514751 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:05.144265 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64968815-8976-4336-99fc-7af776514751 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:05.200086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffca5f-04da-4acc-9bd4-ff84a2dfb740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:05.200623 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffca5f-04da-4acc-9bd4-ff84a2dfb740 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:05.200901 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffca5f-04da-4acc-9bd4-ff84a2dfb740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:05.201174 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffca5f-04da-4acc-9bd4-ff84a2dfb740 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:05.201813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffca5f-04da-4acc-9bd4-ff84a2dfb740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:05.203764 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffca5f-04da-4acc-9bd4-ff84a2dfb740 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:05.225011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1360/2736] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:29:05 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:29:05.229178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188c63a-ad20-4ad2-b07b-548e2f49de67 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:05.239962 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188c63a-ad20-4ad2-b07b-548e2f49de67 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:05.244587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d5b3b-9e41-4dbc-b52c-df09256145d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:05.245785 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d5b3b-9e41-4dbc-b52c-df09256145d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:05.246081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d5b3b-9e41-4dbc-b52c-df09256145d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:05.246373 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d5b3b-9e41-4dbc-b52c-df09256145d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:05.247020 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d5b3b-9e41-4dbc-b52c-df09256145d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:05.248692 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d5b3b-9e41-4dbc-b52c-df09256145d5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:05.259284 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1377/2737] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:05.263480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffca5f-04da-4acc-9bd4-ff84a2dfb740 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:05.273238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffca5f-04da-4acc-9bd4-ff84a2dfb740 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:05.278157 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579b0ae-c908-4b53-885d-7c247588c0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:05.278804 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579b0ae-c908-4b53-885d-7c247588c0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:05.279113 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579b0ae-c908-4b53-885d-7c247588c0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:05.279393 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579b0ae-c908-4b53-885d-7c247588c0c2 admin admin] PATH_INFO: `/v3/projects/00f7d020d2034382bb75a5b6aab9692b/users/eec4ae3f3ef34f63b89d609ac312e458/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:05.294484 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579b0ae-c908-4b53-885d-7c247588c0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f7d020d2034382bb75a5b6aab9692b, user_id=eec4ae3f3ef34f63b89d609ac312e458, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:05.297118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579b0ae-c908-4b53-885d-7c247588c0c2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:05.310375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1361/2738] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:29:05 2022] PUT /identity/v3/projects/00f7d020d2034382bb75a5b6aab9692b/users/eec4ae3f3ef34f63b89d609ac312e458/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:29:05.314190 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d5b3b-9e41-4dbc-b52c-df09256145d5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:05.324175 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d5b3b-9e41-4dbc-b52c-df09256145d5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:05.380616 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87743f8b-e673-491a-81c4-9749f19146d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:05.381227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87743f8b-e673-491a-81c4-9749f19146d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:05.381529 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87743f8b-e673-491a-81c4-9749f19146d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:05.381807 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87743f8b-e673-491a-81c4-9749f19146d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:05.382446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87743f8b-e673-491a-81c4-9749f19146d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:05.384068 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87743f8b-e673-491a-81c4-9749f19146d3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:05.394467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1378/2739] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:29:05.398433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579b0ae-c908-4b53-885d-7c247588c0c2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:05.409214 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579b0ae-c908-4b53-885d-7c247588c0c2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:05.413880 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4f565-0a52-47f1-a9f0-b57f0fbf91dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:05.414544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4f565-0a52-47f1-a9f0-b57f0fbf91dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:05.414824 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4f565-0a52-47f1-a9f0-b57f0fbf91dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:05.415125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4f565-0a52-47f1-a9f0-b57f0fbf91dd admin admin] PATH_INFO: `/v3/projects/00f7d020d2034382bb75a5b6aab9692b/users/eec4ae3f3ef34f63b89d609ac312e458/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:05.417188 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4f565-0a52-47f1-a9f0-b57f0fbf91dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f7d020d2034382bb75a5b6aab9692b, user_id=eec4ae3f3ef34f63b89d609ac312e458, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:05.419858 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4f565-0a52-47f1-a9f0-b57f0fbf91dd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:05.430274 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1362/2740] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:29:05 2022] PUT /identity/v3/projects/00f7d020d2034382bb75a5b6aab9692b/users/eec4ae3f3ef34f63b89d609ac312e458/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:05.440942 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d99626-1fff-4ef7-b766-850e2f00ee32 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:05.441232 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d99626-1fff-4ef7-b766-850e2f00ee32 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:05.441511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d99626-1fff-4ef7-b766-850e2f00ee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:05.469966 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-89d99626-1fff-4ef7-b766-850e2f00ee32 None None] MFA Rules not processed for user `eec4ae3f3ef34f63b89d609ac312e458`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:05.471161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-89d99626-1fff-4ef7-b766-850e2f00ee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:05.503935 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:05.539506 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1379/2741] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:05.549926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4f565-0a52-47f1-a9f0-b57f0fbf91dd admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:05.551681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-99c4f565-0a52-47f1-a9f0-b57f0fbf91dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:05.608910 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4f565-0a52-47f1-a9f0-b57f0fbf91dd admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:05.612550 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f9810-5f7e-4926-b76c-cc06d537ba9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:05.613150 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f9810-5f7e-4926-b76c-cc06d537ba9e service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:05.613430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f9810-5f7e-4926-b76c-cc06d537ba9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:05.613702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f9810-5f7e-4926-b76c-cc06d537ba9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:05.623514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f9810-5f7e-4926-b76c-cc06d537ba9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:05.624946 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f9810-5f7e-4926-b76c-cc06d537ba9e service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:05.634326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1363/2742] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:29:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:29:05.681197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d99626-1fff-4ef7-b766-850e2f00ee32 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:05.683235 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-89d99626-1fff-4ef7-b766-850e2f00ee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:05.695172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d99626-1fff-4ef7-b766-850e2f00ee32 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:05.699537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efde12a-6404-41a8-82b1-490a1c2e1e62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:05.700134 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efde12a-6404-41a8-82b1-490a1c2e1e62 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:05.700419 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efde12a-6404-41a8-82b1-490a1c2e1e62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:05.700695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efde12a-6404-41a8-82b1-490a1c2e1e62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:05.759306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efde12a-6404-41a8-82b1-490a1c2e1e62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:05.761258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efde12a-6404-41a8-82b1-490a1c2e1e62 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:05.770335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1380/2743] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:29:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:29:09.046745 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f9810-5f7e-4926-b76c-cc06d537ba9e service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:09.081231 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:09.110379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f9810-5f7e-4926-b76c-cc06d537ba9e service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:09.114913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134b7ff-2bdd-427b-8ea0-30f732df72d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:09.115558 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134b7ff-2bdd-427b-8ea0-30f732df72d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:09.115837 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134b7ff-2bdd-427b-8ea0-30f732df72d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:09.116109 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134b7ff-2bdd-427b-8ea0-30f732df72d6 admin admin] PATH_INFO: `/v3/users/7236ac7574ff46329d0419993c3ea6d1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:09.117224 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134b7ff-2bdd-427b-8ea0-30f732df72d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7236ac7574ff46329d0419993c3ea6d1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:09.119163 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134b7ff-2bdd-427b-8ea0-30f732df72d6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:09.164947 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e134b7ff-2bdd-427b-8ea0-30f732df72d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7236ac7574ff46329d0419993c3ea6d1'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:09.165513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e134b7ff-2bdd-427b-8ea0-30f732df72d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7236ac7574ff46329d0419993c3ea6d1'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:09.173322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e134b7ff-2bdd-427b-8ea0-30f732df72d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7236ac7574ff46329d0419993c3ea6d1'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:09.185534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e134b7ff-2bdd-427b-8ea0-30f732df72d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7236ac7574ff46329d0419993c3ea6d1'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:09.186380 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e134b7ff-2bdd-427b-8ea0-30f732df72d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7236ac7574ff46329d0419993c3ea6d1'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:09.198973 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1364/2744] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:29:09 2022] DELETE /identity/v3/users/7236ac7574ff46329d0419993c3ea6d1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:09.203567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fa97f-0f19-424b-9aab-c64f6ea06d43 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:09.204046 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fa97f-0f19-424b-9aab-c64f6ea06d43 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:09.204162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fa97f-0f19-424b-9aab-c64f6ea06d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:09.225088 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-402fa97f-0f19-424b-9aab-c64f6ea06d43 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:09.226282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-402fa97f-0f19-424b-9aab-c64f6ea06d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:09.282811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1381/2745] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:09.293321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134b7ff-2bdd-427b-8ea0-30f732df72d6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:09.294761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e134b7ff-2bdd-427b-8ea0-30f732df72d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:09.350813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134b7ff-2bdd-427b-8ea0-30f732df72d6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:09.355247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5efdbf-5a95-4872-b9e2-878aa049b89f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:09.356107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5efdbf-5a95-4872-b9e2-878aa049b89f service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:09.356384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5efdbf-5a95-4872-b9e2-878aa049b89f service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:09.356658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5efdbf-5a95-4872-b9e2-878aa049b89f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:09.365600 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5efdbf-5a95-4872-b9e2-878aa049b89f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:09.367021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5efdbf-5a95-4872-b9e2-878aa049b89f service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:09.376434 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1365/2746] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:29:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:29:09.645737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fa97f-0f19-424b-9aab-c64f6ea06d43 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:09.647213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-402fa97f-0f19-424b-9aab-c64f6ea06d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:09.660139 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fa97f-0f19-424b-9aab-c64f6ea06d43 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:09.665582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b26a7b-e15a-4939-9148-3c500c084f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:09.666437 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26a7b-e15a-4939-9148-3c500c084f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:09.666728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26a7b-e15a-4939-9148-3c500c084f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:09.667300 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26a7b-e15a-4939-9148-3c500c084f12 admin admin] PATH_INFO: `/v3/projects/5800e966773a410eab842703e4b0e356` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:09.668360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b26a7b-e15a-4939-9148-3c500c084f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5800e966773a410eab842703e4b0e356)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:09.670257 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b26a7b-e15a-4939-9148-3c500c084f12 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:09.720178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-90b26a7b-e15a-4939-9148-3c500c084f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5800e966773a410eab842703e4b0e356', 'request_id': 'req-90b26a7b-e15a-4939-9148-3c500c084f12'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:09.727434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-90b26a7b-e15a-4939-9148-3c500c084f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5800e966773a410eab842703e4b0e356', 'request_id': 'req-90b26a7b-e15a-4939-9148-3c500c084f12'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:09.733824 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-90b26a7b-e15a-4939-9148-3c500c084f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5800e966773a410eab842703e4b0e356', 'request_id': 'req-90b26a7b-e15a-4939-9148-3c500c084f12'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:09.737766 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:09.746041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-90b26a7b-e15a-4939-9148-3c500c084f12 admin admin] The token cache is being invalidate because project 5800e966773a410eab842703e4b0e356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:29:09.746537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-90b26a7b-e15a-4939-9148-3c500c084f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:09.747367 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-90b26a7b-e15a-4939-9148-3c500c084f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:09.749029 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1382/2747] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:29:09 2022] DELETE /identity/v3/projects/5800e966773a410eab842703e4b0e356 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:09.753021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5efdbf-5a95-4872-b9e2-878aa049b89f service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:09.763190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5efdbf-5a95-4872-b9e2-878aa049b89f service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:09.814027 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:09.821793 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35660eb3-8c90-4fd3-86cd-59b2124bc8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:09.822615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35660eb3-8c90-4fd3-86cd-59b2124bc8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:09.823621 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35660eb3-8c90-4fd3-86cd-59b2124bc8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:09.823977 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35660eb3-8c90-4fd3-86cd-59b2124bc8f7 admin admin] PATH_INFO: `/v3/users/eec4ae3f3ef34f63b89d609ac312e458` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:09.825168 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35660eb3-8c90-4fd3-86cd-59b2124bc8f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eec4ae3f3ef34f63b89d609ac312e458)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:09.827337 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35660eb3-8c90-4fd3-86cd-59b2124bc8f7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:09.872625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-35660eb3-8c90-4fd3-86cd-59b2124bc8f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eec4ae3f3ef34f63b89d609ac312e458'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:09.873266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-35660eb3-8c90-4fd3-86cd-59b2124bc8f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eec4ae3f3ef34f63b89d609ac312e458'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:09.880130 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-35660eb3-8c90-4fd3-86cd-59b2124bc8f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eec4ae3f3ef34f63b89d609ac312e458'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:09.892674 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-35660eb3-8c90-4fd3-86cd-59b2124bc8f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eec4ae3f3ef34f63b89d609ac312e458'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:09.893311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-35660eb3-8c90-4fd3-86cd-59b2124bc8f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eec4ae3f3ef34f63b89d609ac312e458'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:09.906515 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1366/2748] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:29:09 2022] DELETE /identity/v3/users/eec4ae3f3ef34f63b89d609ac312e458 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:10.175958 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b26a7b-e15a-4939-9148-3c500c084f12 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:10.177447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-90b26a7b-e15a-4939-9148-3c500c084f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:10.192727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b26a7b-e15a-4939-9148-3c500c084f12 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:10.249937 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e41b9-4fad-4687-b44d-461163e47c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:10.250555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e41b9-4fad-4687-b44d-461163e47c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:10.250737 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e41b9-4fad-4687-b44d-461163e47c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:10.251010 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e41b9-4fad-4687-b44d-461163e47c93 admin admin] PATH_INFO: `/v3/projects/00f7d020d2034382bb75a5b6aab9692b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:10.252156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e41b9-4fad-4687-b44d-461163e47c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00f7d020d2034382bb75a5b6aab9692b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:10.254073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e41b9-4fad-4687-b44d-461163e47c93 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:10.300052 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e36e41b9-4fad-4687-b44d-461163e47c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f7d020d2034382bb75a5b6aab9692b', 'request_id': 'req-e36e41b9-4fad-4687-b44d-461163e47c93'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:10.307001 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e36e41b9-4fad-4687-b44d-461163e47c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f7d020d2034382bb75a5b6aab9692b', 'request_id': 'req-e36e41b9-4fad-4687-b44d-461163e47c93'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:10.313902 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e36e41b9-4fad-4687-b44d-461163e47c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f7d020d2034382bb75a5b6aab9692b', 'request_id': 'req-e36e41b9-4fad-4687-b44d-461163e47c93'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:10.324219 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e36e41b9-4fad-4687-b44d-461163e47c93 admin admin] The token cache is being invalidate because project 00f7d020d2034382bb75a5b6aab9692b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:29:10.324510 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e36e41b9-4fad-4687-b44d-461163e47c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:10.325173 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e36e41b9-4fad-4687-b44d-461163e47c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:10.326627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1383/2749] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:29:10 2022] DELETE /identity/v3/projects/00f7d020d2034382bb75a5b6aab9692b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:10.332384 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ac88a-fe02-40a8-895d-3c52b6b3adeb None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:10.332851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ac88a-fe02-40a8-895d-3c52b6b3adeb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:10.332952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ac88a-fe02-40a8-895d-3c52b6b3adeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:10.353307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-9b3ac88a-fe02-40a8-895d-3c52b6b3adeb None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:10.355189 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9b3ac88a-fe02-40a8-895d-3c52b6b3adeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:10.412308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1367/2750] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:10.422114 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b58b3d-8f33-4fab-967d-3cacf5528c03 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:10.422393 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b58b3d-8f33-4fab-967d-3cacf5528c03 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:10.422663 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b58b3d-8f33-4fab-967d-3cacf5528c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:10.443021 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a8b58b3d-8f33-4fab-967d-3cacf5528c03 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:10.444245 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a8b58b3d-8f33-4fab-967d-3cacf5528c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:10.452335 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1384/2751] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:10.456514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ac88a-fe02-40a8-895d-3c52b6b3adeb None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:10.466505 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ac88a-fe02-40a8-895d-3c52b6b3adeb None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:10.471018 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dab6d-c370-4f62-8d41-8df05ac39afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:10.471634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dab6d-c370-4f62-8d41-8df05ac39afc admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:10.471907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dab6d-c370-4f62-8d41-8df05ac39afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:10.472177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dab6d-c370-4f62-8d41-8df05ac39afc admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:10.472807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dab6d-c370-4f62-8d41-8df05ac39afc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:29:10.473105 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dab6d-c370-4f62-8d41-8df05ac39afc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:10.474685 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dab6d-c370-4f62-8d41-8df05ac39afc admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:10.487006 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1368/2752] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:29:10.491085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b58b3d-8f33-4fab-967d-3cacf5528c03 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:10.500905 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b58b3d-8f33-4fab-967d-3cacf5528c03 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:10.505432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d1c09-bbfc-433f-9214-1abb3774baa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:10.506017 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d1c09-bbfc-433f-9214-1abb3774baa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:10.506295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d1c09-bbfc-433f-9214-1abb3774baa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:10.506567 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d1c09-bbfc-433f-9214-1abb3774baa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:10.507258 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d1c09-bbfc-433f-9214-1abb3774baa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:10.509124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d1c09-bbfc-433f-9214-1abb3774baa7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:10.535786 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1385/2753] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:29:10 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:29:10.539888 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dab6d-c370-4f62-8d41-8df05ac39afc admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:10.550445 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dab6d-c370-4f62-8d41-8df05ac39afc admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:10.606681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdc351-c44d-4734-b67a-a9016c603408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:10.607306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdc351-c44d-4734-b67a-a9016c603408 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:10.607580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdc351-c44d-4734-b67a-a9016c603408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:10.607847 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdc351-c44d-4734-b67a-a9016c603408 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:10.608472 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdc351-c44d-4734-b67a-a9016c603408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:10.610356 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdc351-c44d-4734-b67a-a9016c603408 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:10.619085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:10.632872 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1369/2754] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:29:10 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:29:10.637236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d1c09-bbfc-433f-9214-1abb3774baa7 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:10.647406 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d1c09-bbfc-433f-9214-1abb3774baa7 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:10.652901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a5b1a-82ec-4899-805f-fa8a1a619b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:10.653498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a5b1a-82ec-4899-805f-fa8a1a619b01 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:10.653776 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a5b1a-82ec-4899-805f-fa8a1a619b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:10.654047 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a5b1a-82ec-4899-805f-fa8a1a619b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:10.654680 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a5b1a-82ec-4899-805f-fa8a1a619b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:10.656299 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a5b1a-82ec-4899-805f-fa8a1a619b01 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:10.666610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1386/2755] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:10.671296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdc351-c44d-4734-b67a-a9016c603408 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:10.681583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdc351-c44d-4734-b67a-a9016c603408 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:10.687299 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c44bc-21f9-4234-b130-5654b6132a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:10.687917 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c44bc-21f9-4234-b130-5654b6132a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:10.688193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c44bc-21f9-4234-b130-5654b6132a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:10.688458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c44bc-21f9-4234-b130-5654b6132a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:10.689085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c44bc-21f9-4234-b130-5654b6132a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:10.690655 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c44bc-21f9-4234-b130-5654b6132a20 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:10.701319 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1370/2756] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:10.705341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a5b1a-82ec-4899-805f-fa8a1a619b01 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:10.716104 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a5b1a-82ec-4899-805f-fa8a1a619b01 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:10.720625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849170b-6ce4-42ae-b097-80b8116a6a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:10.721256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849170b-6ce4-42ae-b097-80b8116a6a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:10.721534 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849170b-6ce4-42ae-b097-80b8116a6a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:10.721803 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849170b-6ce4-42ae-b097-80b8116a6a61 admin admin] PATH_INFO: `/v3/projects/40bb4b2db10b475f967ff75cd3f75455/users/8a35dfba548548419a92a84369045268/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:10.736849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849170b-6ce4-42ae-b097-80b8116a6a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40bb4b2db10b475f967ff75cd3f75455, user_id=8a35dfba548548419a92a84369045268, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:10.739576 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849170b-6ce4-42ae-b097-80b8116a6a61 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:10.752792 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1387/2757] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:29:10 2022] PUT /identity/v3/projects/40bb4b2db10b475f967ff75cd3f75455/users/8a35dfba548548419a92a84369045268/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:29:10.764381 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96617a7-5788-4923-890d-2d9d53aeef09 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:10.764693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96617a7-5788-4923-890d-2d9d53aeef09 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:10.764969 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96617a7-5788-4923-890d-2d9d53aeef09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:10.792902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e96617a7-5788-4923-890d-2d9d53aeef09 None None] MFA Rules not processed for user `8a35dfba548548419a92a84369045268`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:10.794118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e96617a7-5788-4923-890d-2d9d53aeef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:10.860746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1371/2758] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:10.865532 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849170b-6ce4-42ae-b097-80b8116a6a61 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:10.886740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:10.929255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849170b-6ce4-42ae-b097-80b8116a6a61 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:10.933991 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11332ea-d180-40c4-98eb-d41bda361bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:10.934588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11332ea-d180-40c4-98eb-d41bda361bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:10.934871 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11332ea-d180-40c4-98eb-d41bda361bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:10.935178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11332ea-d180-40c4-98eb-d41bda361bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:10.935813 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11332ea-d180-40c4-98eb-d41bda361bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:10.937692 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11332ea-d180-40c4-98eb-d41bda361bf8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:10.963430 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1388/2759] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:29:10 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:29:10.968338 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96617a7-5788-4923-890d-2d9d53aeef09 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:10.978704 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96617a7-5788-4923-890d-2d9d53aeef09 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:11.034936 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430a72b-b177-4874-a224-c61572a84d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:11.035748 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430a72b-b177-4874-a224-c61572a84d6b admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:11.036026 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430a72b-b177-4874-a224-c61572a84d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:11.036299 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430a72b-b177-4874-a224-c61572a84d6b admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:11.036972 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430a72b-b177-4874-a224-c61572a84d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:11.038881 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430a72b-b177-4874-a224-c61572a84d6b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:11.058964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1372/2760] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:29:10 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:29:11.062948 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11332ea-d180-40c4-98eb-d41bda361bf8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:11.073583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11332ea-d180-40c4-98eb-d41bda361bf8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:11.078481 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88401cf0-61ff-49af-81db-6211b67ab1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:11.079082 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88401cf0-61ff-49af-81db-6211b67ab1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:11.079366 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88401cf0-61ff-49af-81db-6211b67ab1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:11.079636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88401cf0-61ff-49af-81db-6211b67ab1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:11.080266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88401cf0-61ff-49af-81db-6211b67ab1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:11.081839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88401cf0-61ff-49af-81db-6211b67ab1a5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:11.093405 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1389/2761] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:11.097333 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430a72b-b177-4874-a224-c61572a84d6b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:11.107426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430a72b-b177-4874-a224-c61572a84d6b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:11.112234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b013bbb-7ebe-4b66-80eb-9b7fa3dfd9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:11.112876 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b013bbb-7ebe-4b66-80eb-9b7fa3dfd9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:11.113157 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b013bbb-7ebe-4b66-80eb-9b7fa3dfd9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:11.113427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b013bbb-7ebe-4b66-80eb-9b7fa3dfd9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:11.114057 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b013bbb-7ebe-4b66-80eb-9b7fa3dfd9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:11.115683 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b013bbb-7ebe-4b66-80eb-9b7fa3dfd9c2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:11.126000 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1373/2762] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:11.129780 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88401cf0-61ff-49af-81db-6211b67ab1a5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:11.139913 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88401cf0-61ff-49af-81db-6211b67ab1a5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:11.144444 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76320de-6edc-4262-9714-0581827cde57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:11.145074 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76320de-6edc-4262-9714-0581827cde57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:11.145349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76320de-6edc-4262-9714-0581827cde57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:11.145620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76320de-6edc-4262-9714-0581827cde57 admin admin] PATH_INFO: `/v3/projects/e6f732d169a441ac83ab80ac96cc78d8/users/2cea771118c14cc291e3b7f31f203773/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:11.160592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76320de-6edc-4262-9714-0581827cde57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f732d169a441ac83ab80ac96cc78d8, user_id=2cea771118c14cc291e3b7f31f203773, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:11.163208 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76320de-6edc-4262-9714-0581827cde57 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:11.175603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1390/2763] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:29:11 2022] PUT /identity/v3/projects/e6f732d169a441ac83ab80ac96cc78d8/users/2cea771118c14cc291e3b7f31f203773/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:29:11.186614 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48d511-afe0-4f48-8a26-f44efc605eba None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:11.186922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48d511-afe0-4f48-8a26-f44efc605eba None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:11.187246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48d511-afe0-4f48-8a26-f44efc605eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:11.215662 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5c48d511-afe0-4f48-8a26-f44efc605eba None None] MFA Rules not processed for user `2cea771118c14cc291e3b7f31f203773`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:11.216965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5c48d511-afe0-4f48-8a26-f44efc605eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:11.255793 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:11.282963 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1374/2764] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:11.287714 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76320de-6edc-4262-9714-0581827cde57 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:11.349677 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76320de-6edc-4262-9714-0581827cde57 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:11.355642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a12619-36c6-4927-bdd6-c3e2e053a82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:11.356269 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a12619-36c6-4927-bdd6-c3e2e053a82f admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:11.356549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a12619-36c6-4927-bdd6-c3e2e053a82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:11.356823 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a12619-36c6-4927-bdd6-c3e2e053a82f admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:11.357445 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a12619-36c6-4927-bdd6-c3e2e053a82f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:11.359345 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a12619-36c6-4927-bdd6-c3e2e053a82f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:11.385409 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1391/2765] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:29:11 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:29:11.389498 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48d511-afe0-4f48-8a26-f44efc605eba None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:11.400066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48d511-afe0-4f48-8a26-f44efc605eba None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:11.459492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645283e1-3cfc-4e94-9b84-d80b21bc75e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:11.460096 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645283e1-3cfc-4e94-9b84-d80b21bc75e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:11.460371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645283e1-3cfc-4e94-9b84-d80b21bc75e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:11.460643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645283e1-3cfc-4e94-9b84-d80b21bc75e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:11.461277 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645283e1-3cfc-4e94-9b84-d80b21bc75e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:11.463201 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645283e1-3cfc-4e94-9b84-d80b21bc75e7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:11.484961 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1375/2766] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:29:11 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:29:11.488932 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a12619-36c6-4927-bdd6-c3e2e053a82f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:11.499678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a12619-36c6-4927-bdd6-c3e2e053a82f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:11.504278 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3797dda-135d-4f0c-ac74-add943398966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:11.504901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3797dda-135d-4f0c-ac74-add943398966 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:11.505181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3797dda-135d-4f0c-ac74-add943398966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:11.505458 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3797dda-135d-4f0c-ac74-add943398966 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:11.506098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3797dda-135d-4f0c-ac74-add943398966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:11.507800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3797dda-135d-4f0c-ac74-add943398966 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:11.519311 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1392/2767] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:11.523187 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645283e1-3cfc-4e94-9b84-d80b21bc75e7 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:11.533883 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645283e1-3cfc-4e94-9b84-d80b21bc75e7 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:11.538516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094b317-e381-42b7-ae17-aeac424191ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:11.539243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094b317-e381-42b7-ae17-aeac424191ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:11.539524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094b317-e381-42b7-ae17-aeac424191ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:11.539796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094b317-e381-42b7-ae17-aeac424191ea admin admin] PATH_INFO: `/v3/projects/19b48d9ca9a348569cf6e20d4fd8d263/users/d9d2642b88994eae91ac1be89beda642/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:11.554972 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094b317-e381-42b7-ae17-aeac424191ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b48d9ca9a348569cf6e20d4fd8d263, user_id=d9d2642b88994eae91ac1be89beda642, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:11.557702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094b317-e381-42b7-ae17-aeac424191ea admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:11.571240 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1376/2768] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:29:11 2022] PUT /identity/v3/projects/19b48d9ca9a348569cf6e20d4fd8d263/users/d9d2642b88994eae91ac1be89beda642/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:11.575225 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3797dda-135d-4f0c-ac74-add943398966 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:11.584964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3797dda-135d-4f0c-ac74-add943398966 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:11.626376 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:11.642127 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3ef56-febb-4289-a8dd-0f3cf3baac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:11.642734 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3ef56-febb-4289-a8dd-0f3cf3baac3b admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:11.643018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3ef56-febb-4289-a8dd-0f3cf3baac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:11.643340 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3ef56-febb-4289-a8dd-0f3cf3baac3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:11.643973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3ef56-febb-4289-a8dd-0f3cf3baac3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:11.645557 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3ef56-febb-4289-a8dd-0f3cf3baac3b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:11.655777 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1393/2769] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:11.659945 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094b317-e381-42b7-ae17-aeac424191ea admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:11.671316 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094b317-e381-42b7-ae17-aeac424191ea admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:11.676003 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee73e85-c725-404e-9ccc-4394e58964b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:11.676719 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee73e85-c725-404e-9ccc-4394e58964b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:11.676979 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee73e85-c725-404e-9ccc-4394e58964b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:11.677252 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee73e85-c725-404e-9ccc-4394e58964b1 admin admin] PATH_INFO: `/v3/projects/19b48d9ca9a348569cf6e20d4fd8d263/users/d9d2642b88994eae91ac1be89beda642/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:11.679164 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee73e85-c725-404e-9ccc-4394e58964b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b48d9ca9a348569cf6e20d4fd8d263, user_id=d9d2642b88994eae91ac1be89beda642, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:11.681763 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee73e85-c725-404e-9ccc-4394e58964b1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:11.692077 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1377/2770] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:29:11 2022] PUT /identity/v3/projects/19b48d9ca9a348569cf6e20d4fd8d263/users/d9d2642b88994eae91ac1be89beda642/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:11.757215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47173a1e-4a32-4819-b61b-4d9b5e36ba40 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:11.757504 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47173a1e-4a32-4819-b61b-4d9b5e36ba40 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:11.757783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47173a1e-4a32-4819-b61b-4d9b5e36ba40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:11.788045 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-47173a1e-4a32-4819-b61b-4d9b5e36ba40 None None] MFA Rules not processed for user `d9d2642b88994eae91ac1be89beda642`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:11.789314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-47173a1e-4a32-4819-b61b-4d9b5e36ba40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:11.856089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1394/2771] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:11.867277 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee73e85-c725-404e-9ccc-4394e58964b1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:11.869226 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8ee73e85-c725-404e-9ccc-4394e58964b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:11.928195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee73e85-c725-404e-9ccc-4394e58964b1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:11.931922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d518e-99b6-4fa3-80f5-7da24b62021c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:11.932624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d518e-99b6-4fa3-80f5-7da24b62021c service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:11.932930 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d518e-99b6-4fa3-80f5-7da24b62021c service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:11.933206 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d518e-99b6-4fa3-80f5-7da24b62021c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:11.942142 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d518e-99b6-4fa3-80f5-7da24b62021c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:11.943607 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d518e-99b6-4fa3-80f5-7da24b62021c service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:11.953378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1378/2772] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:29:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:29:11.994989 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47173a1e-4a32-4819-b61b-4d9b5e36ba40 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:11.996519 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-47173a1e-4a32-4819-b61b-4d9b5e36ba40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:12.008329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47173a1e-4a32-4819-b61b-4d9b5e36ba40 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:12.013402 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb4ea2-3074-40eb-baaa-1093ddc905f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:12.014058 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb4ea2-3074-40eb-baaa-1093ddc905f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:12.014343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb4ea2-3074-40eb-baaa-1093ddc905f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:12.014622 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb4ea2-3074-40eb-baaa-1093ddc905f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:12.072814 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb4ea2-3074-40eb-baaa-1093ddc905f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:12.075027 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb4ea2-3074-40eb-baaa-1093ddc905f2 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:12.083890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1395/2773] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:29:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:29:14.968134 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d518e-99b6-4fa3-80f5-7da24b62021c service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:15.001246 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:15.030352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d518e-99b6-4fa3-80f5-7da24b62021c service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:15.034799 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e7200-113e-4d26-8f6a-9c47268b2898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:15.035444 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e7200-113e-4d26-8f6a-9c47268b2898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:15.035721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e7200-113e-4d26-8f6a-9c47268b2898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:15.035992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e7200-113e-4d26-8f6a-9c47268b2898 admin admin] PATH_INFO: `/v3/users/8a35dfba548548419a92a84369045268` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:15.037091 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e7200-113e-4d26-8f6a-9c47268b2898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a35dfba548548419a92a84369045268)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:15.038989 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e7200-113e-4d26-8f6a-9c47268b2898 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:15.086245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6f9e7200-113e-4d26-8f6a-9c47268b2898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a35dfba548548419a92a84369045268'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:15.086894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6f9e7200-113e-4d26-8f6a-9c47268b2898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a35dfba548548419a92a84369045268'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:15.094752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6f9e7200-113e-4d26-8f6a-9c47268b2898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a35dfba548548419a92a84369045268'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:15.106829 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6f9e7200-113e-4d26-8f6a-9c47268b2898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a35dfba548548419a92a84369045268'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:15.107475 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6f9e7200-113e-4d26-8f6a-9c47268b2898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a35dfba548548419a92a84369045268'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:15.120064 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1379/2774] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:29:14 2022] DELETE /identity/v3/users/8a35dfba548548419a92a84369045268 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:29:15.124770 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15c9eb-cca0-4c5e-afbb-d1fc09b117e8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:15.125241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15c9eb-cca0-4c5e-afbb-d1fc09b117e8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:15.125363 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15c9eb-cca0-4c5e-afbb-d1fc09b117e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:15.145023 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ec15c9eb-cca0-4c5e-afbb-d1fc09b117e8 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:15.146155 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ec15c9eb-cca0-4c5e-afbb-d1fc09b117e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:15.208786 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1396/2775] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:15.218752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e7200-113e-4d26-8f6a-9c47268b2898 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:15.220186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6f9e7200-113e-4d26-8f6a-9c47268b2898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:15.277203 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e7200-113e-4d26-8f6a-9c47268b2898 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:15.280825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84294c02-1a16-4513-8563-e18c9c9f37b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:15.281415 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84294c02-1a16-4513-8563-e18c9c9f37b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:15.281689 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84294c02-1a16-4513-8563-e18c9c9f37b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:15.281958 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84294c02-1a16-4513-8563-e18c9c9f37b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:15.290674 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84294c02-1a16-4513-8563-e18c9c9f37b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:15.292463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84294c02-1a16-4513-8563-e18c9c9f37b5 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:15.301598 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1380/2776] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:29:15.580929 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15c9eb-cca0-4c5e-afbb-d1fc09b117e8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:15.582524 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ec15c9eb-cca0-4c5e-afbb-d1fc09b117e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:15.591793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:15.599121 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15c9eb-cca0-4c5e-afbb-d1fc09b117e8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:15.602317 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c8994-d0db-4f93-afed-84b0a8d7b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:15.603034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c8994-d0db-4f93-afed-84b0a8d7b9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:15.603420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c8994-d0db-4f93-afed-84b0a8d7b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:15.603769 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c8994-d0db-4f93-afed-84b0a8d7b9bb admin admin] PATH_INFO: `/v3/projects/40bb4b2db10b475f967ff75cd3f75455` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:15.605718 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c8994-d0db-4f93-afed-84b0a8d7b9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=40bb4b2db10b475f967ff75cd3f75455)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:15.607729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c8994-d0db-4f93-afed-84b0a8d7b9bb admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:15.661480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-765c8994-d0db-4f93-afed-84b0a8d7b9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40bb4b2db10b475f967ff75cd3f75455', 'request_id': 'req-765c8994-d0db-4f93-afed-84b0a8d7b9bb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:15.669433 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-765c8994-d0db-4f93-afed-84b0a8d7b9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40bb4b2db10b475f967ff75cd3f75455', 'request_id': 'req-765c8994-d0db-4f93-afed-84b0a8d7b9bb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:15.675874 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-765c8994-d0db-4f93-afed-84b0a8d7b9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40bb4b2db10b475f967ff75cd3f75455', 'request_id': 'req-765c8994-d0db-4f93-afed-84b0a8d7b9bb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:15.687558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-765c8994-d0db-4f93-afed-84b0a8d7b9bb admin admin] The token cache is being invalidate because project 40bb4b2db10b475f967ff75cd3f75455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:29:15.687852 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-765c8994-d0db-4f93-afed-84b0a8d7b9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:15.688503 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-765c8994-d0db-4f93-afed-84b0a8d7b9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:15.689972 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1397/2777] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:29:15 2022] DELETE /identity/v3/projects/40bb4b2db10b475f967ff75cd3f75455 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:15.693948 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84294c02-1a16-4513-8563-e18c9c9f37b5 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:15.704092 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84294c02-1a16-4513-8563-e18c9c9f37b5 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:15.755750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:15.765673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452bb21-be86-418c-9e1d-d654181491b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:15.766422 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452bb21-be86-418c-9e1d-d654181491b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:15.766975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452bb21-be86-418c-9e1d-d654181491b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:15.767552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452bb21-be86-418c-9e1d-d654181491b4 admin admin] PATH_INFO: `/v3/users/2cea771118c14cc291e3b7f31f203773` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:15.769093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452bb21-be86-418c-9e1d-d654181491b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cea771118c14cc291e3b7f31f203773)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:15.772496 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452bb21-be86-418c-9e1d-d654181491b4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:15.818605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2452bb21-be86-418c-9e1d-d654181491b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cea771118c14cc291e3b7f31f203773'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:15.819280 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2452bb21-be86-418c-9e1d-d654181491b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cea771118c14cc291e3b7f31f203773'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:15.826307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2452bb21-be86-418c-9e1d-d654181491b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cea771118c14cc291e3b7f31f203773'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:15.838078 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2452bb21-be86-418c-9e1d-d654181491b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cea771118c14cc291e3b7f31f203773'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:15.838711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2452bb21-be86-418c-9e1d-d654181491b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cea771118c14cc291e3b7f31f203773'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:15.851599 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1381/2778] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:29:15 2022] DELETE /identity/v3/users/2cea771118c14cc291e3b7f31f203773 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:16.123395 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c8994-d0db-4f93-afed-84b0a8d7b9bb admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:16.124953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-765c8994-d0db-4f93-afed-84b0a8d7b9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:16.140008 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c8994-d0db-4f93-afed-84b0a8d7b9bb admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:16.200164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b909be7-6ccf-405a-9bda-b6873fe3fd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:16.200724 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b909be7-6ccf-405a-9bda-b6873fe3fd48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:16.201002 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b909be7-6ccf-405a-9bda-b6873fe3fd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:16.201276 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b909be7-6ccf-405a-9bda-b6873fe3fd48 admin admin] PATH_INFO: `/v3/projects/e6f732d169a441ac83ab80ac96cc78d8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:16.202391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b909be7-6ccf-405a-9bda-b6873fe3fd48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f732d169a441ac83ab80ac96cc78d8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:16.204320 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b909be7-6ccf-405a-9bda-b6873fe3fd48 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:16.251240 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0b909be7-6ccf-405a-9bda-b6873fe3fd48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f732d169a441ac83ab80ac96cc78d8', 'request_id': 'req-0b909be7-6ccf-405a-9bda-b6873fe3fd48'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:16.258431 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0b909be7-6ccf-405a-9bda-b6873fe3fd48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f732d169a441ac83ab80ac96cc78d8', 'request_id': 'req-0b909be7-6ccf-405a-9bda-b6873fe3fd48'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:16.265593 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0b909be7-6ccf-405a-9bda-b6873fe3fd48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f732d169a441ac83ab80ac96cc78d8', 'request_id': 'req-0b909be7-6ccf-405a-9bda-b6873fe3fd48'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:16.277030 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0b909be7-6ccf-405a-9bda-b6873fe3fd48 admin admin] The token cache is being invalidate because project e6f732d169a441ac83ab80ac96cc78d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:29:16.277329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0b909be7-6ccf-405a-9bda-b6873fe3fd48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:16.277975 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0b909be7-6ccf-405a-9bda-b6873fe3fd48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:16.279504 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1398/2779] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:29:16 2022] DELETE /identity/v3/projects/e6f732d169a441ac83ab80ac96cc78d8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:16.283560 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452bb21-be86-418c-9e1d-d654181491b4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:16.285016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2452bb21-be86-418c-9e1d-d654181491b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:16.297817 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452bb21-be86-418c-9e1d-d654181491b4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:16.353928 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1861f1b-91af-4de3-adea-ebafba7a3337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:16.354599 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861f1b-91af-4de3-adea-ebafba7a3337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:16.354880 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861f1b-91af-4de3-adea-ebafba7a3337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:16.355185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861f1b-91af-4de3-adea-ebafba7a3337 admin admin] PATH_INFO: `/v3/users/d9d2642b88994eae91ac1be89beda642` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:16.356331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1861f1b-91af-4de3-adea-ebafba7a3337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d2642b88994eae91ac1be89beda642)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:16.358239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1861f1b-91af-4de3-adea-ebafba7a3337 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:16.404611 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f1861f1b-91af-4de3-adea-ebafba7a3337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d2642b88994eae91ac1be89beda642'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:16.405261 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f1861f1b-91af-4de3-adea-ebafba7a3337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d2642b88994eae91ac1be89beda642'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:16.412222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f1861f1b-91af-4de3-adea-ebafba7a3337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d2642b88994eae91ac1be89beda642'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:16.424599 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f1861f1b-91af-4de3-adea-ebafba7a3337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d2642b88994eae91ac1be89beda642'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:16.425293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f1861f1b-91af-4de3-adea-ebafba7a3337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d2642b88994eae91ac1be89beda642'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:16.427845 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:16.440457 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1382/2780] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:29:16 2022] DELETE /identity/v3/users/d9d2642b88994eae91ac1be89beda642 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:16.710569 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b909be7-6ccf-405a-9bda-b6873fe3fd48 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:16.711998 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0b909be7-6ccf-405a-9bda-b6873fe3fd48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:16.725466 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b909be7-6ccf-405a-9bda-b6873fe3fd48 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:16.739578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:16.786869 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb35bb-9855-4d7f-abe0-d32351d1c7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:16.787516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb35bb-9855-4d7f-abe0-d32351d1c7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:16.787797 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb35bb-9855-4d7f-abe0-d32351d1c7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:16.788067 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb35bb-9855-4d7f-abe0-d32351d1c7aa admin admin] PATH_INFO: `/v3/projects/19b48d9ca9a348569cf6e20d4fd8d263` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:16.789164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb35bb-9855-4d7f-abe0-d32351d1c7aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b48d9ca9a348569cf6e20d4fd8d263)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:16.791049 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb35bb-9855-4d7f-abe0-d32351d1c7aa admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:16.836530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3fbb35bb-9855-4d7f-abe0-d32351d1c7aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b48d9ca9a348569cf6e20d4fd8d263', 'request_id': 'req-3fbb35bb-9855-4d7f-abe0-d32351d1c7aa'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:16.843781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3fbb35bb-9855-4d7f-abe0-d32351d1c7aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b48d9ca9a348569cf6e20d4fd8d263', 'request_id': 'req-3fbb35bb-9855-4d7f-abe0-d32351d1c7aa'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:16.849911 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3fbb35bb-9855-4d7f-abe0-d32351d1c7aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b48d9ca9a348569cf6e20d4fd8d263', 'request_id': 'req-3fbb35bb-9855-4d7f-abe0-d32351d1c7aa'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:16.860278 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3fbb35bb-9855-4d7f-abe0-d32351d1c7aa admin admin] The token cache is being invalidate because project 19b48d9ca9a348569cf6e20d4fd8d263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:29:16.860570 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3fbb35bb-9855-4d7f-abe0-d32351d1c7aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:16.861210 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3fbb35bb-9855-4d7f-abe0-d32351d1c7aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:16.862683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1399/2781] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:29:16 2022] DELETE /identity/v3/projects/19b48d9ca9a348569cf6e20d4fd8d263 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:16.868814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f746bbd-b5c8-4ff5-ad5e-497653795480 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:16.869098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f746bbd-b5c8-4ff5-ad5e-497653795480 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:16.869371 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f746bbd-b5c8-4ff5-ad5e-497653795480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:16.889791 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1f746bbd-b5c8-4ff5-ad5e-497653795480 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:16.890997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1f746bbd-b5c8-4ff5-ad5e-497653795480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:16.951886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1383/2782] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:16.960347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7023b23-a2a9-4d67-ba7b-2e93991e122f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:16.960685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7023b23-a2a9-4d67-ba7b-2e93991e122f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:16.960928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7023b23-a2a9-4d67-ba7b-2e93991e122f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:16.981495 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f7023b23-a2a9-4d67-ba7b-2e93991e122f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:16.982706 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f7023b23-a2a9-4d67-ba7b-2e93991e122f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:16.990495 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1400/2783] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:16.995425 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f746bbd-b5c8-4ff5-ad5e-497653795480 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:17.005271 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f746bbd-b5c8-4ff5-ad5e-497653795480 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:17.009862 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecdf53-2426-43f8-b7f1-08b936b1f541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:17.011120 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecdf53-2426-43f8-b7f1-08b936b1f541 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:17.011406 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecdf53-2426-43f8-b7f1-08b936b1f541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:17.011682 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecdf53-2426-43f8-b7f1-08b936b1f541 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:17.012326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecdf53-2426-43f8-b7f1-08b936b1f541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:29:17.012631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecdf53-2426-43f8-b7f1-08b936b1f541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:17.014341 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecdf53-2426-43f8-b7f1-08b936b1f541 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:17.025802 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1384/2784] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:29:17.030349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7023b23-a2a9-4d67-ba7b-2e93991e122f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:17.039441 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7023b23-a2a9-4d67-ba7b-2e93991e122f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:17.044666 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e9ecd-5a4c-4bee-a266-fa9914761a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:17.045257 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e9ecd-5a4c-4bee-a266-fa9914761a4c admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:17.045537 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e9ecd-5a4c-4bee-a266-fa9914761a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:17.045808 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e9ecd-5a4c-4bee-a266-fa9914761a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:17.046440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e9ecd-5a4c-4bee-a266-fa9914761a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:17.048356 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e9ecd-5a4c-4bee-a266-fa9914761a4c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:17.074940 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1401/2785] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:29:17 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:29:17.079128 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecdf53-2426-43f8-b7f1-08b936b1f541 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:17.089181 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecdf53-2426-43f8-b7f1-08b936b1f541 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:17.145144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee7d4e-5d1e-4f73-9460-696634387d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:17.145774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee7d4e-5d1e-4f73-9460-696634387d36 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:17.146056 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee7d4e-5d1e-4f73-9460-696634387d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:17.146334 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee7d4e-5d1e-4f73-9460-696634387d36 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:17.146970 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee7d4e-5d1e-4f73-9460-696634387d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:17.148919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee7d4e-5d1e-4f73-9460-696634387d36 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:17.170263 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1385/2786] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:29:17 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:29:17.174368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e9ecd-5a4c-4bee-a266-fa9914761a4c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:17.185292 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e9ecd-5a4c-4bee-a266-fa9914761a4c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:17.190406 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57e1e2-dbda-4636-8f49-37a6261588fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:17.191006 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e1e2-dbda-4636-8f49-37a6261588fa admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:17.191422 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e1e2-dbda-4636-8f49-37a6261588fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:17.191701 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e1e2-dbda-4636-8f49-37a6261588fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:17.192341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57e1e2-dbda-4636-8f49-37a6261588fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:17.193919 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57e1e2-dbda-4636-8f49-37a6261588fa admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:17.204488 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1402/2787] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:17.208405 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee7d4e-5d1e-4f73-9460-696634387d36 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:17.218556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee7d4e-5d1e-4f73-9460-696634387d36 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:17.222980 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9e6f0-13bf-4a47-93b0-b85af4351b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:17.223596 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9e6f0-13bf-4a47-93b0-b85af4351b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:17.223873 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9e6f0-13bf-4a47-93b0-b85af4351b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:17.224141 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9e6f0-13bf-4a47-93b0-b85af4351b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:17.224769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9e6f0-13bf-4a47-93b0-b85af4351b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:17.226340 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9e6f0-13bf-4a47-93b0-b85af4351b9a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:17.238227 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1386/2788] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:17.242197 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57e1e2-dbda-4636-8f49-37a6261588fa admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:17.253076 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57e1e2-dbda-4636-8f49-37a6261588fa admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:17.257621 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00a6a0-f189-416a-9b7d-05d252deaef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:17.258259 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00a6a0-f189-416a-9b7d-05d252deaef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:17.258539 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00a6a0-f189-416a-9b7d-05d252deaef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:17.258810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00a6a0-f189-416a-9b7d-05d252deaef0 admin admin] PATH_INFO: `/v3/projects/a79b692d6d2e4ddbaf58caafc23a6329/users/dfca10fd9aeb4183bae4b0c51a249a7a/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:17.273205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00a6a0-f189-416a-9b7d-05d252deaef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79b692d6d2e4ddbaf58caafc23a6329, user_id=dfca10fd9aeb4183bae4b0c51a249a7a, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:17.275811 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00a6a0-f189-416a-9b7d-05d252deaef0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:17.288849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1403/2789] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:29:17 2022] PUT /identity/v3/projects/a79b692d6d2e4ddbaf58caafc23a6329/users/dfca10fd9aeb4183bae4b0c51a249a7a/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:17.300664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42a74f-4fbb-400b-a2f1-fd62c2a3051d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:17.301179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42a74f-4fbb-400b-a2f1-fd62c2a3051d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:17.301281 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42a74f-4fbb-400b-a2f1-fd62c2a3051d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:17.330234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-af42a74f-4fbb-400b-a2f1-fd62c2a3051d None None] MFA Rules not processed for user `dfca10fd9aeb4183bae4b0c51a249a7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:17.331466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-af42a74f-4fbb-400b-a2f1-fd62c2a3051d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:17.377752 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:17.396817 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1387/2790] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:17.402005 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00a6a0-f189-416a-9b7d-05d252deaef0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:17.450916 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:17.466844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00a6a0-f189-416a-9b7d-05d252deaef0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:17.471581 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9538224-6f0f-41ae-8179-f6a81a7337fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:17.472130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9538224-6f0f-41ae-8179-f6a81a7337fa admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:17.472412 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9538224-6f0f-41ae-8179-f6a81a7337fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:17.472685 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9538224-6f0f-41ae-8179-f6a81a7337fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:17.473314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9538224-6f0f-41ae-8179-f6a81a7337fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:17.475268 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9538224-6f0f-41ae-8179-f6a81a7337fa admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:17.501803 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1404/2791] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:29:17 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:29:17.505805 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42a74f-4fbb-400b-a2f1-fd62c2a3051d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:17.516545 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42a74f-4fbb-400b-a2f1-fd62c2a3051d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:17.573227 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bba8b1-c00e-4198-9c7e-a470347f6ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:17.573836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bba8b1-c00e-4198-9c7e-a470347f6ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:17.574114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bba8b1-c00e-4198-9c7e-a470347f6ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:17.574389 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bba8b1-c00e-4198-9c7e-a470347f6ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:17.575027 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bba8b1-c00e-4198-9c7e-a470347f6ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:17.576980 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bba8b1-c00e-4198-9c7e-a470347f6ea8 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:17.602981 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1388/2792] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:29:17 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:29:17.607591 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9538224-6f0f-41ae-8179-f6a81a7337fa admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:17.617834 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9538224-6f0f-41ae-8179-f6a81a7337fa admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:17.622972 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d189c-c13b-48eb-b601-0f4771ad05ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:17.623599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d189c-c13b-48eb-b601-0f4771ad05ea admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:17.623881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d189c-c13b-48eb-b601-0f4771ad05ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:17.624156 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d189c-c13b-48eb-b601-0f4771ad05ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:17.624793 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d189c-c13b-48eb-b601-0f4771ad05ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:17.626381 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d189c-c13b-48eb-b601-0f4771ad05ea admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:17.636989 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1405/2793] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:17.641135 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bba8b1-c00e-4198-9c7e-a470347f6ea8 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:17.652183 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bba8b1-c00e-4198-9c7e-a470347f6ea8 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:17.656966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9a220-492c-4579-af59-7813f27dd6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:17.657629 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9a220-492c-4579-af59-7813f27dd6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:17.657913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9a220-492c-4579-af59-7813f27dd6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:17.658190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9a220-492c-4579-af59-7813f27dd6fc admin admin] PATH_INFO: `/v3/projects/3da15a2c279548c89e315221cc3deb02/users/c9e37e1866b34681b951854bdf2144fb/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:17.673844 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9a220-492c-4579-af59-7813f27dd6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da15a2c279548c89e315221cc3deb02, user_id=c9e37e1866b34681b951854bdf2144fb, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:17.676623 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9a220-492c-4579-af59-7813f27dd6fc admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:17.688997 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1389/2794] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:29:17 2022] PUT /identity/v3/projects/3da15a2c279548c89e315221cc3deb02/users/c9e37e1866b34681b951854bdf2144fb/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:17.692910 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d189c-c13b-48eb-b601-0f4771ad05ea admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:17.702713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d189c-c13b-48eb-b601-0f4771ad05ea admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:17.758341 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0f42e-806b-4b7c-b325-0f447f6543ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:17.758864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0f42e-806b-4b7c-b325-0f447f6543ef admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:17.759187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0f42e-806b-4b7c-b325-0f447f6543ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:17.759459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0f42e-806b-4b7c-b325-0f447f6543ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:17.760088 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0f42e-806b-4b7c-b325-0f447f6543ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:17.762217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0f42e-806b-4b7c-b325-0f447f6543ef admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:17.771654 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1406/2795] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:29:17.775954 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9a220-492c-4579-af59-7813f27dd6fc admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:17.789114 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9a220-492c-4579-af59-7813f27dd6fc admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:17.793839 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb5d4f-30c5-4f80-96f7-8a6c8b90c0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:17.794492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb5d4f-30c5-4f80-96f7-8a6c8b90c0b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:17.794773 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb5d4f-30c5-4f80-96f7-8a6c8b90c0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:17.795049 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb5d4f-30c5-4f80-96f7-8a6c8b90c0b1 admin admin] PATH_INFO: `/v3/projects/3da15a2c279548c89e315221cc3deb02/users/c9e37e1866b34681b951854bdf2144fb/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:17.797016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb5d4f-30c5-4f80-96f7-8a6c8b90c0b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da15a2c279548c89e315221cc3deb02, user_id=c9e37e1866b34681b951854bdf2144fb, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:17.799686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb5d4f-30c5-4f80-96f7-8a6c8b90c0b1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:17.810287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1390/2796] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:29:17 2022] PUT /identity/v3/projects/3da15a2c279548c89e315221cc3deb02/users/c9e37e1866b34681b951854bdf2144fb/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:17.821785 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad5c75-03a1-4bd8-9f7c-d662fc97de48 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:17.822071 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad5c75-03a1-4bd8-9f7c-d662fc97de48 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:17.822349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad5c75-03a1-4bd8-9f7c-d662fc97de48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:17.851287 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-24ad5c75-03a1-4bd8-9f7c-d662fc97de48 None None] MFA Rules not processed for user `c9e37e1866b34681b951854bdf2144fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:17.852529 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-24ad5c75-03a1-4bd8-9f7c-d662fc97de48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:17.920467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1407/2797] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:29:17.932217 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb5d4f-30c5-4f80-96f7-8a6c8b90c0b1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:17.934052 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-acfb5d4f-30c5-4f80-96f7-8a6c8b90c0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:17.991270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb5d4f-30c5-4f80-96f7-8a6c8b90c0b1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:17.995011 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf6de4-fc03-427c-a6c8-0aa5fd2e5a81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:17.995715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf6de4-fc03-427c-a6c8-0aa5fd2e5a81 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:17.995996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf6de4-fc03-427c-a6c8-0aa5fd2e5a81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:17.996276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf6de4-fc03-427c-a6c8-0aa5fd2e5a81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:18.005213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf6de4-fc03-427c-a6c8-0aa5fd2e5a81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:18.006634 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf6de4-fc03-427c-a6c8-0aa5fd2e5a81 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:18.016831 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1391/2798] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:29:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:29:18.100124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad5c75-03a1-4bd8-9f7c-d662fc97de48 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:18.110119 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad5c75-03a1-4bd8-9f7c-d662fc97de48 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:18.113652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a45b7-e3ab-469f-8610-95d2c6bb7612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:18.114249 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a45b7-e3ab-469f-8610-95d2c6bb7612 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:18.114531 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a45b7-e3ab-469f-8610-95d2c6bb7612 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:18.114802 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a45b7-e3ab-469f-8610-95d2c6bb7612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:18.155418 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:18.177249 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a45b7-e3ab-469f-8610-95d2c6bb7612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:18.178738 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a45b7-e3ab-469f-8610-95d2c6bb7612 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:18.188587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1408/2799] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:29:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:29:22.885054 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf6de4-fc03-427c-a6c8-0aa5fd2e5a81 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:22.929373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:22.947313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf6de4-fc03-427c-a6c8-0aa5fd2e5a81 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:22.952580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6f87e-fc01-481b-afde-26bd6cb486d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:22.953205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6f87e-fc01-481b-afde-26bd6cb486d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:22.953483 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6f87e-fc01-481b-afde-26bd6cb486d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:22.953754 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6f87e-fc01-481b-afde-26bd6cb486d3 admin admin] PATH_INFO: `/v3/users/dfca10fd9aeb4183bae4b0c51a249a7a` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:22.954851 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6f87e-fc01-481b-afde-26bd6cb486d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfca10fd9aeb4183bae4b0c51a249a7a)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:22.956799 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6f87e-fc01-481b-afde-26bd6cb486d3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:23.002861 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-46f6f87e-fc01-481b-afde-26bd6cb486d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfca10fd9aeb4183bae4b0c51a249a7a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:23.003452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-46f6f87e-fc01-481b-afde-26bd6cb486d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfca10fd9aeb4183bae4b0c51a249a7a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:23.010302 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-46f6f87e-fc01-481b-afde-26bd6cb486d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfca10fd9aeb4183bae4b0c51a249a7a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:23.022139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-46f6f87e-fc01-481b-afde-26bd6cb486d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfca10fd9aeb4183bae4b0c51a249a7a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:23.022774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-46f6f87e-fc01-481b-afde-26bd6cb486d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfca10fd9aeb4183bae4b0c51a249a7a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:23.034939 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1392/2800] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:29:22 2022] DELETE /identity/v3/users/dfca10fd9aeb4183bae4b0c51a249a7a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:23.039399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbde59-0db1-49a6-ada9-a1e58c703142 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:23.039887 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbde59-0db1-49a6-ada9-a1e58c703142 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:23.040001 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbde59-0db1-49a6-ada9-a1e58c703142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:23.059641 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fddbde59-0db1-49a6-ada9-a1e58c703142 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:23.060863 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fddbde59-0db1-49a6-ada9-a1e58c703142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:23.118844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1409/2801] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:23.129197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6f87e-fc01-481b-afde-26bd6cb486d3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:23.130576 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-46f6f87e-fc01-481b-afde-26bd6cb486d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:23.187801 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6f87e-fc01-481b-afde-26bd6cb486d3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:23.191432 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a06fd-f367-483d-9bf5-8e06c2cf6521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:23.192029 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a06fd-f367-483d-9bf5-8e06c2cf6521 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:23.192301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a06fd-f367-483d-9bf5-8e06c2cf6521 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:23.192570 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a06fd-f367-483d-9bf5-8e06c2cf6521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:23.201758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a06fd-f367-483d-9bf5-8e06c2cf6521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:23.203196 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a06fd-f367-483d-9bf5-8e06c2cf6521 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:23.212785 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1393/2802] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:29:23.477885 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbde59-0db1-49a6-ada9-a1e58c703142 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:23.479338 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fddbde59-0db1-49a6-ada9-a1e58c703142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:23.492281 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbde59-0db1-49a6-ada9-a1e58c703142 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:23.497459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:23.498129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:23.498413 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:23.498781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3 admin admin] PATH_INFO: `/v3/projects/a79b692d6d2e4ddbaf58caafc23a6329` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:23.500038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79b692d6d2e4ddbaf58caafc23a6329)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:23.501944 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:23.550355 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79b692d6d2e4ddbaf58caafc23a6329', 'request_id': 'req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:23.557527 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79b692d6d2e4ddbaf58caafc23a6329', 'request_id': 'req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:23.564804 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79b692d6d2e4ddbaf58caafc23a6329', 'request_id': 'req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:23.576661 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3 admin admin] The token cache is being invalidate because project a79b692d6d2e4ddbaf58caafc23a6329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:29:23.576946 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:23.577588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:23.579051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1410/2803] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:29:23 2022] DELETE /identity/v3/projects/a79b692d6d2e4ddbaf58caafc23a6329 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:23.582971 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a06fd-f367-483d-9bf5-8e06c2cf6521 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:23.593700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a06fd-f367-483d-9bf5-8e06c2cf6521 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:23.649234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f38b3-885c-4ad5-a099-eefa42c7d6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:23.649852 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f38b3-885c-4ad5-a099-eefa42c7d6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:23.650129 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f38b3-885c-4ad5-a099-eefa42c7d6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:23.650400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f38b3-885c-4ad5-a099-eefa42c7d6e2 admin admin] PATH_INFO: `/v3/users/c9e37e1866b34681b951854bdf2144fb` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:23.651532 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f38b3-885c-4ad5-a099-eefa42c7d6e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e37e1866b34681b951854bdf2144fb)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:23.653955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f38b3-885c-4ad5-a099-eefa42c7d6e2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:23.659163 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:23.699666 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-635f38b3-885c-4ad5-a099-eefa42c7d6e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e37e1866b34681b951854bdf2144fb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:23.700313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-635f38b3-885c-4ad5-a099-eefa42c7d6e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e37e1866b34681b951854bdf2144fb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:23.707248 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-635f38b3-885c-4ad5-a099-eefa42c7d6e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e37e1866b34681b951854bdf2144fb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:23.720413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-635f38b3-885c-4ad5-a099-eefa42c7d6e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e37e1866b34681b951854bdf2144fb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:23.721060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-635f38b3-885c-4ad5-a099-eefa42c7d6e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e37e1866b34681b951854bdf2144fb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:23.734522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1394/2804] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:29:23 2022] DELETE /identity/v3/users/c9e37e1866b34681b951854bdf2144fb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:24.008679 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:24.010118 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:24.027842 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53d3c-63e5-4b2f-a8ca-5be5f415cfc3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:24.085782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:24.086480 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:24.086642 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:24.086867 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5 admin admin] PATH_INFO: `/v3/projects/3da15a2c279548c89e315221cc3deb02` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:24.088021 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da15a2c279548c89e315221cc3deb02)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:24.090799 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:24.093073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:24.139329 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da15a2c279548c89e315221cc3deb02', 'request_id': 'req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:24.146227 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da15a2c279548c89e315221cc3deb02', 'request_id': 'req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:24.153186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da15a2c279548c89e315221cc3deb02', 'request_id': 'req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:24.163599 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5 admin admin] The token cache is being invalidate because project 3da15a2c279548c89e315221cc3deb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:29:24.163885 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:24.164516 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:24.166181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1411/2805] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:29:24 2022] DELETE /identity/v3/projects/3da15a2c279548c89e315221cc3deb02 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:33.730216 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:34.160391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=23,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:35.102685 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f38b3-885c-4ad5-a099-eefa42c7d6e2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:35.104120 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-635f38b3-885c-4ad5-a099-eefa42c7d6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:35.159494 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f38b3-885c-4ad5-a099-eefa42c7d6e2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:35.207862 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169c3dd-b979-4682-8591-03b9144baed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:35.208457 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169c3dd-b979-4682-8591-03b9144baed2 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:35.208730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169c3dd-b979-4682-8591-03b9144baed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:35.208999 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169c3dd-b979-4682-8591-03b9144baed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:35.210691 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5169c3dd-b979-4682-8591-03b9144baed2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:35.277988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169c3dd-b979-4682-8591-03b9144baed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:35.279512 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169c3dd-b979-4682-8591-03b9144baed2 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:35.290098 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1395/2806] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:29:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:29:38.467493 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:38.469544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:38.486031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f9ceb-4231-47cc-afd9-90b7484f9ec5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:38.492272 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b572ee9-1ebd-4fc6-9bbf-62b1a6c8bce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:38.493093 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b572ee9-1ebd-4fc6-9bbf-62b1a6c8bce8 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:38.493550 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b572ee9-1ebd-4fc6-9bbf-62b1a6c8bce8 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:38.494001 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b572ee9-1ebd-4fc6-9bbf-62b1a6c8bce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:38.495839 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3b572ee9-1ebd-4fc6-9bbf-62b1a6c8bce8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:38.509215 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b572ee9-1ebd-4fc6-9bbf-62b1a6c8bce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:38.510809 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b572ee9-1ebd-4fc6-9bbf-62b1a6c8bce8 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:38.527254 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1412/2807] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:29:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:29:38.624605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169c3dd-b979-4682-8591-03b9144baed2 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:38.626891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5169c3dd-b979-4682-8591-03b9144baed2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:38.699257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169c3dd-b979-4682-8591-03b9144baed2 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:38.704160 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdc201-314f-46c6-8732-d19aaa7d636d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:38.704869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdc201-314f-46c6-8732-d19aaa7d636d service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:38.705245 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdc201-314f-46c6-8732-d19aaa7d636d service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:38.705612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdc201-314f-46c6-8732-d19aaa7d636d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:38.707853 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-35cdc201-314f-46c6-8732-d19aaa7d636d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:38.723837 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdc201-314f-46c6-8732-d19aaa7d636d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:38.725635 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdc201-314f-46c6-8732-d19aaa7d636d service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:38.732517 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:38.739443 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1396/2808] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:29:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:29:39.445814 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a6202-0eb4-4253-af2f-18fccda57c70 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:39.446106 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a6202-0eb4-4253-af2f-18fccda57c70 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:39.446385 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a6202-0eb4-4253-af2f-18fccda57c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:39.468411 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0e0a6202-0eb4-4253-af2f-18fccda57c70 None None] MFA Rules not processed for user `0dae2a1dae1947f2be48c65fb9c503ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:39.469652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0e0a6202-0eb4-4253-af2f-18fccda57c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:39.527561 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1413/2809] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:29:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:40.008965 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdc201-314f-46c6-8732-d19aaa7d636d service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:40.010344 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-35cdc201-314f-46c6-8732-d19aaa7d636d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:40.022904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdc201-314f-46c6-8732-d19aaa7d636d service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:40.028107 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d46ebb-600d-436e-8363-5e75663e22fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:40.029902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d46ebb-600d-436e-8363-5e75663e22fc service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:40.030451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d46ebb-600d-436e-8363-5e75663e22fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:40.030933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d46ebb-600d-436e-8363-5e75663e22fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:40.032975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-60d46ebb-600d-436e-8363-5e75663e22fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:40.052241 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d46ebb-600d-436e-8363-5e75663e22fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:40.053723 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d46ebb-600d-436e-8363-5e75663e22fc service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:40.067853 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1397/2810] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:29:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:29:48.934869 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a6150-44c0-4eb3-bb97-04613b4982ad None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:48.935450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a6150-44c0-4eb3-bb97-04613b4982ad None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:48.936059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a6150-44c0-4eb3-bb97-04613b4982ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:48.988584 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-428a6150-44c0-4eb3-bb97-04613b4982ad None None] MFA Rules not processed for user `da83fb76a0b04aa2bdb91f6c25dc6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:29:48.989789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-428a6150-44c0-4eb3-bb97-04613b4982ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:49.053768 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1414/2811] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 13 01:29:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:29:49.103781 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d46ebb-600d-436e-8363-5e75663e22fc service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:49.105186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-60d46ebb-600d-436e-8363-5e75663e22fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:49.197501 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d46ebb-600d-436e-8363-5e75663e22fc service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:49.204426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9caa1-533f-405f-a2d8-40085f3b90dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2414e53593b4e2084c895651fd0d0e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:49.205038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9caa1-533f-405f-a2d8-40085f3b90dc service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:49.205321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9caa1-533f-405f-a2d8-40085f3b90dc service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:49.205603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9caa1-533f-405f-a2d8-40085f3b90dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:49.214144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9caa1-533f-405f-a2d8-40085f3b90dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:49.216836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9caa1-533f-405f-a2d8-40085f3b90dc service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:49.225478 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1398/2812] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 13 01:29:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 01:29:56.863499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a6150-44c0-4eb3-bb97-04613b4982ad None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:56.865015 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-428a6150-44c0-4eb3-bb97-04613b4982ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:56.934340 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a6150-44c0-4eb3-bb97-04613b4982ad None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:56.939263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616f907-b088-494d-9674-fa0998c040d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:56.939905 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616f907-b088-494d-9674-fa0998c040d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:56.940188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616f907-b088-494d-9674-fa0998c040d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:56.940523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616f907-b088-494d-9674-fa0998c040d6 admin admin] PATH_INFO: `/v3/users/03f85d2218824876a423a85a837e44a9` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:56.941695 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616f907-b088-494d-9674-fa0998c040d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f85d2218824876a423a85a837e44a9)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:56.943680 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616f907-b088-494d-9674-fa0998c040d6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:56.948314 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:56.989840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c616f907-b088-494d-9674-fa0998c040d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f85d2218824876a423a85a837e44a9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:56.990416 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c616f907-b088-494d-9674-fa0998c040d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f85d2218824876a423a85a837e44a9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:56.997410 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c616f907-b088-494d-9674-fa0998c040d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f85d2218824876a423a85a837e44a9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.009231 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c616f907-b088-494d-9674-fa0998c040d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f85d2218824876a423a85a837e44a9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.009880 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c616f907-b088-494d-9674-fa0998c040d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f85d2218824876a423a85a837e44a9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.022377 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1415/2813] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:29:56 2022] DELETE /identity/v3/users/03f85d2218824876a423a85a837e44a9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:57.200214 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9caa1-533f-405f-a2d8-40085f3b90dc service swift] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:57.214300 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9caa1-533f-405f-a2d8-40085f3b90dc service swift] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:57.273649 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca235876-858c-411c-baa8-95b940875b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:57.274278 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca235876-858c-411c-baa8-95b940875b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:57.274557 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca235876-858c-411c-baa8-95b940875b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:57.274831 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca235876-858c-411c-baa8-95b940875b42 admin admin] PATH_INFO: `/v3/projects/95810dc0be054d44b5b0deea9e3a0a8a` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:57.275969 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca235876-858c-411c-baa8-95b940875b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95810dc0be054d44b5b0deea9e3a0a8a)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:57.277932 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca235876-858c-411c-baa8-95b940875b42 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:57.323797 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ca235876-858c-411c-baa8-95b940875b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95810dc0be054d44b5b0deea9e3a0a8a', 'request_id': 'req-ca235876-858c-411c-baa8-95b940875b42'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.330433 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ca235876-858c-411c-baa8-95b940875b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95810dc0be054d44b5b0deea9e3a0a8a', 'request_id': 'req-ca235876-858c-411c-baa8-95b940875b42'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.334390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:57.336615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ca235876-858c-411c-baa8-95b940875b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95810dc0be054d44b5b0deea9e3a0a8a', 'request_id': 'req-ca235876-858c-411c-baa8-95b940875b42'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.349126 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ca235876-858c-411c-baa8-95b940875b42 admin admin] The token cache is being invalidate because project 95810dc0be054d44b5b0deea9e3a0a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:29:57.349414 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ca235876-858c-411c-baa8-95b940875b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.350029 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ca235876-858c-411c-baa8-95b940875b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.351547 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1399/2814] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:29:57 2022] DELETE /identity/v3/projects/95810dc0be054d44b5b0deea9e3a0a8a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:57.355546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616f907-b088-494d-9674-fa0998c040d6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:57.357010 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c616f907-b088-494d-9674-fa0998c040d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:57.369748 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616f907-b088-494d-9674-fa0998c040d6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:57.425727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426f85f-bd43-4367-959c-64ba40c622a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:57.426361 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426f85f-bd43-4367-959c-64ba40c622a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:57.426639 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426f85f-bd43-4367-959c-64ba40c622a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:57.426908 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426f85f-bd43-4367-959c-64ba40c622a2 admin admin] PATH_INFO: `/v3/users/a8cb6958b83f418d8f1023ce8cd7fc3a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:57.428066 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426f85f-bd43-4367-959c-64ba40c622a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8cb6958b83f418d8f1023ce8cd7fc3a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:57.429957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426f85f-bd43-4367-959c-64ba40c622a2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:57.477144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0426f85f-bd43-4367-959c-64ba40c622a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8cb6958b83f418d8f1023ce8cd7fc3a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.477870 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0426f85f-bd43-4367-959c-64ba40c622a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8cb6958b83f418d8f1023ce8cd7fc3a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.487164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0426f85f-bd43-4367-959c-64ba40c622a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8cb6958b83f418d8f1023ce8cd7fc3a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.504255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0426f85f-bd43-4367-959c-64ba40c622a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8cb6958b83f418d8f1023ce8cd7fc3a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.505009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0426f85f-bd43-4367-959c-64ba40c622a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8cb6958b83f418d8f1023ce8cd7fc3a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.518459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1416/2815] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:29:57 2022] DELETE /identity/v3/users/a8cb6958b83f418d8f1023ce8cd7fc3a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:29:57.693328 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca235876-858c-411c-baa8-95b940875b42 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:29:57.694926 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ca235876-858c-411c-baa8-95b940875b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:29:57.708664 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca235876-858c-411c-baa8-95b940875b42 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:29:57.765820 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68788f-c524-433a-a290-d39ffbc786c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:29:57.766447 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68788f-c524-433a-a290-d39ffbc786c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:29:57.766723 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68788f-c524-433a-a290-d39ffbc786c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:29:57.766996 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68788f-c524-433a-a290-d39ffbc786c3 admin admin] PATH_INFO: `/v3/projects/c0c024e5e9904153831866d60e12aa54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:29:57.768126 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68788f-c524-433a-a290-d39ffbc786c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0c024e5e9904153831866d60e12aa54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:29:57.770021 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68788f-c524-433a-a290-d39ffbc786c3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:29:57.815705 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2b68788f-c524-433a-a290-d39ffbc786c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0c024e5e9904153831866d60e12aa54', 'request_id': 'req-2b68788f-c524-433a-a290-d39ffbc786c3'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.821582 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2b68788f-c524-433a-a290-d39ffbc786c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0c024e5e9904153831866d60e12aa54', 'request_id': 'req-2b68788f-c524-433a-a290-d39ffbc786c3'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.827355 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2b68788f-c524-433a-a290-d39ffbc786c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0c024e5e9904153831866d60e12aa54', 'request_id': 'req-2b68788f-c524-433a-a290-d39ffbc786c3'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.839087 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2b68788f-c524-433a-a290-d39ffbc786c3 admin admin] The token cache is being invalidate because project c0c024e5e9904153831866d60e12aa54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:29:57.839402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2b68788f-c524-433a-a290-d39ffbc786c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.840014 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2b68788f-c524-433a-a290-d39ffbc786c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:29:57.842292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1400/2816] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:29:57 2022] DELETE /identity/v3/projects/c0c024e5e9904153831866d60e12aa54 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:30:07.514986 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=77,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:30:07.836163 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=9,keystone:SELECT=54,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:31:22.220009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfe230-3315-439d-880b-3274837ea9f0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:31:22.220556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfe230-3315-439d-880b-3274837ea9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:31:22.220556 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfe230-3315-439d-880b-3274837ea9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:31:22.241255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f5bfe230-3315-439d-880b-3274837ea9f0 None None] MFA Rules not processed for user `0dae2a1dae1947f2be48c65fb9c503ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:31:22.242446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f5bfe230-3315-439d-880b-3274837ea9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:31:22.295515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1417/2817] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:31:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:31:22.599646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68788f-c524-433a-a290-d39ffbc786c3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:31:22.601064 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2b68788f-c524-433a-a290-d39ffbc786c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:31:22.657541 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68788f-c524-433a-a290-d39ffbc786c3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:31:22.661451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cb952-fe11-4048-b264-64967456e8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:31:22.661987 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cb952-fe11-4048-b264-64967456e8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:31:22.662267 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cb952-fe11-4048-b264-64967456e8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:31:22.662544 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cb952-fe11-4048-b264-64967456e8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:31:22.664259 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-418cb952-fe11-4048-b264-64967456e8e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:31:22.673586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cb952-fe11-4048-b264-64967456e8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:31:22.675010 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cb952-fe11-4048-b264-64967456e8e5 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:31:22.683613 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1401/2818] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:31:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:31:22.993647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfe230-3315-439d-880b-3274837ea9f0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:31:22.995041 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f5bfe230-3315-439d-880b-3274837ea9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:31:23.067528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfe230-3315-439d-880b-3274837ea9f0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:31:23.072395 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b768d0-30d2-4891-834f-55706403b9a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c5e6dae854a44a0ad6628e7dd69dfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:31:23.072991 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b768d0-30d2-4891-834f-55706403b9a5 service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:31:23.073328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b768d0-30d2-4891-834f-55706403b9a5 service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:31:23.073603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b768d0-30d2-4891-834f-55706403b9a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:31:23.075306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a7b768d0-30d2-4891-834f-55706403b9a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:31:23.087137 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b768d0-30d2-4891-834f-55706403b9a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:31:23.088688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b768d0-30d2-4891-834f-55706403b9a5 service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:31:23.099513 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1418/2819] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:31:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:31:32.680016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=26 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:31:33.094382 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=57 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:31:33.895360 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cb952-fe11-4048-b264-64967456e8e5 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:31:33.897009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-418cb952-fe11-4048-b264-64967456e8e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:31:33.973453 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cb952-fe11-4048-b264-64967456e8e5 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:31:33.978925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bba0c-6e0a-4589-9320-4c56d5fe3c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:31:33.979565 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bba0c-6e0a-4589-9320-4c56d5fe3c78 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:31:33.979846 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bba0c-6e0a-4589-9320-4c56d5fe3c78 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:31:33.980119 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bba0c-6e0a-4589-9320-4c56d5fe3c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:31:33.981841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-cb2bba0c-6e0a-4589-9320-4c56d5fe3c78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:31:33.994296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bba0c-6e0a-4589-9320-4c56d5fe3c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:31:33.995906 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bba0c-6e0a-4589-9320-4c56d5fe3c78 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:31:34.007157 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1402/2820] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:31:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:31:44.001945 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=34 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:33:02.679618 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b768d0-30d2-4891-834f-55706403b9a5 service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:33:02.681038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a7b768d0-30d2-4891-834f-55706403b9a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:33:02.694334 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b768d0-30d2-4891-834f-55706403b9a5 service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:33:02.699408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb7722-4e67-4774-9fd9-16065271452f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c5e6dae854a44a0ad6628e7dd69dfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:33:02.700009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb7722-4e67-4774-9fd9-16065271452f service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:33:02.700286 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb7722-4e67-4774-9fd9-16065271452f service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:33:02.700557 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb7722-4e67-4774-9fd9-16065271452f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:33:02.702923 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-98bb7722-4e67-4774-9fd9-16065271452f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:33:02.722234 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb7722-4e67-4774-9fd9-16065271452f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:33:02.723856 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb7722-4e67-4774-9fd9-16065271452f service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:33:02.734024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1419/2821] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:33:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:33:04.001291 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bba0c-6e0a-4589-9320-4c56d5fe3c78 service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:33:04.010642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bba0c-6e0a-4589-9320-4c56d5fe3c78 service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:33:04.014301 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bd2d2-4ee3-4518-b599-f2b61d9b7442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:33:04.014902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bd2d2-4ee3-4518-b599-f2b61d9b7442 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:33:04.015220 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bd2d2-4ee3-4518-b599-f2b61d9b7442 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:33:04.015498 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bd2d2-4ee3-4518-b599-f2b61d9b7442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:33:04.017223 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f67bd2d2-4ee3-4518-b599-f2b61d9b7442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:33:04.027914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67bd2d2-4ee3-4518-b599-f2b61d9b7442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:33:04.029342 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67bd2d2-4ee3-4518-b599-f2b61d9b7442 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:33:04.038890 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1403/2822] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:33:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:33:05.842667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbe09e-7be1-469e-9663-418c09305e6a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:33:05.843455 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbe09e-7be1-469e-9663-418c09305e6a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:33:05.843651 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbe09e-7be1-469e-9663-418c09305e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:33:05.863102 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-05fbe09e-7be1-469e-9663-418c09305e6a None None] MFA Rules not processed for user `0dae2a1dae1947f2be48c65fb9c503ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:33:05.864255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-05fbe09e-7be1-469e-9663-418c09305e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:33:05.870984 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1420/2823] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:33:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:33:06.182830 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bd2d2-4ee3-4518-b599-f2b61d9b7442 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:33:06.191984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bd2d2-4ee3-4518-b599-f2b61d9b7442 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:33:06.195581 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b28f78-3570-42ee-b12d-2f2d186cd785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:33:06.196179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b28f78-3570-42ee-b12d-2f2d186cd785 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:33:06.196454 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b28f78-3570-42ee-b12d-2f2d186cd785 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:33:06.196732 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b28f78-3570-42ee-b12d-2f2d186cd785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:33:06.198422 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-58b28f78-3570-42ee-b12d-2f2d186cd785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:33:06.208899 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b28f78-3570-42ee-b12d-2f2d186cd785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:33:06.210312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b28f78-3570-42ee-b12d-2f2d186cd785 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:33:06.218779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1404/2824] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:33:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:33:15.857450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=9 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:33:16.214742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=12 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:40.130560 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbe09e-7be1-469e-9663-418c09305e6a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:40.131977 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-05fbe09e-7be1-469e-9663-418c09305e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:40.188880 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbe09e-7be1-469e-9663-418c09305e6a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:40.192432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cea613-6ebe-48b1-91a4-470cf5ce5167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:40.193038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cea613-6ebe-48b1-91a4-470cf5ce5167 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:40.193925 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cea613-6ebe-48b1-91a4-470cf5ce5167 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:40.193925 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cea613-6ebe-48b1-91a4-470cf5ce5167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:40.195504 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-52cea613-6ebe-48b1-91a4-470cf5ce5167 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:40.209282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cea613-6ebe-48b1-91a4-470cf5ce5167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:40.210724 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cea613-6ebe-48b1-91a4-470cf5ce5167 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:40.221705 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1421/2825] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:34:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:34:42.871555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b28f78-3570-42ee-b12d-2f2d186cd785 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:42.881452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b28f78-3570-42ee-b12d-2f2d186cd785 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:42.885066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cce840-d4bd-42e8-8bc4-ca1316f90236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:42.885666 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cce840-d4bd-42e8-8bc4-ca1316f90236 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:42.885933 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cce840-d4bd-42e8-8bc4-ca1316f90236 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:42.886207 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cce840-d4bd-42e8-8bc4-ca1316f90236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:42.888027 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-61cce840-d4bd-42e8-8bc4-ca1316f90236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:42.902287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cce840-d4bd-42e8-8bc4-ca1316f90236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:42.903762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cce840-d4bd-42e8-8bc4-ca1316f90236 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:42.914625 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1405/2826] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:34:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:34:44.555468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cea613-6ebe-48b1-91a4-470cf5ce5167 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:44.557316 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-52cea613-6ebe-48b1-91a4-470cf5ce5167 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:44.572186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cea613-6ebe-48b1-91a4-470cf5ce5167 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:44.578521 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612eef8-27d4-4bfb-b2b2-20717493aff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:44.579244 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612eef8-27d4-4bfb-b2b2-20717493aff6 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:44.579534 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612eef8-27d4-4bfb-b2b2-20717493aff6 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:44.579815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612eef8-27d4-4bfb-b2b2-20717493aff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:44.582011 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c612eef8-27d4-4bfb-b2b2-20717493aff6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:44.595497 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612eef8-27d4-4bfb-b2b2-20717493aff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:44.597289 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612eef8-27d4-4bfb-b2b2-20717493aff6 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:44.608789 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1422/2827] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:34:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 01:34:49.662960 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cce840-d4bd-42e8-8bc4-ca1316f90236 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:49.664358 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-61cce840-d4bd-42e8-8bc4-ca1316f90236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:49.675822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cce840-d4bd-42e8-8bc4-ca1316f90236 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:49.679316 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f76d20-9a48-45e3-b42c-49d2d5ce34ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:49.679903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f76d20-9a48-45e3-b42c-49d2d5ce34ad service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:49.680177 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f76d20-9a48-45e3-b42c-49d2d5ce34ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:49.680442 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f76d20-9a48-45e3-b42c-49d2d5ce34ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:49.682106 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-71f76d20-9a48-45e3-b42c-49d2d5ce34ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:49.743761 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f76d20-9a48-45e3-b42c-49d2d5ce34ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:49.745173 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f76d20-9a48-45e3-b42c-49d2d5ce34ad service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:49.755591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1406/2828] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:34:52.736408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612eef8-27d4-4bfb-b2b2-20717493aff6 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:52.757955 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612eef8-27d4-4bfb-b2b2-20717493aff6 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:52.763588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fdf05-c60e-4272-b71b-b2ed8331fd18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c5e6dae854a44a0ad6628e7dd69dfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:52.764310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fdf05-c60e-4272-b71b-b2ed8331fd18 service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:52.765018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fdf05-c60e-4272-b71b-b2ed8331fd18 service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:52.765018 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fdf05-c60e-4272-b71b-b2ed8331fd18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:52.767181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-454fdf05-c60e-4272-b71b-b2ed8331fd18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:52.784782 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fdf05-c60e-4272-b71b-b2ed8331fd18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:52.786830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fdf05-c60e-4272-b71b-b2ed8331fd18 service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:52.801483 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1423/2829] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:34:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:34:52.830940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f76d20-9a48-45e3-b42c-49d2d5ce34ad service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:52.833027 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-71f76d20-9a48-45e3-b42c-49d2d5ce34ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:52.848925 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f76d20-9a48-45e3-b42c-49d2d5ce34ad service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:52.856084 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e483833-be90-4b92-a060-35d94abeff14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:52.856727 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e483833-be90-4b92-a060-35d94abeff14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:52.857009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e483833-be90-4b92-a060-35d94abeff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:52.857289 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e483833-be90-4b92-a060-35d94abeff14 admin admin] PATH_INFO: `/v3/users/0dae2a1dae1947f2be48c65fb9c503ce` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:52.858566 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e483833-be90-4b92-a060-35d94abeff14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dae2a1dae1947f2be48c65fb9c503ce)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:52.860696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e483833-be90-4b92-a060-35d94abeff14 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:52.913699 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4e483833-be90-4b92-a060-35d94abeff14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dae2a1dae1947f2be48c65fb9c503ce'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:52.914347 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4e483833-be90-4b92-a060-35d94abeff14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dae2a1dae1947f2be48c65fb9c503ce'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:52.921376 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4e483833-be90-4b92-a060-35d94abeff14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dae2a1dae1947f2be48c65fb9c503ce'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:52.933163 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4e483833-be90-4b92-a060-35d94abeff14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dae2a1dae1947f2be48c65fb9c503ce'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:52.933857 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4e483833-be90-4b92-a060-35d94abeff14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dae2a1dae1947f2be48c65fb9c503ce'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:52.946529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1407/2830] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:34:52 2022] DELETE /identity/v3/users/0dae2a1dae1947f2be48c65fb9c503ce => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:53.116863 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fdf05-c60e-4272-b71b-b2ed8331fd18 service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:53.132086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fdf05-c60e-4272-b71b-b2ed8331fd18 service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:53.190467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c19555-12f8-4ce1-8fa3-eee3c848710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:53.191122 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c19555-12f8-4ce1-8fa3-eee3c848710d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:53.191408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c19555-12f8-4ce1-8fa3-eee3c848710d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:53.191687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c19555-12f8-4ce1-8fa3-eee3c848710d admin admin] PATH_INFO: `/v3/projects/b902feddb56443dbb4483390648719cc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:53.192802 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c19555-12f8-4ce1-8fa3-eee3c848710d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b902feddb56443dbb4483390648719cc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:53.194693 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c19555-12f8-4ce1-8fa3-eee3c848710d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:53.240772 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-54c19555-12f8-4ce1-8fa3-eee3c848710d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b902feddb56443dbb4483390648719cc', 'request_id': 'req-54c19555-12f8-4ce1-8fa3-eee3c848710d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:53.248098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-54c19555-12f8-4ce1-8fa3-eee3c848710d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b902feddb56443dbb4483390648719cc', 'request_id': 'req-54c19555-12f8-4ce1-8fa3-eee3c848710d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:53.254393 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-54c19555-12f8-4ce1-8fa3-eee3c848710d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b902feddb56443dbb4483390648719cc', 'request_id': 'req-54c19555-12f8-4ce1-8fa3-eee3c848710d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:53.264805 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-54c19555-12f8-4ce1-8fa3-eee3c848710d admin admin] The token cache is being invalidate because project b902feddb56443dbb4483390648719cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:34:53.265115 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-54c19555-12f8-4ce1-8fa3-eee3c848710d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:53.265742 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-54c19555-12f8-4ce1-8fa3-eee3c848710d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:53.267410 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1424/2831] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:34:53 2022] DELETE /identity/v3/projects/b902feddb56443dbb4483390648719cc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:53.272442 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6056-d7bb-42bd-835f-3c70ab869938 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:53.272732 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6056-d7bb-42bd-835f-3c70ab869938 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:53.273020 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6056-d7bb-42bd-835f-3c70ab869938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:53.294746 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-002c6056-d7bb-42bd-835f-3c70ab869938 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:34:53.295889 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-002c6056-d7bb-42bd-835f-3c70ab869938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:53.342423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:53.356793 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1408/2832] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:34:53.365512 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ad32a-e17b-415b-8760-bb167582b5ba None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:53.365796 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ad32a-e17b-415b-8760-bb167582b5ba None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:53.366068 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ad32a-e17b-415b-8760-bb167582b5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:53.380617 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:53.386491 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9b2ad32a-e17b-415b-8760-bb167582b5ba None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:34:53.388439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9b2ad32a-e17b-415b-8760-bb167582b5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:53.398141 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1425/2833] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:34:53.402337 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c6056-d7bb-42bd-835f-3c70ab869938 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:53.412641 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c6056-d7bb-42bd-835f-3c70ab869938 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:53.417349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc4251-8605-4b48-89c6-92b6450be6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:53.417959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc4251-8605-4b48-89c6-92b6450be6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:53.418235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc4251-8605-4b48-89c6-92b6450be6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:53.418512 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc4251-8605-4b48-89c6-92b6450be6d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:53.419186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc4251-8605-4b48-89c6-92b6450be6d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:34:53.419491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc4251-8605-4b48-89c6-92b6450be6d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:53.421090 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc4251-8605-4b48-89c6-92b6450be6d9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:53.433780 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1409/2834] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:34:53.438043 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ad32a-e17b-415b-8760-bb167582b5ba None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:53.447729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ad32a-e17b-415b-8760-bb167582b5ba None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:53.452265 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cbda5-9dd5-4522-9fb5-7b0866c39012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:53.452853 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cbda5-9dd5-4522-9fb5-7b0866c39012 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:53.453124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cbda5-9dd5-4522-9fb5-7b0866c39012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:53.453391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cbda5-9dd5-4522-9fb5-7b0866c39012 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:53.454011 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cbda5-9dd5-4522-9fb5-7b0866c39012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:53.456734 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cbda5-9dd5-4522-9fb5-7b0866c39012 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:53.485298 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1426/2835] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:34:53 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:34:53.489610 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc4251-8605-4b48-89c6-92b6450be6d9 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:53.499439 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc4251-8605-4b48-89c6-92b6450be6d9 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:53.556708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe003d-c150-4b53-9068-52795e9ab2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:53.557213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe003d-c150-4b53-9068-52795e9ab2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:53.557492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe003d-c150-4b53-9068-52795e9ab2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:53.557757 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe003d-c150-4b53-9068-52795e9ab2e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:53.558553 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe003d-c150-4b53-9068-52795e9ab2e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:53.560487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe003d-c150-4b53-9068-52795e9ab2e3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:53.584333 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1410/2836] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:34:53 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:34:53.588412 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cbda5-9dd5-4522-9fb5-7b0866c39012 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:53.599647 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cbda5-9dd5-4522-9fb5-7b0866c39012 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:53.604256 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b10af-af55-4df8-9b30-855632d38fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:53.604849 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b10af-af55-4df8-9b30-855632d38fec admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:53.605129 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b10af-af55-4df8-9b30-855632d38fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:53.605401 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b10af-af55-4df8-9b30-855632d38fec admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:53.606038 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b10af-af55-4df8-9b30-855632d38fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:53.607646 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b10af-af55-4df8-9b30-855632d38fec admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:53.619266 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1427/2837] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:34:53.621701 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe003d-c150-4b53-9068-52795e9ab2e3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:53.631736 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe003d-c150-4b53-9068-52795e9ab2e3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:53.636451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f48d2-d5ca-42b8-a449-0176dce26d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:53.637052 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f48d2-d5ca-42b8-a449-0176dce26d44 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:53.637326 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f48d2-d5ca-42b8-a449-0176dce26d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:53.637594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f48d2-d5ca-42b8-a449-0176dce26d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:53.638230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f48d2-d5ca-42b8-a449-0176dce26d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:53.639850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f48d2-d5ca-42b8-a449-0176dce26d44 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:53.652060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1411/2838] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:34:53.656325 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b10af-af55-4df8-9b30-855632d38fec admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:53.668131 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b10af-af55-4df8-9b30-855632d38fec admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:53.672835 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd76cdd-30b9-4010-9623-cc1747b85723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:53.673499 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd76cdd-30b9-4010-9623-cc1747b85723 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:53.673780 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd76cdd-30b9-4010-9623-cc1747b85723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:53.674055 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd76cdd-30b9-4010-9623-cc1747b85723 admin admin] PATH_INFO: `/v3/projects/3227f85f69e144d9ad1706d51600e4a7/users/16e62aeddea04af1b2a9c3f00b147467/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:53.689985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd76cdd-30b9-4010-9623-cc1747b85723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3227f85f69e144d9ad1706d51600e4a7, user_id=16e62aeddea04af1b2a9c3f00b147467, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:53.693650 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd76cdd-30b9-4010-9623-cc1747b85723 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:53.706858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1428/2839] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:34:53 2022] PUT /identity/v3/projects/3227f85f69e144d9ad1706d51600e4a7/users/16e62aeddea04af1b2a9c3f00b147467/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:53.718584 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e95a4-6cb4-4f10-b707-ad51d003ce70 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:53.718869 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e95a4-6cb4-4f10-b707-ad51d003ce70 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:53.719441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e95a4-6cb4-4f10-b707-ad51d003ce70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:53.749234 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-eb8e95a4-6cb4-4f10-b707-ad51d003ce70 None None] MFA Rules not processed for user `16e62aeddea04af1b2a9c3f00b147467`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:34:53.750451 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-eb8e95a4-6cb4-4f10-b707-ad51d003ce70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:53.816307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1412/2840] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:34:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:34:53.820864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd76cdd-30b9-4010-9623-cc1747b85723 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:53.881967 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd76cdd-30b9-4010-9623-cc1747b85723 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:53.886592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd65e1f-54c4-4865-9955-e8d0e09d2066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:53.887228 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd65e1f-54c4-4865-9955-e8d0e09d2066 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:53.887510 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd65e1f-54c4-4865-9955-e8d0e09d2066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:53.887781 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd65e1f-54c4-4865-9955-e8d0e09d2066 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:53.888424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd65e1f-54c4-4865-9955-e8d0e09d2066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:53.890312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd65e1f-54c4-4865-9955-e8d0e09d2066 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:53.917404 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1429/2841] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:34:53 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:34:53.921643 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e95a4-6cb4-4f10-b707-ad51d003ce70 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:53.932247 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e95a4-6cb4-4f10-b707-ad51d003ce70 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:53.977421 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:53.990147 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083fcbd-9ac9-44bc-a40f-ed215d92dbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:53.990749 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083fcbd-9ac9-44bc-a40f-ed215d92dbe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:53.991045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083fcbd-9ac9-44bc-a40f-ed215d92dbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:53.991341 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083fcbd-9ac9-44bc-a40f-ed215d92dbe0 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:53.991992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083fcbd-9ac9-44bc-a40f-ed215d92dbe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:53.993909 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083fcbd-9ac9-44bc-a40f-ed215d92dbe0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:54.015235 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1413/2842] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:34:53 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:34:54.019908 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd65e1f-54c4-4865-9955-e8d0e09d2066 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:54.030009 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd65e1f-54c4-4865-9955-e8d0e09d2066 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:54.034612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b1915-d3ac-4798-9440-d7eef3ccf261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:54.035303 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b1915-d3ac-4798-9440-d7eef3ccf261 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:54.035581 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b1915-d3ac-4798-9440-d7eef3ccf261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:54.035851 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b1915-d3ac-4798-9440-d7eef3ccf261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:54.036486 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b1915-d3ac-4798-9440-d7eef3ccf261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:54.038056 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b1915-d3ac-4798-9440-d7eef3ccf261 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:54.048656 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1430/2843] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:34:54.052670 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083fcbd-9ac9-44bc-a40f-ed215d92dbe0 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:54.062306 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083fcbd-9ac9-44bc-a40f-ed215d92dbe0 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:54.067708 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ec417-1e39-47c7-b891-754d92715c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:54.068282 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ec417-1e39-47c7-b891-754d92715c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:54.068556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ec417-1e39-47c7-b891-754d92715c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:54.068826 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ec417-1e39-47c7-b891-754d92715c55 admin admin] PATH_INFO: `/v3/projects/f6325877c0ce4d7f8e72a9520bfcf600/users/d7e0e424875744218fdfe06246c7649c/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:54.083850 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ec417-1e39-47c7-b891-754d92715c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6325877c0ce4d7f8e72a9520bfcf600, user_id=d7e0e424875744218fdfe06246c7649c, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:54.086465 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ec417-1e39-47c7-b891-754d92715c55 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:54.099223 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1414/2844] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:34:54 2022] PUT /identity/v3/projects/f6325877c0ce4d7f8e72a9520bfcf600/users/d7e0e424875744218fdfe06246c7649c/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:54.103053 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b1915-d3ac-4798-9440-d7eef3ccf261 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:54.113108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b1915-d3ac-4798-9440-d7eef3ccf261 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:54.169627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae4d6f-8aba-4120-ba9b-0c4c1ba69e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:54.170226 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae4d6f-8aba-4120-ba9b-0c4c1ba69e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:54.170501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae4d6f-8aba-4120-ba9b-0c4c1ba69e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:54.170769 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae4d6f-8aba-4120-ba9b-0c4c1ba69e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:54.171429 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae4d6f-8aba-4120-ba9b-0c4c1ba69e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:54.172994 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae4d6f-8aba-4120-ba9b-0c4c1ba69e25 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:54.183163 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1431/2845] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 01:34:54.187352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ec417-1e39-47c7-b891-754d92715c55 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:54.198257 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ec417-1e39-47c7-b891-754d92715c55 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:54.202742 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16f76-63b7-4547-9074-c602f26af609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:54.203420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16f76-63b7-4547-9074-c602f26af609 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:54.203698 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16f76-63b7-4547-9074-c602f26af609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:54.203966 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16f76-63b7-4547-9074-c602f26af609 admin admin] PATH_INFO: `/v3/projects/f6325877c0ce4d7f8e72a9520bfcf600/users/d7e0e424875744218fdfe06246c7649c/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:54.206167 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e16f76-63b7-4547-9074-c602f26af609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6325877c0ce4d7f8e72a9520bfcf600, user_id=d7e0e424875744218fdfe06246c7649c, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:54.208813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e16f76-63b7-4547-9074-c602f26af609 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:54.219357 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1415/2846] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:34:54 2022] PUT /identity/v3/projects/f6325877c0ce4d7f8e72a9520bfcf600/users/d7e0e424875744218fdfe06246c7649c/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:54.229636 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e4fe3-ee18-49d4-8116-44a22137ce4d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:54.229922 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e4fe3-ee18-49d4-8116-44a22137ce4d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:54.230198 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e4fe3-ee18-49d4-8116-44a22137ce4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:54.256630 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:54.259918 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-339e4fe3-ee18-49d4-8116-44a22137ce4d None None] MFA Rules not processed for user `d7e0e424875744218fdfe06246c7649c`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:34:54.261769 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-339e4fe3-ee18-49d4-8116-44a22137ce4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:54.328439 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1432/2847] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:34:54.339529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16f76-63b7-4547-9074-c602f26af609 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:54.341213 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d8e16f76-63b7-4547-9074-c602f26af609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:54.399039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16f76-63b7-4547-9074-c602f26af609 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:54.402639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06c7d5-8a87-4d2c-a398-b9bea76fc4b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:54.403269 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06c7d5-8a87-4d2c-a398-b9bea76fc4b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:54.403545 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06c7d5-8a87-4d2c-a398-b9bea76fc4b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:54.403813 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06c7d5-8a87-4d2c-a398-b9bea76fc4b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:54.413113 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06c7d5-8a87-4d2c-a398-b9bea76fc4b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:54.414583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06c7d5-8a87-4d2c-a398-b9bea76fc4b7 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:54.426069 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1416/2848] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:34:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:34:54.491160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e4fe3-ee18-49d4-8116-44a22137ce4d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:54.553032 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e4fe3-ee18-49d4-8116-44a22137ce4d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:54.557596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4d82c-9d53-43c9-8f27-6fca17c5d68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:54.558214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4d82c-9d53-43c9-8f27-6fca17c5d68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:54.558603 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4d82c-9d53-43c9-8f27-6fca17c5d68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:54.558877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4d82c-9d53-43c9-8f27-6fca17c5d68e admin admin] PATH_INFO: `/v3/users/16e62aeddea04af1b2a9c3f00b147467` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:54.560022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4d82c-9d53-43c9-8f27-6fca17c5d68e admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e62aeddea04af1b2a9c3f00b147467)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:54.561921 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4d82c-9d53-43c9-8f27-6fca17c5d68e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:54.608583 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-38b4d82c-9d53-43c9-8f27-6fca17c5d68e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e62aeddea04af1b2a9c3f00b147467'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:54.609147 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-38b4d82c-9d53-43c9-8f27-6fca17c5d68e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e62aeddea04af1b2a9c3f00b147467'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:54.616566 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-38b4d82c-9d53-43c9-8f27-6fca17c5d68e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e62aeddea04af1b2a9c3f00b147467'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:54.628822 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-38b4d82c-9d53-43c9-8f27-6fca17c5d68e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e62aeddea04af1b2a9c3f00b147467'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:54.629467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-38b4d82c-9d53-43c9-8f27-6fca17c5d68e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e62aeddea04af1b2a9c3f00b147467'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:54.642137 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1433/2849] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:34:54 2022] DELETE /identity/v3/users/16e62aeddea04af1b2a9c3f00b147467 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:54.647191 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca5f21-41a6-46e6-a1a6-d9491002f1e8 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:54.647483 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca5f21-41a6-46e6-a1a6-d9491002f1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:54.647760 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca5f21-41a6-46e6-a1a6-d9491002f1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:54.666109 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-43ca5f21-41a6-46e6-a1a6-d9491002f1e8 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:34:54.667339 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-43ca5f21-41a6-46e6-a1a6-d9491002f1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:54.726211 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1417/2850] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:34:54.735834 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4d82c-9d53-43c9-8f27-6fca17c5d68e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:54.737407 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-38b4d82c-9d53-43c9-8f27-6fca17c5d68e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:54.758126 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:54.797501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4d82c-9d53-43c9-8f27-6fca17c5d68e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:54.801217 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec2956-07f3-48bd-90e8-ac030805920a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:54.801819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec2956-07f3-48bd-90e8-ac030805920a service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:54.802100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec2956-07f3-48bd-90e8-ac030805920a service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:54.802377 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec2956-07f3-48bd-90e8-ac030805920a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:54.811476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec2956-07f3-48bd-90e8-ac030805920a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:54.812892 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec2956-07f3-48bd-90e8-ac030805920a service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:54.823187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1434/2851] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:34:55.090295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca5f21-41a6-46e6-a1a6-d9491002f1e8 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:55.091907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-43ca5f21-41a6-46e6-a1a6-d9491002f1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:55.104665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca5f21-41a6-46e6-a1a6-d9491002f1e8 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:55.109400 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24894f73-df44-44a9-b744-998e5de5f09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:55.110033 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24894f73-df44-44a9-b744-998e5de5f09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:55.110312 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24894f73-df44-44a9-b744-998e5de5f09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:55.110585 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24894f73-df44-44a9-b744-998e5de5f09e admin admin] PATH_INFO: `/v3/projects/3227f85f69e144d9ad1706d51600e4a7` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:55.112372 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24894f73-df44-44a9-b744-998e5de5f09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3227f85f69e144d9ad1706d51600e4a7)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:55.114313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24894f73-df44-44a9-b744-998e5de5f09e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:55.155628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:55.163549 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-24894f73-df44-44a9-b744-998e5de5f09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3227f85f69e144d9ad1706d51600e4a7', 'request_id': 'req-24894f73-df44-44a9-b744-998e5de5f09e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:55.169954 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-24894f73-df44-44a9-b744-998e5de5f09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3227f85f69e144d9ad1706d51600e4a7', 'request_id': 'req-24894f73-df44-44a9-b744-998e5de5f09e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:55.176162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-24894f73-df44-44a9-b744-998e5de5f09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3227f85f69e144d9ad1706d51600e4a7', 'request_id': 'req-24894f73-df44-44a9-b744-998e5de5f09e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:55.188313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-24894f73-df44-44a9-b744-998e5de5f09e admin admin] The token cache is being invalidate because project 3227f85f69e144d9ad1706d51600e4a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:34:55.188624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-24894f73-df44-44a9-b744-998e5de5f09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:55.189807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-24894f73-df44-44a9-b744-998e5de5f09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:55.191586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1418/2852] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:34:55 2022] DELETE /identity/v3/projects/3227f85f69e144d9ad1706d51600e4a7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:55.195549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec2956-07f3-48bd-90e8-ac030805920a service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:55.205050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec2956-07f3-48bd-90e8-ac030805920a service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:55.262933 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228efa2c-9027-421d-a86b-96908d6c61f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:55.263588 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228efa2c-9027-421d-a86b-96908d6c61f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:55.263862 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228efa2c-9027-421d-a86b-96908d6c61f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:55.264130 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228efa2c-9027-421d-a86b-96908d6c61f4 admin admin] PATH_INFO: `/v3/users/d7e0e424875744218fdfe06246c7649c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:55.265241 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228efa2c-9027-421d-a86b-96908d6c61f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e0e424875744218fdfe06246c7649c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:55.267161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228efa2c-9027-421d-a86b-96908d6c61f4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:55.313315 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-228efa2c-9027-421d-a86b-96908d6c61f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e0e424875744218fdfe06246c7649c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:55.313972 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-228efa2c-9027-421d-a86b-96908d6c61f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e0e424875744218fdfe06246c7649c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:55.321518 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-228efa2c-9027-421d-a86b-96908d6c61f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e0e424875744218fdfe06246c7649c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:55.333342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-228efa2c-9027-421d-a86b-96908d6c61f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e0e424875744218fdfe06246c7649c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:55.333991 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-228efa2c-9027-421d-a86b-96908d6c61f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e0e424875744218fdfe06246c7649c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:55.347304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1435/2853] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:34:55 2022] DELETE /identity/v3/users/d7e0e424875744218fdfe06246c7649c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:55.621600 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24894f73-df44-44a9-b744-998e5de5f09e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:55.623099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-24894f73-df44-44a9-b744-998e5de5f09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:55.636354 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24894f73-df44-44a9-b744-998e5de5f09e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:55.693208 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8065e4-ca6a-4b38-a576-d2b129108736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:55.693751 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8065e4-ca6a-4b38-a576-d2b129108736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:55.694025 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8065e4-ca6a-4b38-a576-d2b129108736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:55.694295 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8065e4-ca6a-4b38-a576-d2b129108736 admin admin] PATH_INFO: `/v3/projects/f6325877c0ce4d7f8e72a9520bfcf600` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:55.695426 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8065e4-ca6a-4b38-a576-d2b129108736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6325877c0ce4d7f8e72a9520bfcf600)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:55.697311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8065e4-ca6a-4b38-a576-d2b129108736 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:55.743920 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9b8065e4-ca6a-4b38-a576-d2b129108736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6325877c0ce4d7f8e72a9520bfcf600', 'request_id': 'req-9b8065e4-ca6a-4b38-a576-d2b129108736'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:55.749990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9b8065e4-ca6a-4b38-a576-d2b129108736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6325877c0ce4d7f8e72a9520bfcf600', 'request_id': 'req-9b8065e4-ca6a-4b38-a576-d2b129108736'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:55.756167 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9b8065e4-ca6a-4b38-a576-d2b129108736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6325877c0ce4d7f8e72a9520bfcf600', 'request_id': 'req-9b8065e4-ca6a-4b38-a576-d2b129108736'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:55.768946 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9b8065e4-ca6a-4b38-a576-d2b129108736 admin admin] The token cache is being invalidate because project f6325877c0ce4d7f8e72a9520bfcf600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:34:55.769237 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9b8065e4-ca6a-4b38-a576-d2b129108736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:55.769864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9b8065e4-ca6a-4b38-a576-d2b129108736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:55.771387 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1419/2854] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:34:55 2022] DELETE /identity/v3/projects/f6325877c0ce4d7f8e72a9520bfcf600 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:55.776261 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13d5a-56e7-4aaf-9ed4-f9a737aa4a78 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:55.776553 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13d5a-56e7-4aaf-9ed4-f9a737aa4a78 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:55.776830 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13d5a-56e7-4aaf-9ed4-f9a737aa4a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:55.799957 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-20c13d5a-56e7-4aaf-9ed4-f9a737aa4a78 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:34:55.801223 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-20c13d5a-56e7-4aaf-9ed4-f9a737aa4a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:55.834069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:55.859987 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1436/2855] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:34:55.868423 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506899ee-dfe9-49e8-b177-d11ca0d58dbc None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:55.868706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506899ee-dfe9-49e8-b177-d11ca0d58dbc None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:55.868982 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506899ee-dfe9-49e8-b177-d11ca0d58dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:55.889270 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-506899ee-dfe9-49e8-b177-d11ca0d58dbc None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:34:55.890492 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-506899ee-dfe9-49e8-b177-d11ca0d58dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:55.898594 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1420/2856] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:34:55.902804 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c13d5a-56e7-4aaf-9ed4-f9a737aa4a78 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:55.912714 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c13d5a-56e7-4aaf-9ed4-f9a737aa4a78 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:55.917289 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57e21a-ea52-4b06-98cf-459f77a521bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:55.917881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57e21a-ea52-4b06-98cf-459f77a521bd admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:55.918162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57e21a-ea52-4b06-98cf-459f77a521bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:55.918436 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57e21a-ea52-4b06-98cf-459f77a521bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:55.919106 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57e21a-ea52-4b06-98cf-459f77a521bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:34:55.919415 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57e21a-ea52-4b06-98cf-459f77a521bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:55.921000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57e21a-ea52-4b06-98cf-459f77a521bd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:55.933164 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1437/2857] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:34:55.937176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506899ee-dfe9-49e8-b177-d11ca0d58dbc None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:55.947007 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506899ee-dfe9-49e8-b177-d11ca0d58dbc None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:55.951603 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22378ab-1d20-421b-9f6b-1177b3a50c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:55.952197 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22378ab-1d20-421b-9f6b-1177b3a50c02 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:55.952475 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22378ab-1d20-421b-9f6b-1177b3a50c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:55.952750 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22378ab-1d20-421b-9f6b-1177b3a50c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:55.953389 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22378ab-1d20-421b-9f6b-1177b3a50c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:55.955390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22378ab-1d20-421b-9f6b-1177b3a50c02 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:55.982089 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1421/2858] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:34:55 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:34:55.986826 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57e21a-ea52-4b06-98cf-459f77a521bd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:55.996721 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57e21a-ea52-4b06-98cf-459f77a521bd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:56.052398 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193185ed-8e29-42da-83be-828f86f71a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:56.053000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193185ed-8e29-42da-83be-828f86f71a53 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:56.053277 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193185ed-8e29-42da-83be-828f86f71a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:56.053548 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193185ed-8e29-42da-83be-828f86f71a53 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:56.054178 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193185ed-8e29-42da-83be-828f86f71a53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:56.056112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193185ed-8e29-42da-83be-828f86f71a53 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:56.078124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1438/2859] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:34:55 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:34:56.082552 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22378ab-1d20-421b-9f6b-1177b3a50c02 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:56.094002 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22378ab-1d20-421b-9f6b-1177b3a50c02 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:56.100142 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524bda1-e9c6-488f-af3f-6dddfad35b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:56.100778 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524bda1-e9c6-488f-af3f-6dddfad35b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:56.101094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524bda1-e9c6-488f-af3f-6dddfad35b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:56.101443 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524bda1-e9c6-488f-af3f-6dddfad35b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:56.102148 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524bda1-e9c6-488f-af3f-6dddfad35b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:56.103898 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524bda1-e9c6-488f-af3f-6dddfad35b47 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:56.115185 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1422/2860] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:34:56.119051 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193185ed-8e29-42da-83be-828f86f71a53 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:56.129137 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193185ed-8e29-42da-83be-828f86f71a53 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:56.133740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29637589-6dd7-4cca-a606-fb065e4e11e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:56.134337 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29637589-6dd7-4cca-a606-fb065e4e11e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:56.134619 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29637589-6dd7-4cca-a606-fb065e4e11e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:56.134895 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29637589-6dd7-4cca-a606-fb065e4e11e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:56.135577 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29637589-6dd7-4cca-a606-fb065e4e11e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:56.137157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29637589-6dd7-4cca-a606-fb065e4e11e9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:56.147792 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1439/2861] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:34:56.151693 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524bda1-e9c6-488f-af3f-6dddfad35b47 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:56.162090 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524bda1-e9c6-488f-af3f-6dddfad35b47 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:56.166690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc41575-5890-4683-aecb-db01185a45c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:56.167366 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc41575-5890-4683-aecb-db01185a45c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:56.167646 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc41575-5890-4683-aecb-db01185a45c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:56.167922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc41575-5890-4683-aecb-db01185a45c0 admin admin] PATH_INFO: `/v3/projects/4989f4f00f8a4d81bd570ce6a73458b7/users/f057f62264204d1d94060e94875759b2/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:56.182939 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc41575-5890-4683-aecb-db01185a45c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4989f4f00f8a4d81bd570ce6a73458b7, user_id=f057f62264204d1d94060e94875759b2, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:56.185619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc41575-5890-4683-aecb-db01185a45c0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:56.187802 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:56.200279 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1423/2862] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:34:56 2022] PUT /identity/v3/projects/4989f4f00f8a4d81bd570ce6a73458b7/users/f057f62264204d1d94060e94875759b2/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:34:56.211939 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9054a3-3415-47f4-b2e3-2595fd7db060 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:56.212253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9054a3-3415-47f4-b2e3-2595fd7db060 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:56.212547 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9054a3-3415-47f4-b2e3-2595fd7db060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:56.242869 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3d9054a3-3415-47f4-b2e3-2595fd7db060 None None] MFA Rules not processed for user `f057f62264204d1d94060e94875759b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:34:56.244119 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3d9054a3-3415-47f4-b2e3-2595fd7db060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:56.306900 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1440/2863] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:34:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:34:56.311588 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc41575-5890-4683-aecb-db01185a45c0 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:56.373463 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc41575-5890-4683-aecb-db01185a45c0 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:56.378214 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206fd0f-1f8f-47a2-a26b-05eecf5f80bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:56.378819 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206fd0f-1f8f-47a2-a26b-05eecf5f80bc admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:56.379130 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206fd0f-1f8f-47a2-a26b-05eecf5f80bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:56.379409 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206fd0f-1f8f-47a2-a26b-05eecf5f80bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:56.380051 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206fd0f-1f8f-47a2-a26b-05eecf5f80bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:56.381988 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206fd0f-1f8f-47a2-a26b-05eecf5f80bc admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:56.407551 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1424/2864] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:34:56 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:34:56.412344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9054a3-3415-47f4-b2e3-2595fd7db060 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:56.423244 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9054a3-3415-47f4-b2e3-2595fd7db060 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:56.455658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:56.481253 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc8d87-23c5-4aec-b7ea-0a46a491333e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:56.481879 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc8d87-23c5-4aec-b7ea-0a46a491333e admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:56.482157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc8d87-23c5-4aec-b7ea-0a46a491333e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:56.482425 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc8d87-23c5-4aec-b7ea-0a46a491333e admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:56.483059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc8d87-23c5-4aec-b7ea-0a46a491333e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:56.484975 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc8d87-23c5-4aec-b7ea-0a46a491333e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:56.505574 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1441/2865] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:34:56 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:34:56.509710 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206fd0f-1f8f-47a2-a26b-05eecf5f80bc admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:56.520928 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206fd0f-1f8f-47a2-a26b-05eecf5f80bc admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:56.525550 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c6e26-8e47-4c96-b553-f0db1c752bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:56.526149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c6e26-8e47-4c96-b553-f0db1c752bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:56.526428 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c6e26-8e47-4c96-b553-f0db1c752bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:56.526700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c6e26-8e47-4c96-b553-f0db1c752bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:56.527373 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c6e26-8e47-4c96-b553-f0db1c752bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:56.528955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c6e26-8e47-4c96-b553-f0db1c752bb8 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:56.540324 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1425/2866] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:34:56.544489 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc8d87-23c5-4aec-b7ea-0a46a491333e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:56.554501 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc8d87-23c5-4aec-b7ea-0a46a491333e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:56.559081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c573a-b22d-41f0-a955-063c489ff755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:56.559736 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c573a-b22d-41f0-a955-063c489ff755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:56.560017 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c573a-b22d-41f0-a955-063c489ff755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:56.560292 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c573a-b22d-41f0-a955-063c489ff755 admin admin] PATH_INFO: `/v3/projects/d739b2b0d53b4f67a8346ba1df3537f7/users/ed93c46a5e794e70ba5f33eee2f6a735/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:56.574627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c573a-b22d-41f0-a955-063c489ff755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d739b2b0d53b4f67a8346ba1df3537f7, user_id=ed93c46a5e794e70ba5f33eee2f6a735, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:56.577408 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c573a-b22d-41f0-a955-063c489ff755 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:56.590953 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1442/2867] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:34:56 2022] PUT /identity/v3/projects/d739b2b0d53b4f67a8346ba1df3537f7/users/ed93c46a5e794e70ba5f33eee2f6a735/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:56.595297 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c6e26-8e47-4c96-b553-f0db1c752bb8 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:56.605700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c6e26-8e47-4c96-b553-f0db1c752bb8 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:56.661545 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c50da-af5a-48be-bee1-5c73ecb866f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:56.662143 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c50da-af5a-48be-bee1-5c73ecb866f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:56.662420 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c50da-af5a-48be-bee1-5c73ecb866f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:56.662686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c50da-af5a-48be-bee1-5c73ecb866f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:56.663348 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c50da-af5a-48be-bee1-5c73ecb866f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:56.664927 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c50da-af5a-48be-bee1-5c73ecb866f2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:56.675043 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1426/2868] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:34:56.679194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c573a-b22d-41f0-a955-063c489ff755 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:56.689764 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c573a-b22d-41f0-a955-063c489ff755 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:56.694368 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110136f2-296b-4567-bd35-9ed662025967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:56.695209 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110136f2-296b-4567-bd35-9ed662025967 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:56.695490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110136f2-296b-4567-bd35-9ed662025967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:56.695765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110136f2-296b-4567-bd35-9ed662025967 admin admin] PATH_INFO: `/v3/projects/d739b2b0d53b4f67a8346ba1df3537f7/users/ed93c46a5e794e70ba5f33eee2f6a735/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:56.697658 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110136f2-296b-4567-bd35-9ed662025967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d739b2b0d53b4f67a8346ba1df3537f7, user_id=ed93c46a5e794e70ba5f33eee2f6a735, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:56.700296 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110136f2-296b-4567-bd35-9ed662025967 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:56.710974 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1443/2869] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:34:56 2022] PUT /identity/v3/projects/d739b2b0d53b4f67a8346ba1df3537f7/users/ed93c46a5e794e70ba5f33eee2f6a735/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:56.721671 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1063c-6368-4153-90cc-f672a59f882b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:56.721952 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1063c-6368-4153-90cc-f672a59f882b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:56.722253 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1063c-6368-4153-90cc-f672a59f882b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:56.749194 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f6a1063c-6368-4153-90cc-f672a59f882b None None] MFA Rules not processed for user `ed93c46a5e794e70ba5f33eee2f6a735`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:34:56.750390 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f6a1063c-6368-4153-90cc-f672a59f882b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:56.801651 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:56.821741 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1427/2870] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:34:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:34:56.834170 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110136f2-296b-4567-bd35-9ed662025967 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:56.835973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-110136f2-296b-4567-bd35-9ed662025967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:56.894483 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110136f2-296b-4567-bd35-9ed662025967 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:56.898260 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e214a-a68c-40da-8f6c-ef5116fcfc0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:56.898886 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e214a-a68c-40da-8f6c-ef5116fcfc0e service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:56.899200 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e214a-a68c-40da-8f6c-ef5116fcfc0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:56.899473 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e214a-a68c-40da-8f6c-ef5116fcfc0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:56.909108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e214a-a68c-40da-8f6c-ef5116fcfc0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:56.910529 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e214a-a68c-40da-8f6c-ef5116fcfc0e service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:56.919765 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1444/2871] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:34:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:34:57.231732 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1063c-6368-4153-90cc-f672a59f882b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:57.240872 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1063c-6368-4153-90cc-f672a59f882b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:57.245702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d167ace-035d-4965-8be3-37881217b772 tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed93c46a5e794e70ba5f33eee2f6a735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd739b2b0d53b4f67a8346ba1df3537f7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:57.246294 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d167ace-035d-4965-8be3-37881217b772 tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:57.246578 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d167ace-035d-4965-8be3-37881217b772 tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:57.246849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d167ace-035d-4965-8be3-37881217b772 tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:57.247513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d167ace-035d-4965-8be3-37881217b772 tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:34:57.247819 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d167ace-035d-4965-8be3-37881217b772 tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:57.249491 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d167ace-035d-4965-8be3-37881217b772 tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:57.261302 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1428/2872] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:34:57.265305 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e214a-a68c-40da-8f6c-ef5116fcfc0e service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:57.274773 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e214a-a68c-40da-8f6c-ef5116fcfc0e service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:57.279321 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fcece-c80e-4e55-bbff-365f6d18068e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed93c46a5e794e70ba5f33eee2f6a735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd739b2b0d53b4f67a8346ba1df3537f7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:57.279910 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fcece-c80e-4e55-bbff-365f6d18068e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:57.280191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fcece-c80e-4e55-bbff-365f6d18068e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:57.280464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fcece-c80e-4e55-bbff-365f6d18068e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:57.281093 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fcece-c80e-4e55-bbff-365f6d18068e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:57.283555 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fcece-c80e-4e55-bbff-365f6d18068e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:57.310094 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1445/2873] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:34:57 2022] POST /identity/v3/projects => generated 352 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:34:57.314322 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d167ace-035d-4965-8be3-37881217b772 tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:57.324480 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d167ace-035d-4965-8be3-37881217b772 tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:57.381003 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a474f-8169-4a13-ad1e-557b79df368e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed93c46a5e794e70ba5f33eee2f6a735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd739b2b0d53b4f67a8346ba1df3537f7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:57.381604 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a474f-8169-4a13-ad1e-557b79df368e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:57.381885 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a474f-8169-4a13-ad1e-557b79df368e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:57.382165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a474f-8169-4a13-ad1e-557b79df368e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:57.382807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a474f-8169-4a13-ad1e-557b79df368e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:34:57.383142 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a474f-8169-4a13-ad1e-557b79df368e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:57.384739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a474f-8169-4a13-ad1e-557b79df368e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:57.398311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1429/2874] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:34:57.436144 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fcece-c80e-4e55-bbff-365f6d18068e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:57.446509 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fcece-c80e-4e55-bbff-365f6d18068e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:57.451262 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f2e5a-e5f7-44db-b9a8-ce11a7a2570c tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed93c46a5e794e70ba5f33eee2f6a735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd739b2b0d53b4f67a8346ba1df3537f7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:57.451895 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f2e5a-e5f7-44db-b9a8-ce11a7a2570c tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:57.452181 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f2e5a-e5f7-44db-b9a8-ce11a7a2570c tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:57.452457 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f2e5a-e5f7-44db-b9a8-ce11a7a2570c tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] PATH_INFO: `/v3/projects/ac5cd8922359422ab47947059f84244e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:57.453594 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f2e5a-e5f7-44db-b9a8-ce11a7a2570c tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ac5cd8922359422ab47947059f84244e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:57.456081 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f2e5a-e5f7-44db-b9a8-ce11a7a2570c tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:57.504113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c57f2e5a-e5f7-44db-b9a8-ce11a7a2570c tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5cd8922359422ab47947059f84244e', 'request_id': 'req-c57f2e5a-e5f7-44db-b9a8-ce11a7a2570c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:57.511355 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c57f2e5a-e5f7-44db-b9a8-ce11a7a2570c tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5cd8922359422ab47947059f84244e', 'request_id': 'req-c57f2e5a-e5f7-44db-b9a8-ce11a7a2570c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:57.518841 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c57f2e5a-e5f7-44db-b9a8-ce11a7a2570c tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5cd8922359422ab47947059f84244e', 'request_id': 'req-c57f2e5a-e5f7-44db-b9a8-ce11a7a2570c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:57.520888 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=87,keystone:INSERT=7,keystone:DELETE=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:57.531587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c57f2e5a-e5f7-44db-b9a8-ce11a7a2570c tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] The token cache is being invalidate because project ac5cd8922359422ab47947059f84244e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:34:57.531864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c57f2e5a-e5f7-44db-b9a8-ce11a7a2570c tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:57.532513 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c57f2e5a-e5f7-44db-b9a8-ce11a7a2570c tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:57.534615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1446/2875] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:34:57 2022] DELETE /identity/v3/projects/ac5cd8922359422ab47947059f84244e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:57.723717 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a474f-8169-4a13-ad1e-557b79df368e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:57.725456 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2d4a474f-8169-4a13-ad1e-557b79df368e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:57.789490 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a474f-8169-4a13-ad1e-557b79df368e tempest-VolumeQuotaClassesTest-882177745 tempest-VolumeQuotaClassesTest-882177745-project-admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:57.845660 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4437f-5f6b-492a-9be2-9599486bc567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:57.846315 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4437f-5f6b-492a-9be2-9599486bc567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:57.846591 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4437f-5f6b-492a-9be2-9599486bc567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:57.846864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4437f-5f6b-492a-9be2-9599486bc567 admin admin] PATH_INFO: `/v3/users/f057f62264204d1d94060e94875759b2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:57.848023 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4437f-5f6b-492a-9be2-9599486bc567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f057f62264204d1d94060e94875759b2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:57.849943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4437f-5f6b-492a-9be2-9599486bc567 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:57.870034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:57.896487 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dad4437f-5f6b-492a-9be2-9599486bc567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f057f62264204d1d94060e94875759b2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:57.897125 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dad4437f-5f6b-492a-9be2-9599486bc567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f057f62264204d1d94060e94875759b2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:57.903950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dad4437f-5f6b-492a-9be2-9599486bc567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f057f62264204d1d94060e94875759b2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:57.915753 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dad4437f-5f6b-492a-9be2-9599486bc567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f057f62264204d1d94060e94875759b2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:57.916379 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dad4437f-5f6b-492a-9be2-9599486bc567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f057f62264204d1d94060e94875759b2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:57.929482 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1430/2876] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:34:57 2022] DELETE /identity/v3/users/f057f62264204d1d94060e94875759b2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:34:57.933927 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25fc09-2fb1-474a-8dd7-78bd98f54061 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:57.934388 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25fc09-2fb1-474a-8dd7-78bd98f54061 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:57.934549 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25fc09-2fb1-474a-8dd7-78bd98f54061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:57.953723 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1d25fc09-2fb1-474a-8dd7-78bd98f54061 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:34:57.955011 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1d25fc09-2fb1-474a-8dd7-78bd98f54061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:58.013214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1447/2877] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:34:58.023296 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4437f-5f6b-492a-9be2-9599486bc567 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:58.024722 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-dad4437f-5f6b-492a-9be2-9599486bc567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:58.082346 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4437f-5f6b-492a-9be2-9599486bc567 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:58.086009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298e218-d340-409c-bfdd-b1b162a82346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:58.086609 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298e218-d340-409c-bfdd-b1b162a82346 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:58.086891 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298e218-d340-409c-bfdd-b1b162a82346 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:58.087195 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298e218-d340-409c-bfdd-b1b162a82346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:58.096479 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298e218-d340-409c-bfdd-b1b162a82346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:58.097919 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298e218-d340-409c-bfdd-b1b162a82346 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:58.107324 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1431/2878] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:34:58.380213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25fc09-2fb1-474a-8dd7-78bd98f54061 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:58.381652 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1d25fc09-2fb1-474a-8dd7-78bd98f54061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:58.393840 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25fc09-2fb1-474a-8dd7-78bd98f54061 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:58.398464 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0308e-89f5-449a-ac4e-819e54ec9917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:58.399165 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0308e-89f5-449a-ac4e-819e54ec9917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:58.399449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0308e-89f5-449a-ac4e-819e54ec9917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:58.399728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0308e-89f5-449a-ac4e-819e54ec9917 admin admin] PATH_INFO: `/v3/projects/4989f4f00f8a4d81bd570ce6a73458b7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:58.400851 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0308e-89f5-449a-ac4e-819e54ec9917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4989f4f00f8a4d81bd570ce6a73458b7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:58.402761 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0308e-89f5-449a-ac4e-819e54ec9917 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:58.450996 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8fb0308e-89f5-449a-ac4e-819e54ec9917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4989f4f00f8a4d81bd570ce6a73458b7', 'request_id': 'req-8fb0308e-89f5-449a-ac4e-819e54ec9917'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:58.458172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8fb0308e-89f5-449a-ac4e-819e54ec9917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4989f4f00f8a4d81bd570ce6a73458b7', 'request_id': 'req-8fb0308e-89f5-449a-ac4e-819e54ec9917'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:58.464349 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8fb0308e-89f5-449a-ac4e-819e54ec9917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4989f4f00f8a4d81bd570ce6a73458b7', 'request_id': 'req-8fb0308e-89f5-449a-ac4e-819e54ec9917'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:58.475605 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8fb0308e-89f5-449a-ac4e-819e54ec9917 admin admin] The token cache is being invalidate because project 4989f4f00f8a4d81bd570ce6a73458b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:34:58.475901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8fb0308e-89f5-449a-ac4e-819e54ec9917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:58.476538 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8fb0308e-89f5-449a-ac4e-819e54ec9917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:58.478024 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1448/2879] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:34:58 2022] DELETE /identity/v3/projects/4989f4f00f8a4d81bd570ce6a73458b7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:58.482128 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298e218-d340-409c-bfdd-b1b162a82346 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:58.492924 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298e218-d340-409c-bfdd-b1b162a82346 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:58.553149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed971e-3f82-4af7-871b-4e7b5e9ee16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:58.553905 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed971e-3f82-4af7-871b-4e7b5e9ee16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:58.554187 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed971e-3f82-4af7-871b-4e7b5e9ee16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:58.554455 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed971e-3f82-4af7-871b-4e7b5e9ee16b admin admin] PATH_INFO: `/v3/users/ed93c46a5e794e70ba5f33eee2f6a735` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:58.555707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed971e-3f82-4af7-871b-4e7b5e9ee16b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed93c46a5e794e70ba5f33eee2f6a735)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:58.557630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed971e-3f82-4af7-871b-4e7b5e9ee16b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:58.599205 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:58.605024 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f8ed971e-3f82-4af7-871b-4e7b5e9ee16b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed93c46a5e794e70ba5f33eee2f6a735'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:58.605941 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f8ed971e-3f82-4af7-871b-4e7b5e9ee16b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed93c46a5e794e70ba5f33eee2f6a735'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:58.614886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f8ed971e-3f82-4af7-871b-4e7b5e9ee16b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed93c46a5e794e70ba5f33eee2f6a735'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:58.626672 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f8ed971e-3f82-4af7-871b-4e7b5e9ee16b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed93c46a5e794e70ba5f33eee2f6a735'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:58.627293 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f8ed971e-3f82-4af7-871b-4e7b5e9ee16b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed93c46a5e794e70ba5f33eee2f6a735'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:58.639907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1432/2880] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:34:58 2022] DELETE /identity/v3/users/ed93c46a5e794e70ba5f33eee2f6a735 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:58.906604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0308e-89f5-449a-ac4e-819e54ec9917 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:58.908077 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8fb0308e-89f5-449a-ac4e-819e54ec9917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:58.921671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0308e-89f5-449a-ac4e-819e54ec9917 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:58.978244 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd969589-069e-4fc4-be5d-b846baae2ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:58.978889 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd969589-069e-4fc4-be5d-b846baae2ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:58.979172 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd969589-069e-4fc4-be5d-b846baae2ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:58.979450 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd969589-069e-4fc4-be5d-b846baae2ff3 admin admin] PATH_INFO: `/v3/projects/d739b2b0d53b4f67a8346ba1df3537f7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:58.980557 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd969589-069e-4fc4-be5d-b846baae2ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d739b2b0d53b4f67a8346ba1df3537f7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:58.982442 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd969589-069e-4fc4-be5d-b846baae2ff3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:58.998848 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:59.030498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bd969589-069e-4fc4-be5d-b846baae2ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd739b2b0d53b4f67a8346ba1df3537f7', 'request_id': 'req-bd969589-069e-4fc4-be5d-b846baae2ff3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:59.038146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bd969589-069e-4fc4-be5d-b846baae2ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd739b2b0d53b4f67a8346ba1df3537f7', 'request_id': 'req-bd969589-069e-4fc4-be5d-b846baae2ff3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:59.044472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bd969589-069e-4fc4-be5d-b846baae2ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd739b2b0d53b4f67a8346ba1df3537f7', 'request_id': 'req-bd969589-069e-4fc4-be5d-b846baae2ff3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:59.055863 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bd969589-069e-4fc4-be5d-b846baae2ff3 admin admin] The token cache is being invalidate because project d739b2b0d53b4f67a8346ba1df3537f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:34:59.056152 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bd969589-069e-4fc4-be5d-b846baae2ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:59.056783 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bd969589-069e-4fc4-be5d-b846baae2ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:34:59.058310 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1449/2881] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:34:58 2022] DELETE /identity/v3/projects/d739b2b0d53b4f67a8346ba1df3537f7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:59.063130 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410c698-f394-479b-ac3b-b9539715ae30 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:59.063497 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410c698-f394-479b-ac3b-b9539715ae30 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:59.063776 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410c698-f394-479b-ac3b-b9539715ae30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:59.084411 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a410c698-f394-479b-ac3b-b9539715ae30 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:34:59.085600 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a410c698-f394-479b-ac3b-b9539715ae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:59.145701 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1433/2882] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:34:59.155403 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd82b8-2e71-4f48-bec4-4cf24960ca06 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:59.155698 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd82b8-2e71-4f48-bec4-4cf24960ca06 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:59.156191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd82b8-2e71-4f48-bec4-4cf24960ca06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:59.175954 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c9dd82b8-2e71-4f48-bec4-4cf24960ca06 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:34:59.177159 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c9dd82b8-2e71-4f48-bec4-4cf24960ca06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:59.185019 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1450/2883] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:34:59.189250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410c698-f394-479b-ac3b-b9539715ae30 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:59.200008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410c698-f394-479b-ac3b-b9539715ae30 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:59.204586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad4ece-c8dd-4fcf-8528-cfaceb314269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:59.205183 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad4ece-c8dd-4fcf-8528-cfaceb314269 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:59.205466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad4ece-c8dd-4fcf-8528-cfaceb314269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:59.206327 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad4ece-c8dd-4fcf-8528-cfaceb314269 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:59.207039 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad4ece-c8dd-4fcf-8528-cfaceb314269 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:34:59.207378 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad4ece-c8dd-4fcf-8528-cfaceb314269 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:59.208983 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad4ece-c8dd-4fcf-8528-cfaceb314269 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:59.220922 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1434/2884] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:34:59.225472 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd82b8-2e71-4f48-bec4-4cf24960ca06 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:59.234592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd82b8-2e71-4f48-bec4-4cf24960ca06 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:59.239328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468856f-cc6a-4dd8-89bc-db9855704495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:59.239925 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468856f-cc6a-4dd8-89bc-db9855704495 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:59.240204 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468856f-cc6a-4dd8-89bc-db9855704495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:59.240476 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468856f-cc6a-4dd8-89bc-db9855704495 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:59.241112 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468856f-cc6a-4dd8-89bc-db9855704495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:59.243086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468856f-cc6a-4dd8-89bc-db9855704495 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:59.271716 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1451/2885] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:34:59 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:34:59.275902 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad4ece-c8dd-4fcf-8528-cfaceb314269 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:59.285884 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad4ece-c8dd-4fcf-8528-cfaceb314269 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:59.341568 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fd816-b190-4d05-b3d8-3123d8b3dee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:59.342166 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fd816-b190-4d05-b3d8-3123d8b3dee0 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:59.342442 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fd816-b190-4d05-b3d8-3123d8b3dee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:59.342711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fd816-b190-4d05-b3d8-3123d8b3dee0 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:59.343367 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fd816-b190-4d05-b3d8-3123d8b3dee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:59.345517 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fd816-b190-4d05-b3d8-3123d8b3dee0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:59.366512 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1435/2886] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:34:59 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:34:59.370529 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468856f-cc6a-4dd8-89bc-db9855704495 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:59.382180 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468856f-cc6a-4dd8-89bc-db9855704495 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:59.386759 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c45ad7-955c-4b7a-9fe8-7bdef79ee90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:59.387377 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c45ad7-955c-4b7a-9fe8-7bdef79ee90f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:59.387653 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c45ad7-955c-4b7a-9fe8-7bdef79ee90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:59.387920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c45ad7-955c-4b7a-9fe8-7bdef79ee90f admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:59.388562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c45ad7-955c-4b7a-9fe8-7bdef79ee90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:59.390183 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c45ad7-955c-4b7a-9fe8-7bdef79ee90f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:59.400990 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1452/2887] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:34:59.404907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fd816-b190-4d05-b3d8-3123d8b3dee0 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:59.415720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fd816-b190-4d05-b3d8-3123d8b3dee0 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:59.420385 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e38fb3-ba4f-4d8c-b6e7-23a51c988fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:59.420984 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e38fb3-ba4f-4d8c-b6e7-23a51c988fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:59.421262 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e38fb3-ba4f-4d8c-b6e7-23a51c988fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:59.421534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e38fb3-ba4f-4d8c-b6e7-23a51c988fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:59.422167 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e38fb3-ba4f-4d8c-b6e7-23a51c988fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:59.423799 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e38fb3-ba4f-4d8c-b6e7-23a51c988fc0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:59.435452 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1436/2888] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:34:59.439515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c45ad7-955c-4b7a-9fe8-7bdef79ee90f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:59.450113 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c45ad7-955c-4b7a-9fe8-7bdef79ee90f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:59.454611 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63bf75-e84d-4add-9097-3e0342b51b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:59.455275 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63bf75-e84d-4add-9097-3e0342b51b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:59.455552 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63bf75-e84d-4add-9097-3e0342b51b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:59.455970 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63bf75-e84d-4add-9097-3e0342b51b41 admin admin] PATH_INFO: `/v3/projects/a57352207d464656a46c1af1e2e1e0df/users/09ebf9cfa9614773949d54d9119c1284/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:59.470424 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63bf75-e84d-4add-9097-3e0342b51b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57352207d464656a46c1af1e2e1e0df, user_id=09ebf9cfa9614773949d54d9119c1284, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:59.473432 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63bf75-e84d-4add-9097-3e0342b51b41 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:59.486124 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1453/2889] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:34:59 2022] PUT /identity/v3/projects/a57352207d464656a46c1af1e2e1e0df/users/09ebf9cfa9614773949d54d9119c1284/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:34:59.497066 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d864a-105e-4860-95b4-e518dc624984 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:59.497562 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d864a-105e-4860-95b4-e518dc624984 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:59.497696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d864a-105e-4860-95b4-e518dc624984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:59.525481 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ef0d864a-105e-4860-95b4-e518dc624984 None None] MFA Rules not processed for user `09ebf9cfa9614773949d54d9119c1284`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:34:59.526700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ef0d864a-105e-4860-95b4-e518dc624984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:34:59.538639 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:59.592762 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1437/2890] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:34:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:34:59.597912 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63bf75-e84d-4add-9097-3e0342b51b41 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:59.658534 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63bf75-e84d-4add-9097-3e0342b51b41 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:59.663162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094b45b-9583-4f0b-862f-4e57239be115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:59.663757 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094b45b-9583-4f0b-862f-4e57239be115 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:59.664035 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094b45b-9583-4f0b-862f-4e57239be115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:59.664306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094b45b-9583-4f0b-862f-4e57239be115 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:59.664938 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094b45b-9583-4f0b-862f-4e57239be115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:59.666895 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094b45b-9583-4f0b-862f-4e57239be115 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:59.693699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1454/2891] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:34:59 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:34:59.697759 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d864a-105e-4860-95b4-e518dc624984 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:59.708353 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d864a-105e-4860-95b4-e518dc624984 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:59.764320 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a5a05-2c16-4273-9460-99d79e737e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:59.764914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5a05-2c16-4273-9460-99d79e737e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:59.765188 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5a05-2c16-4273-9460-99d79e737e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:59.765457 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5a05-2c16-4273-9460-99d79e737e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:59.766158 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a5a05-2c16-4273-9460-99d79e737e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:59.768303 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a5a05-2c16-4273-9460-99d79e737e67 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:59.789554 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1438/2892] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:34:59 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:34:59.793460 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094b45b-9583-4f0b-862f-4e57239be115 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:59.804578 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094b45b-9583-4f0b-862f-4e57239be115 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:59.809192 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cf269-05dc-4e2b-be23-ed0b72905fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:59.809788 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cf269-05dc-4e2b-be23-ed0b72905fff admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:59.810069 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cf269-05dc-4e2b-be23-ed0b72905fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:59.810345 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cf269-05dc-4e2b-be23-ed0b72905fff admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:59.810983 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cf269-05dc-4e2b-be23-ed0b72905fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:59.812620 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cf269-05dc-4e2b-be23-ed0b72905fff admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:59.823037 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1455/2893] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:34:59.827026 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a5a05-2c16-4273-9460-99d79e737e67 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:59.837076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a5a05-2c16-4273-9460-99d79e737e67 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:59.841673 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f6b3f-fc0a-411f-9632-ebd7c482ac68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:59.842311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6b3f-fc0a-411f-9632-ebd7c482ac68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:59.842589 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6b3f-fc0a-411f-9632-ebd7c482ac68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:59.842864 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6b3f-fc0a-411f-9632-ebd7c482ac68 admin admin] PATH_INFO: `/v3/projects/4fbb05a7363a4bad944bd3da05e4ff3e/users/e234cb6ab3ea4ee3b614eac194cb4165/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:59.857992 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f6b3f-fc0a-411f-9632-ebd7c482ac68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbb05a7363a4bad944bd3da05e4ff3e, user_id=e234cb6ab3ea4ee3b614eac194cb4165, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:59.860721 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f6b3f-fc0a-411f-9632-ebd7c482ac68 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:59.873677 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1439/2894] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:34:59 2022] PUT /identity/v3/projects/4fbb05a7363a4bad944bd3da05e4ff3e/users/e234cb6ab3ea4ee3b614eac194cb4165/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:34:59.877629 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cf269-05dc-4e2b-be23-ed0b72905fff admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:59.887449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cf269-05dc-4e2b-be23-ed0b72905fff admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:59.898844 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:34:59.947571 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d926adf-be31-4da4-b2d5-a8c7ec581951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:59.948093 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d926adf-be31-4da4-b2d5-a8c7ec581951 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:59.948392 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d926adf-be31-4da4-b2d5-a8c7ec581951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:59.948662 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d926adf-be31-4da4-b2d5-a8c7ec581951 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:59.949294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d926adf-be31-4da4-b2d5-a8c7ec581951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:59.950877 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d926adf-be31-4da4-b2d5-a8c7ec581951 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:59.960678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1456/2895] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:34:59.965048 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f6b3f-fc0a-411f-9632-ebd7c482ac68 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:34:59.976009 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f6b3f-fc0a-411f-9632-ebd7c482ac68 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:34:59.980605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab096ef8-ce83-46c1-877e-7c3b7601d426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:34:59.981250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab096ef8-ce83-46c1-877e-7c3b7601d426 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:34:59.981529 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab096ef8-ce83-46c1-877e-7c3b7601d426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:34:59.981802 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab096ef8-ce83-46c1-877e-7c3b7601d426 admin admin] PATH_INFO: `/v3/projects/4fbb05a7363a4bad944bd3da05e4ff3e/users/e234cb6ab3ea4ee3b614eac194cb4165/roles/3799feb4caa64e568971222375957f54` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:34:59.983719 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab096ef8-ce83-46c1-877e-7c3b7601d426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbb05a7363a4bad944bd3da05e4ff3e, user_id=e234cb6ab3ea4ee3b614eac194cb4165, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:34:59.986345 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab096ef8-ce83-46c1-877e-7c3b7601d426 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:34:59.997041 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1440/2896] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:34:59 2022] PUT /identity/v3/projects/4fbb05a7363a4bad944bd3da05e4ff3e/users/e234cb6ab3ea4ee3b614eac194cb4165/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:35:00.007044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e56fd-97b8-46ad-bb87-a7c455f58ab7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:00.007546 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e56fd-97b8-46ad-bb87-a7c455f58ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:00.007667 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e56fd-97b8-46ad-bb87-a7c455f58ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:00.035263 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-823e56fd-97b8-46ad-bb87-a7c455f58ab7 None None] MFA Rules not processed for user `e234cb6ab3ea4ee3b614eac194cb4165`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:00.036459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-823e56fd-97b8-46ad-bb87-a7c455f58ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:00.102987 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1457/2897] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:35:00.114696 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab096ef8-ce83-46c1-877e-7c3b7601d426 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:00.116449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ab096ef8-ce83-46c1-877e-7c3b7601d426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:00.173233 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab096ef8-ce83-46c1-877e-7c3b7601d426 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:00.177034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbc5e7-479a-497d-b589-e2490dad310c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:00.177630 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbc5e7-479a-497d-b589-e2490dad310c service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:00.177906 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbc5e7-479a-497d-b589-e2490dad310c service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:00.178179 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbc5e7-479a-497d-b589-e2490dad310c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:00.187190 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbc5e7-479a-497d-b589-e2490dad310c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:00.188605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbc5e7-479a-497d-b589-e2490dad310c service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:00.198008 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1441/2898] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:35:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:35:00.734973 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e56fd-97b8-46ad-bb87-a7c455f58ab7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:00.796594 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e56fd-97b8-46ad-bb87-a7c455f58ab7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:00.801406 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff793462-ce91-44f4-8792-a5971a063249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:00.802060 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff793462-ce91-44f4-8792-a5971a063249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:00.802339 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff793462-ce91-44f4-8792-a5971a063249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:00.802612 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff793462-ce91-44f4-8792-a5971a063249 admin admin] PATH_INFO: `/v3/users/09ebf9cfa9614773949d54d9119c1284` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:00.803773 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff793462-ce91-44f4-8792-a5971a063249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09ebf9cfa9614773949d54d9119c1284)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:00.805705 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff793462-ce91-44f4-8792-a5971a063249 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:00.845062 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:00.851664 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff793462-ce91-44f4-8792-a5971a063249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ebf9cfa9614773949d54d9119c1284'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:00.852562 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff793462-ce91-44f4-8792-a5971a063249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ebf9cfa9614773949d54d9119c1284'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:00.859445 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff793462-ce91-44f4-8792-a5971a063249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ebf9cfa9614773949d54d9119c1284'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:00.871179 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff793462-ce91-44f4-8792-a5971a063249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ebf9cfa9614773949d54d9119c1284'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:00.871815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ff793462-ce91-44f4-8792-a5971a063249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ebf9cfa9614773949d54d9119c1284'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:00.884564 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1458/2899] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:35:00 2022] DELETE /identity/v3/users/09ebf9cfa9614773949d54d9119c1284 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:35:00.889590 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd6674-11e3-4974-800b-b51b4efb4ee4 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:00.890076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd6674-11e3-4974-800b-b51b4efb4ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:00.890178 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd6674-11e3-4974-800b-b51b4efb4ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:00.909375 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ddcd6674-11e3-4974-800b-b51b4efb4ee4 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:00.910587 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ddcd6674-11e3-4974-800b-b51b4efb4ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:00.914506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:00.971765 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1442/2900] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:35:00.981161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff793462-ce91-44f4-8792-a5971a063249 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:00.982582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ff793462-ce91-44f4-8792-a5971a063249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:01.041268 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff793462-ce91-44f4-8792-a5971a063249 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:01.044901 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81187d36-28f2-4b0a-b7d5-00d933a58f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:01.045498 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81187d36-28f2-4b0a-b7d5-00d933a58f01 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:01.045773 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81187d36-28f2-4b0a-b7d5-00d933a58f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:01.046044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81187d36-28f2-4b0a-b7d5-00d933a58f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:01.055850 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81187d36-28f2-4b0a-b7d5-00d933a58f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:01.057270 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81187d36-28f2-4b0a-b7d5-00d933a58f01 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:01.067388 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1459/2901] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:35:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:35:01.331574 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd6674-11e3-4974-800b-b51b4efb4ee4 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:01.333037 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ddcd6674-11e3-4974-800b-b51b4efb4ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:01.345225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd6674-11e3-4974-800b-b51b4efb4ee4 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:01.349884 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a9d18-194d-4049-a1c1-d00877c365aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:01.350513 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a9d18-194d-4049-a1c1-d00877c365aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:01.350789 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a9d18-194d-4049-a1c1-d00877c365aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:01.351078 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a9d18-194d-4049-a1c1-d00877c365aa admin admin] PATH_INFO: `/v3/projects/a57352207d464656a46c1af1e2e1e0df` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:01.352228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a9d18-194d-4049-a1c1-d00877c365aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a57352207d464656a46c1af1e2e1e0df)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:01.354093 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a9d18-194d-4049-a1c1-d00877c365aa admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:01.402331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-430a9d18-194d-4049-a1c1-d00877c365aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a57352207d464656a46c1af1e2e1e0df', 'request_id': 'req-430a9d18-194d-4049-a1c1-d00877c365aa'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:01.408408 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-430a9d18-194d-4049-a1c1-d00877c365aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a57352207d464656a46c1af1e2e1e0df', 'request_id': 'req-430a9d18-194d-4049-a1c1-d00877c365aa'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:01.413964 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-430a9d18-194d-4049-a1c1-d00877c365aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a57352207d464656a46c1af1e2e1e0df', 'request_id': 'req-430a9d18-194d-4049-a1c1-d00877c365aa'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:01.428250 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-430a9d18-194d-4049-a1c1-d00877c365aa admin admin] The token cache is being invalidate because project a57352207d464656a46c1af1e2e1e0df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:35:01.428542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-430a9d18-194d-4049-a1c1-d00877c365aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:01.429165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-430a9d18-194d-4049-a1c1-d00877c365aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:01.431458 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1443/2902] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:35:01 2022] DELETE /identity/v3/projects/a57352207d464656a46c1af1e2e1e0df => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:35:01.435427 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81187d36-28f2-4b0a-b7d5-00d933a58f01 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:01.446610 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81187d36-28f2-4b0a-b7d5-00d933a58f01 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:01.504348 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6037703-c0c9-4762-a477-b0d62fa27e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:01.505005 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6037703-c0c9-4762-a477-b0d62fa27e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:01.505255 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6037703-c0c9-4762-a477-b0d62fa27e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:01.505530 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6037703-c0c9-4762-a477-b0d62fa27e1e admin admin] PATH_INFO: `/v3/users/e234cb6ab3ea4ee3b614eac194cb4165` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:01.506697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6037703-c0c9-4762-a477-b0d62fa27e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e234cb6ab3ea4ee3b614eac194cb4165)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:01.508611 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6037703-c0c9-4762-a477-b0d62fa27e1e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:01.553010 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6037703-c0c9-4762-a477-b0d62fa27e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e234cb6ab3ea4ee3b614eac194cb4165'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:01.553671 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6037703-c0c9-4762-a477-b0d62fa27e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e234cb6ab3ea4ee3b614eac194cb4165'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:01.560473 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6037703-c0c9-4762-a477-b0d62fa27e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e234cb6ab3ea4ee3b614eac194cb4165'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:01.564801 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:01.573786 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6037703-c0c9-4762-a477-b0d62fa27e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e234cb6ab3ea4ee3b614eac194cb4165'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:01.574544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6037703-c0c9-4762-a477-b0d62fa27e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e234cb6ab3ea4ee3b614eac194cb4165'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:01.588145 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1460/2903] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:35:01 2022] DELETE /identity/v3/users/e234cb6ab3ea4ee3b614eac194cb4165 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:35:01.855047 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a9d18-194d-4049-a1c1-d00877c365aa admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:01.856489 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-430a9d18-194d-4049-a1c1-d00877c365aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:01.870023 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a9d18-194d-4049-a1c1-d00877c365aa admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:01.928923 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdef97f-3595-436c-bbe4-b1b06e216953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:01.929586 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdef97f-3595-436c-bbe4-b1b06e216953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:01.929809 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdef97f-3595-436c-bbe4-b1b06e216953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:01.930078 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdef97f-3595-436c-bbe4-b1b06e216953 admin admin] PATH_INFO: `/v3/projects/4fbb05a7363a4bad944bd3da05e4ff3e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:01.931218 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdef97f-3595-436c-bbe4-b1b06e216953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fbb05a7363a4bad944bd3da05e4ff3e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:01.933105 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdef97f-3595-436c-bbe4-b1b06e216953 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:01.969005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:01.980688 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9bdef97f-3595-436c-bbe4-b1b06e216953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fbb05a7363a4bad944bd3da05e4ff3e', 'request_id': 'req-9bdef97f-3595-436c-bbe4-b1b06e216953'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:01.986658 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9bdef97f-3595-436c-bbe4-b1b06e216953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fbb05a7363a4bad944bd3da05e4ff3e', 'request_id': 'req-9bdef97f-3595-436c-bbe4-b1b06e216953'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:01.992978 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9bdef97f-3595-436c-bbe4-b1b06e216953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fbb05a7363a4bad944bd3da05e4ff3e', 'request_id': 'req-9bdef97f-3595-436c-bbe4-b1b06e216953'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:02.005313 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9bdef97f-3595-436c-bbe4-b1b06e216953 admin admin] The token cache is being invalidate because project 4fbb05a7363a4bad944bd3da05e4ff3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:35:02.005605 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9bdef97f-3595-436c-bbe4-b1b06e216953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:02.006249 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9bdef97f-3595-436c-bbe4-b1b06e216953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:02.007822 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1444/2904] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:35:01 2022] DELETE /identity/v3/projects/4fbb05a7363a4bad944bd3da05e4ff3e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:35:02.012691 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724f87e-1f29-423e-9f1d-3e7f95d197b6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:02.012985 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724f87e-1f29-423e-9f1d-3e7f95d197b6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:02.013295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724f87e-1f29-423e-9f1d-3e7f95d197b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:02.032673 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b724f87e-1f29-423e-9f1d-3e7f95d197b6 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:02.034343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b724f87e-1f29-423e-9f1d-3e7f95d197b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:02.091495 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1461/2905] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 01:35:02.154842 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75b550-7878-41ce-9227-466df06db3c4 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:02.155161 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75b550-7878-41ce-9227-466df06db3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:02.155437 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75b550-7878-41ce-9227-466df06db3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:02.176580 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ce75b550-7878-41ce-9227-466df06db3c4 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:02.177774 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ce75b550-7878-41ce-9227-466df06db3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:02.185514 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1445/2906] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:35:02.189627 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724f87e-1f29-423e-9f1d-3e7f95d197b6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:02.199465 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724f87e-1f29-423e-9f1d-3e7f95d197b6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:02.204214 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfbdc3-88ce-46d6-b372-6653f48c9e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:02.204810 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfbdc3-88ce-46d6-b372-6653f48c9e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:02.205089 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfbdc3-88ce-46d6-b372-6653f48c9e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:02.205360 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfbdc3-88ce-46d6-b372-6653f48c9e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:02.206312 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfbdc3-88ce-46d6-b372-6653f48c9e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:35:02.206615 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfbdc3-88ce-46d6-b372-6653f48c9e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:02.208238 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfbdc3-88ce-46d6-b372-6653f48c9e15 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:02.220159 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1462/2907] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 01:35:02.224877 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75b550-7878-41ce-9227-466df06db3c4 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:02.233785 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75b550-7878-41ce-9227-466df06db3c4 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:02.239260 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285fe67-02d1-4577-977e-416fef0fe7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:02.239849 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285fe67-02d1-4577-977e-416fef0fe7cf admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:02.240122 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285fe67-02d1-4577-977e-416fef0fe7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:02.240392 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285fe67-02d1-4577-977e-416fef0fe7cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:02.241015 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285fe67-02d1-4577-977e-416fef0fe7cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:02.242896 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285fe67-02d1-4577-977e-416fef0fe7cf admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:02.269665 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1446/2908] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:35:02 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:35:02.273688 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfbdc3-88ce-46d6-b372-6653f48c9e15 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:02.284191 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfbdc3-88ce-46d6-b372-6653f48c9e15 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:02.339187 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68cd29-a882-4442-b715-c20a63874a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:02.339791 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68cd29-a882-4442-b715-c20a63874a4a admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:02.340072 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68cd29-a882-4442-b715-c20a63874a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:02.340347 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68cd29-a882-4442-b715-c20a63874a4a admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:02.340981 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68cd29-a882-4442-b715-c20a63874a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:02.342889 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68cd29-a882-4442-b715-c20a63874a4a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:02.365157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1463/2909] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:35:02 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:35:02.369292 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285fe67-02d1-4577-977e-416fef0fe7cf admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:02.379534 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285fe67-02d1-4577-977e-416fef0fe7cf admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:02.384397 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208ae24-4c0f-4d4d-94a8-5cea9f34dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:02.385005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208ae24-4c0f-4d4d-94a8-5cea9f34dc56 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:02.385285 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208ae24-4c0f-4d4d-94a8-5cea9f34dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:02.385560 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208ae24-4c0f-4d4d-94a8-5cea9f34dc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:02.386215 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208ae24-4c0f-4d4d-94a8-5cea9f34dc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:02.387904 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208ae24-4c0f-4d4d-94a8-5cea9f34dc56 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:02.398825 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1447/2910] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:35:02.402704 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68cd29-a882-4442-b715-c20a63874a4a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:02.413387 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68cd29-a882-4442-b715-c20a63874a4a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:02.418344 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb90a3-b133-4f27-8dd7-c90c18094194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:02.418969 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb90a3-b133-4f27-8dd7-c90c18094194 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:02.419410 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb90a3-b133-4f27-8dd7-c90c18094194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:02.420100 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb90a3-b133-4f27-8dd7-c90c18094194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:02.420319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb90a3-b133-4f27-8dd7-c90c18094194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:02.421894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb90a3-b133-4f27-8dd7-c90c18094194 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:02.432971 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1464/2911] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:35:02.437126 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208ae24-4c0f-4d4d-94a8-5cea9f34dc56 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:02.446814 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208ae24-4c0f-4d4d-94a8-5cea9f34dc56 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:02.451398 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea09384-38fb-46bd-b810-35a8f2de6f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:02.452034 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea09384-38fb-46bd-b810-35a8f2de6f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:02.452311 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea09384-38fb-46bd-b810-35a8f2de6f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:02.452583 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea09384-38fb-46bd-b810-35a8f2de6f2c admin admin] PATH_INFO: `/v3/projects/bb8e5b90e6bc4feabd5408e0a2a24f69/users/32230276276c4cc996063ee6a63aad9f/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:02.468169 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea09384-38fb-46bd-b810-35a8f2de6f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8e5b90e6bc4feabd5408e0a2a24f69, user_id=32230276276c4cc996063ee6a63aad9f, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:02.471038 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea09384-38fb-46bd-b810-35a8f2de6f2c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:02.484738 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1448/2912] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:35:02 2022] PUT /identity/v3/projects/bb8e5b90e6bc4feabd5408e0a2a24f69/users/32230276276c4cc996063ee6a63aad9f/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:35:02.489888 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6f50f-166a-421f-9b33-8d2bd26f2d2f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:02.490229 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6f50f-166a-421f-9b33-8d2bd26f2d2f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:02.490683 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6f50f-166a-421f-9b33-8d2bd26f2d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:02.510108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-49f6f50f-166a-421f-9b33-8d2bd26f2d2f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:02.511343 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-49f6f50f-166a-421f-9b33-8d2bd26f2d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:02.551319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:02.571468 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1465/2913] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:35:02.581713 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea09384-38fb-46bd-b810-35a8f2de6f2c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:02.583494 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1ea09384-38fb-46bd-b810-35a8f2de6f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:02.639940 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea09384-38fb-46bd-b810-35a8f2de6f2c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:02.644204 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8befe-1e78-4377-ab47-bfa24b5b8ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:02.644808 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8befe-1e78-4377-ab47-bfa24b5b8ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:02.645085 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8befe-1e78-4377-ab47-bfa24b5b8ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:02.645352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8befe-1e78-4377-ab47-bfa24b5b8ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:02.654176 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8befe-1e78-4377-ab47-bfa24b5b8ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:02.655642 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8befe-1e78-4377-ab47-bfa24b5b8ea3 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:02.665619 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1449/2914] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:35:03.298186 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac21b9a-7b7f-47fe-bd5f-e3d4f4bfa012 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:03.298784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac21b9a-7b7f-47fe-bd5f-e3d4f4bfa012 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:03.298899 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac21b9a-7b7f-47fe-bd5f-e3d4f4bfa012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:03.327722 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cac21b9a-7b7f-47fe-bd5f-e3d4f4bfa012 None None] MFA Rules not processed for user `32230276276c4cc996063ee6a63aad9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:03.328858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cac21b9a-7b7f-47fe-bd5f-e3d4f4bfa012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:03.397917 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1466/2915] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:35:03.402448 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8befe-1e78-4377-ab47-bfa24b5b8ea3 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:03.412239 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8befe-1e78-4377-ab47-bfa24b5b8ea3 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:03.417157 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e507403-95c2-49e0-8306-236d02e75742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:03.417771 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e507403-95c2-49e0-8306-236d02e75742 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:03.418053 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e507403-95c2-49e0-8306-236d02e75742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:03.418330 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e507403-95c2-49e0-8306-236d02e75742 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:03.419705 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e507403-95c2-49e0-8306-236d02e75742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:03.421621 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e507403-95c2-49e0-8306-236d02e75742 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:03.450149 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1450/2916] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:35:03 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:35:03.454220 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac21b9a-7b7f-47fe-bd5f-e3d4f4bfa012 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:03.464936 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac21b9a-7b7f-47fe-bd5f-e3d4f4bfa012 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:03.522500 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb985a1-dd55-4e41-b0f7-e37bc52e1fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:03.523146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb985a1-dd55-4e41-b0f7-e37bc52e1fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:03.523433 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb985a1-dd55-4e41-b0f7-e37bc52e1fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:03.523729 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb985a1-dd55-4e41-b0f7-e37bc52e1fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:03.524342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb985a1-dd55-4e41-b0f7-e37bc52e1fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:03.526331 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb985a1-dd55-4e41-b0f7-e37bc52e1fe3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:03.551011 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1467/2917] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:35:03 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:35:03.555023 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e507403-95c2-49e0-8306-236d02e75742 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:03.565427 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e507403-95c2-49e0-8306-236d02e75742 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:03.569962 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f72bd4-5e69-4ed3-8fe4-5c0276d2a320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:03.570563 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f72bd4-5e69-4ed3-8fe4-5c0276d2a320 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:03.570848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f72bd4-5e69-4ed3-8fe4-5c0276d2a320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:03.571159 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f72bd4-5e69-4ed3-8fe4-5c0276d2a320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:03.571800 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f72bd4-5e69-4ed3-8fe4-5c0276d2a320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:03.573394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f72bd4-5e69-4ed3-8fe4-5c0276d2a320 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:03.584096 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1451/2918] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:35:03.588110 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb985a1-dd55-4e41-b0f7-e37bc52e1fe3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:03.598720 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb985a1-dd55-4e41-b0f7-e37bc52e1fe3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:03.603294 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40bed1-926e-4408-b99b-ff02b2fd755e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:03.603937 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40bed1-926e-4408-b99b-ff02b2fd755e admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:03.604216 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40bed1-926e-4408-b99b-ff02b2fd755e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:03.604490 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40bed1-926e-4408-b99b-ff02b2fd755e admin admin] PATH_INFO: `/v3/projects/7bbb81d4dba5426e926e4007e704dd49/users/d95d527b09d344259b9f2a4e028d4720/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:03.619780 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40bed1-926e-4408-b99b-ff02b2fd755e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bbb81d4dba5426e926e4007e704dd49, user_id=d95d527b09d344259b9f2a4e028d4720, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:03.622434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40bed1-926e-4408-b99b-ff02b2fd755e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:03.635594 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1468/2919] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:35:03 2022] PUT /identity/v3/projects/7bbb81d4dba5426e926e4007e704dd49/users/d95d527b09d344259b9f2a4e028d4720/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:35:03.639543 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f72bd4-5e69-4ed3-8fe4-5c0276d2a320 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:03.649938 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f72bd4-5e69-4ed3-8fe4-5c0276d2a320 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:03.674961 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:03.709203 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6808b6-7ec5-4575-95d9-e0ef605f35fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:03.709815 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6808b6-7ec5-4575-95d9-e0ef605f35fe admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:03.710099 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6808b6-7ec5-4575-95d9-e0ef605f35fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:03.710377 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6808b6-7ec5-4575-95d9-e0ef605f35fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:03.711016 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6808b6-7ec5-4575-95d9-e0ef605f35fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:03.712640 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6808b6-7ec5-4575-95d9-e0ef605f35fe admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:03.722705 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1452/2920] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:35:03.727108 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40bed1-926e-4408-b99b-ff02b2fd755e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:03.737176 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40bed1-926e-4408-b99b-ff02b2fd755e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:03.741672 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21194ec1-a13c-415e-abaf-06b7fe5ab921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:03.742313 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21194ec1-a13c-415e-abaf-06b7fe5ab921 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:03.742587 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21194ec1-a13c-415e-abaf-06b7fe5ab921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:03.742857 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21194ec1-a13c-415e-abaf-06b7fe5ab921 admin admin] PATH_INFO: `/v3/projects/7bbb81d4dba5426e926e4007e704dd49/users/d95d527b09d344259b9f2a4e028d4720/roles/3799feb4caa64e568971222375957f54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:03.744836 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21194ec1-a13c-415e-abaf-06b7fe5ab921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bbb81d4dba5426e926e4007e704dd49, user_id=d95d527b09d344259b9f2a4e028d4720, role_id=3799feb4caa64e568971222375957f54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:03.747446 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21194ec1-a13c-415e-abaf-06b7fe5ab921 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:03.758157 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1469/2921] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:35:03 2022] PUT /identity/v3/projects/7bbb81d4dba5426e926e4007e704dd49/users/d95d527b09d344259b9f2a4e028d4720/roles/3799feb4caa64e568971222375957f54 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:35:04.374811 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b85c5-6ded-4792-9415-0cd202f9acfa None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:04.375133 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b85c5-6ded-4792-9415-0cd202f9acfa None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:04.375441 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b85c5-6ded-4792-9415-0cd202f9acfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:04.404779 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-570b85c5-6ded-4792-9415-0cd202f9acfa None None] MFA Rules not processed for user `d95d527b09d344259b9f2a4e028d4720`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:04.405955 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-570b85c5-6ded-4792-9415-0cd202f9acfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:04.479282 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1453/2922] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:35:04.490073 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2cd95-1bb7-4892-823b-fa0bea6afa36 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:04.490596 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2cd95-1bb7-4892-823b-fa0bea6afa36 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:04.490699 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2cd95-1bb7-4892-823b-fa0bea6afa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:04.510665 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fcd2cd95-1bb7-4892-823b-fa0bea6afa36 None None] MFA Rules not processed for user `32230276276c4cc996063ee6a63aad9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:04.511924 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fcd2cd95-1bb7-4892-823b-fa0bea6afa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:04.532099 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:04.570959 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1470/2923] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:35:04.583718 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b85c5-6ded-4792-9415-0cd202f9acfa None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:04.585232 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-570b85c5-6ded-4792-9415-0cd202f9acfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:04.659230 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b85c5-6ded-4792-9415-0cd202f9acfa None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:04.664796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e039a-7b90-4fbb-92b2-34e0a7dfd34e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadc83bec6be41979e1aa4d71f8fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:04.665402 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e039a-7b90-4fbb-92b2-34e0a7dfd34e service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:04.665684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e039a-7b90-4fbb-92b2-34e0a7dfd34e service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:04.665959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e039a-7b90-4fbb-92b2-34e0a7dfd34e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:04.673744 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e039a-7b90-4fbb-92b2-34e0a7dfd34e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:04.675502 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e039a-7b90-4fbb-92b2-34e0a7dfd34e service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:04.684509 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1454/2924] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:35:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:35:06.976918 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2cd95-1bb7-4892-823b-fa0bea6afa36 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:06.978359 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fcd2cd95-1bb7-4892-823b-fa0bea6afa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:07.033952 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2cd95-1bb7-4892-823b-fa0bea6afa36 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:07.037456 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f1e83-bf95-4ed7-8837-39775bf9740f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:07.038171 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f1e83-bf95-4ed7-8837-39775bf9740f service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:07.038449 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f1e83-bf95-4ed7-8837-39775bf9740f service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:07.038731 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f1e83-bf95-4ed7-8837-39775bf9740f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:07.040447 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-261f1e83-bf95-4ed7-8837-39775bf9740f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:07.050085 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f1e83-bf95-4ed7-8837-39775bf9740f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:07.051522 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f1e83-bf95-4ed7-8837-39775bf9740f service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:07.059342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1471/2925] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:35:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:35:14.680317 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=84 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:17.056245 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=39 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:18.737094 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e039a-7b90-4fbb-92b2-34e0a7dfd34e service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:18.738524 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e51e039a-7b90-4fbb-92b2-34e0a7dfd34e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:18.795151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e039a-7b90-4fbb-92b2-34e0a7dfd34e service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:18.798700 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9eff7c-000e-4ee3-b52d-11490345f2d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:18.799449 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9eff7c-000e-4ee3-b52d-11490345f2d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:18.799702 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9eff7c-000e-4ee3-b52d-11490345f2d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:18.799970 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9eff7c-000e-4ee3-b52d-11490345f2d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:18.812657 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9eff7c-000e-4ee3-b52d-11490345f2d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:18.814077 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9eff7c-000e-4ee3-b52d-11490345f2d3 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:18.824103 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1455/2926] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:35:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:35:28.819937 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=26 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:38.352295 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f1e83-bf95-4ed7-8837-39775bf9740f service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:38.353903 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-261f1e83-bf95-4ed7-8837-39775bf9740f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:38.418684 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9eff7c-000e-4ee3-b52d-11490345f2d3 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:38.435582 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f1e83-bf95-4ed7-8837-39775bf9740f service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:38.442459 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbdefd-ce2c-4da8-9e8e-bcacb19a8718 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c5e6dae854a44a0ad6628e7dd69dfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:38.443098 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbdefd-ce2c-4da8-9e8e-bcacb19a8718 service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:38.443407 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbdefd-ce2c-4da8-9e8e-bcacb19a8718 service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:38.443677 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbdefd-ce2c-4da8-9e8e-bcacb19a8718 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:38.445410 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4bfbdefd-ce2c-4da8-9e8e-bcacb19a8718 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:38.458399 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbdefd-ce2c-4da8-9e8e-bcacb19a8718 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:38.458945 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbdefd-ce2c-4da8-9e8e-bcacb19a8718 service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:38.468872 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1472/2927] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:35:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:35:38.493542 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9eff7c-000e-4ee3-b52d-11490345f2d3 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:38.498172 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a00f2b-6a2e-40af-ac59-cb63877659e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:38.498796 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a00f2b-6a2e-40af-ac59-cb63877659e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:38.499165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a00f2b-6a2e-40af-ac59-cb63877659e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:38.499367 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a00f2b-6a2e-40af-ac59-cb63877659e3 admin admin] PATH_INFO: `/v3/users/32230276276c4cc996063ee6a63aad9f` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:38.500486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a00f2b-6a2e-40af-ac59-cb63877659e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32230276276c4cc996063ee6a63aad9f)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:38.502396 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a00f2b-6a2e-40af-ac59-cb63877659e3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:38.548836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c7a00f2b-6a2e-40af-ac59-cb63877659e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32230276276c4cc996063ee6a63aad9f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:38.550076 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c7a00f2b-6a2e-40af-ac59-cb63877659e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32230276276c4cc996063ee6a63aad9f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:38.558145 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c7a00f2b-6a2e-40af-ac59-cb63877659e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32230276276c4cc996063ee6a63aad9f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:38.571122 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c7a00f2b-6a2e-40af-ac59-cb63877659e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32230276276c4cc996063ee6a63aad9f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:38.571798 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c7a00f2b-6a2e-40af-ac59-cb63877659e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32230276276c4cc996063ee6a63aad9f'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:38.585697 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1456/2928] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:35:38 2022] DELETE /identity/v3/users/32230276276c4cc996063ee6a63aad9f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:35:38.759727 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbdefd-ce2c-4da8-9e8e-bcacb19a8718 service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:38.771771 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbdefd-ce2c-4da8-9e8e-bcacb19a8718 service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:38.833467 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a4305-ae75-422f-afbe-26f0df84f98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:38.834028 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a4305-ae75-422f-afbe-26f0df84f98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:38.834337 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a4305-ae75-422f-afbe-26f0df84f98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:38.834608 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a4305-ae75-422f-afbe-26f0df84f98a admin admin] PATH_INFO: `/v3/projects/bb8e5b90e6bc4feabd5408e0a2a24f69` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:38.835740 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a4305-ae75-422f-afbe-26f0df84f98a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb8e5b90e6bc4feabd5408e0a2a24f69)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:38.837634 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a4305-ae75-422f-afbe-26f0df84f98a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:38.884992 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b70a4305-ae75-422f-afbe-26f0df84f98a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb8e5b90e6bc4feabd5408e0a2a24f69', 'request_id': 'req-b70a4305-ae75-422f-afbe-26f0df84f98a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:38.892189 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b70a4305-ae75-422f-afbe-26f0df84f98a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb8e5b90e6bc4feabd5408e0a2a24f69', 'request_id': 'req-b70a4305-ae75-422f-afbe-26f0df84f98a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:38.898496 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b70a4305-ae75-422f-afbe-26f0df84f98a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb8e5b90e6bc4feabd5408e0a2a24f69', 'request_id': 'req-b70a4305-ae75-422f-afbe-26f0df84f98a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:38.908687 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b70a4305-ae75-422f-afbe-26f0df84f98a admin admin] The token cache is being invalidate because project bb8e5b90e6bc4feabd5408e0a2a24f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:35:38.909485 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b70a4305-ae75-422f-afbe-26f0df84f98a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:38.910205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b70a4305-ae75-422f-afbe-26f0df84f98a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:38.911702 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1473/2929] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:35:38 2022] DELETE /identity/v3/projects/bb8e5b90e6bc4feabd5408e0a2a24f69 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:35:38.915792 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a00f2b-6a2e-40af-ac59-cb63877659e3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:38.917240 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c7a00f2b-6a2e-40af-ac59-cb63877659e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:38.930894 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a00f2b-6a2e-40af-ac59-cb63877659e3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:38.986853 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73e6f6-b59d-4e47-89db-9ae12eaf0c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:38.988225 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73e6f6-b59d-4e47-89db-9ae12eaf0c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:38.988506 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73e6f6-b59d-4e47-89db-9ae12eaf0c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:38.988783 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73e6f6-b59d-4e47-89db-9ae12eaf0c58 admin admin] PATH_INFO: `/v3/users/d95d527b09d344259b9f2a4e028d4720` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:38.989924 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73e6f6-b59d-4e47-89db-9ae12eaf0c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95d527b09d344259b9f2a4e028d4720)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:38.991886 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73e6f6-b59d-4e47-89db-9ae12eaf0c58 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:39.013222 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:39.039522 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1e73e6f6-b59d-4e47-89db-9ae12eaf0c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95d527b09d344259b9f2a4e028d4720'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:39.040165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1e73e6f6-b59d-4e47-89db-9ae12eaf0c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95d527b09d344259b9f2a4e028d4720'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:39.046990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1e73e6f6-b59d-4e47-89db-9ae12eaf0c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95d527b09d344259b9f2a4e028d4720'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:39.059394 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1e73e6f6-b59d-4e47-89db-9ae12eaf0c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95d527b09d344259b9f2a4e028d4720'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:39.060036 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1e73e6f6-b59d-4e47-89db-9ae12eaf0c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95d527b09d344259b9f2a4e028d4720'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:39.073111 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1457/2930] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:35:38 2022] DELETE /identity/v3/users/d95d527b09d344259b9f2a4e028d4720 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:35:39.246358 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a4305-ae75-422f-afbe-26f0df84f98a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:39.247964 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b70a4305-ae75-422f-afbe-26f0df84f98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:39.262091 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a4305-ae75-422f-afbe-26f0df84f98a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:39.279162 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:39.322291 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37074617-9f93-4b10-8df4-809f8eaf837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:39.322918 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37074617-9f93-4b10-8df4-809f8eaf837b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:39.323240 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37074617-9f93-4b10-8df4-809f8eaf837b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:39.323514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37074617-9f93-4b10-8df4-809f8eaf837b admin admin] PATH_INFO: `/v3/projects/7bbb81d4dba5426e926e4007e704dd49` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:39.324625 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37074617-9f93-4b10-8df4-809f8eaf837b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bbb81d4dba5426e926e4007e704dd49)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:39.326505 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37074617-9f93-4b10-8df4-809f8eaf837b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:39.372743 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-37074617-9f93-4b10-8df4-809f8eaf837b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bbb81d4dba5426e926e4007e704dd49', 'request_id': 'req-37074617-9f93-4b10-8df4-809f8eaf837b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:39.380327 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-37074617-9f93-4b10-8df4-809f8eaf837b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bbb81d4dba5426e926e4007e704dd49', 'request_id': 'req-37074617-9f93-4b10-8df4-809f8eaf837b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:39.386513 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-37074617-9f93-4b10-8df4-809f8eaf837b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bbb81d4dba5426e926e4007e704dd49', 'request_id': 'req-37074617-9f93-4b10-8df4-809f8eaf837b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:39.397143 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-37074617-9f93-4b10-8df4-809f8eaf837b admin admin] The token cache is being invalidate because project 7bbb81d4dba5426e926e4007e704dd49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:35:39.397435 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-37074617-9f93-4b10-8df4-809f8eaf837b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:39.398068 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-37074617-9f93-4b10-8df4-809f8eaf837b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:39.399584 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1474/2931] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:35:39 2022] DELETE /identity/v3/projects/7bbb81d4dba5426e926e4007e704dd49 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:35:39.404440 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e607f2-78c9-42a1-b1c0-8591b6198981 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:39.404728 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e607f2-78c9-42a1-b1c0-8591b6198981 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:39.405025 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e607f2-78c9-42a1-b1c0-8591b6198981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:39.426878 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-75e607f2-78c9-42a1-b1c0-8591b6198981 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:39.428115 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-75e607f2-78c9-42a1-b1c0-8591b6198981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:39.486816 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1458/2932] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:35:39.496150 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1fb81-b16a-41df-a416-207c2e6b1c51 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:39.496435 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1fb81-b16a-41df-a416-207c2e6b1c51 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:39.496713 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1fb81-b16a-41df-a416-207c2e6b1c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:39.516618 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b5b1fb81-b16a-41df-a416-207c2e6b1c51 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:39.517815 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b5b1fb81-b16a-41df-a416-207c2e6b1c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:39.526050 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1475/2933] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:35:39.530151 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e607f2-78c9-42a1-b1c0-8591b6198981 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:39.540310 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e607f2-78c9-42a1-b1c0-8591b6198981 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:39.544836 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e9d49-c776-4328-b1d9-f36c744ccd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:39.545429 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e9d49-c776-4328-b1d9-f36c744ccd1a admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:39.545706 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e9d49-c776-4328-b1d9-f36c744ccd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:39.545976 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e9d49-c776-4328-b1d9-f36c744ccd1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:39.546615 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e9d49-c776-4328-b1d9-f36c744ccd1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:35:39.546913 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e9d49-c776-4328-b1d9-f36c744ccd1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:39.548547 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e9d49-c776-4328-b1d9-f36c744ccd1a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:39.560632 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1459/2934] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:35:39.564795 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1fb81-b16a-41df-a416-207c2e6b1c51 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:39.574487 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1fb81-b16a-41df-a416-207c2e6b1c51 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:39.579158 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df1715-bd72-421c-b2eb-17ea6a76f1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:39.579755 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df1715-bd72-421c-b2eb-17ea6a76f1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:39.580033 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df1715-bd72-421c-b2eb-17ea6a76f1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:39.580304 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df1715-bd72-421c-b2eb-17ea6a76f1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:39.580997 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df1715-bd72-421c-b2eb-17ea6a76f1b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:39.582881 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df1715-bd72-421c-b2eb-17ea6a76f1b7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:39.610213 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1476/2935] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:35:39 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 01:35:39.614947 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e9d49-c776-4328-b1d9-f36c744ccd1a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:39.624804 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e9d49-c776-4328-b1d9-f36c744ccd1a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:39.680907 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8f175-96dd-4964-b439-14586c98ad3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:39.681507 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8f175-96dd-4964-b439-14586c98ad3c admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:39.681786 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8f175-96dd-4964-b439-14586c98ad3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:39.682060 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8f175-96dd-4964-b439-14586c98ad3c admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:39.682694 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8f175-96dd-4964-b439-14586c98ad3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:39.684690 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8f175-96dd-4964-b439-14586c98ad3c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:39.705430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1460/2936] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:35:39 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:35:39.709928 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df1715-bd72-421c-b2eb-17ea6a76f1b7 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:39.720188 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df1715-bd72-421c-b2eb-17ea6a76f1b7 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:39.725678 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf06998-f39c-4174-bfff-8814ad7df565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:39.726268 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf06998-f39c-4174-bfff-8814ad7df565 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:39.726545 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf06998-f39c-4174-bfff-8814ad7df565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:39.726814 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf06998-f39c-4174-bfff-8814ad7df565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:39.727492 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf06998-f39c-4174-bfff-8814ad7df565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:39.729093 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf06998-f39c-4174-bfff-8814ad7df565 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:39.740059 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1477/2937] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:35:39.743900 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8f175-96dd-4964-b439-14586c98ad3c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:39.753739 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8f175-96dd-4964-b439-14586c98ad3c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:39.758238 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887266c-8121-433e-a19e-9bc98e5a35e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:39.758824 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887266c-8121-433e-a19e-9bc98e5a35e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:39.759166 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887266c-8121-433e-a19e-9bc98e5a35e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:39.759438 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887266c-8121-433e-a19e-9bc98e5a35e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:39.760061 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887266c-8121-433e-a19e-9bc98e5a35e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:39.761628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887266c-8121-433e-a19e-9bc98e5a35e3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:39.772321 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1461/2938] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:35:39.776239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf06998-f39c-4174-bfff-8814ad7df565 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:39.786836 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf06998-f39c-4174-bfff-8814ad7df565 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:39.791394 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb3036-5222-4a29-911b-4dbfca329501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:39.792034 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb3036-5222-4a29-911b-4dbfca329501 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:39.792307 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb3036-5222-4a29-911b-4dbfca329501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:39.792604 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb3036-5222-4a29-911b-4dbfca329501 admin admin] PATH_INFO: `/v3/projects/770ed7aa9b454f6ea3f4475d4d83dba3/users/85c329e8e7154d8cb5eccbef96ad2e79/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:39.807558 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb3036-5222-4a29-911b-4dbfca329501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=770ed7aa9b454f6ea3f4475d4d83dba3, user_id=85c329e8e7154d8cb5eccbef96ad2e79, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:39.810161 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb3036-5222-4a29-911b-4dbfca329501 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:39.822434 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1478/2939] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:35:39 2022] PUT /identity/v3/projects/770ed7aa9b454f6ea3f4475d4d83dba3/users/85c329e8e7154d8cb5eccbef96ad2e79/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:35:39.832678 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8f86a-5d38-4ef1-ac46-966ab8f0b92a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:39.832991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8f86a-5d38-4ef1-ac46-966ab8f0b92a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:39.833335 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8f86a-5d38-4ef1-ac46-966ab8f0b92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:39.841555 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:39.861998 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bae8f86a-5d38-4ef1-ac46-966ab8f0b92a None None] MFA Rules not processed for user `85c329e8e7154d8cb5eccbef96ad2e79`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:39.863769 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bae8f86a-5d38-4ef1-ac46-966ab8f0b92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:39.926986 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1462/2940] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:35:39.937870 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb3036-5222-4a29-911b-4dbfca329501 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:39.939617 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-20eb3036-5222-4a29-911b-4dbfca329501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:39.991572 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:39.998364 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb3036-5222-4a29-911b-4dbfca329501 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:40.003086 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc42d28-663c-4de6-83ad-980f950564f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:40.003787 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc42d28-663c-4de6-83ad-980f950564f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:40.004068 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc42d28-663c-4de6-83ad-980f950564f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:40.004342 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc42d28-663c-4de6-83ad-980f950564f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:40.012784 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc42d28-663c-4de6-83ad-980f950564f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:40.014205 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc42d28-663c-4de6-83ad-980f950564f0 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:40.023819 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1479/2941] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:35:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:35:40.045722 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8f86a-5d38-4ef1-ac46-966ab8f0b92a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:40.107454 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8f86a-5d38-4ef1-ac46-966ab8f0b92a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:40.112005 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e29e7-5904-45eb-9fd3-a074d92e558f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:40.112632 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e29e7-5904-45eb-9fd3-a074d92e558f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:40.112914 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e29e7-5904-45eb-9fd3-a074d92e558f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:40.113189 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e29e7-5904-45eb-9fd3-a074d92e558f admin admin] PATH_INFO: `/v3/users/85c329e8e7154d8cb5eccbef96ad2e79` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:40.114324 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e29e7-5904-45eb-9fd3-a074d92e558f admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c329e8e7154d8cb5eccbef96ad2e79)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:40.116276 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e29e7-5904-45eb-9fd3-a074d92e558f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:40.163681 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-031e29e7-5904-45eb-9fd3-a074d92e558f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c329e8e7154d8cb5eccbef96ad2e79'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:40.164344 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-031e29e7-5904-45eb-9fd3-a074d92e558f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c329e8e7154d8cb5eccbef96ad2e79'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:40.171144 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-031e29e7-5904-45eb-9fd3-a074d92e558f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c329e8e7154d8cb5eccbef96ad2e79'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:40.183118 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-031e29e7-5904-45eb-9fd3-a074d92e558f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c329e8e7154d8cb5eccbef96ad2e79'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:40.183715 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-031e29e7-5904-45eb-9fd3-a074d92e558f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c329e8e7154d8cb5eccbef96ad2e79'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:40.196958 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1463/2942] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:35:40 2022] DELETE /identity/v3/users/85c329e8e7154d8cb5eccbef96ad2e79 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 01:35:40.201494 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309909-aa42-44bf-b309-cac4aa90d58b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:40.201864 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309909-aa42-44bf-b309-cac4aa90d58b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:40.202146 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309909-aa42-44bf-b309-cac4aa90d58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:40.224802 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d3309909-aa42-44bf-b309-cac4aa90d58b None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:40.226013 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d3309909-aa42-44bf-b309-cac4aa90d58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:40.283420 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1480/2943] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:35:40.293349 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e29e7-5904-45eb-9fd3-a074d92e558f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:40.294741 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-031e29e7-5904-45eb-9fd3-a074d92e558f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:40.308944 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:40.354122 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e29e7-5904-45eb-9fd3-a074d92e558f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:40.357707 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56caf77-00d9-4832-84bd-cc8ef59d10f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:40.358302 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56caf77-00d9-4832-84bd-cc8ef59d10f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:40.358582 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56caf77-00d9-4832-84bd-cc8ef59d10f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:40.358848 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56caf77-00d9-4832-84bd-cc8ef59d10f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:40.368186 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56caf77-00d9-4832-84bd-cc8ef59d10f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:40.369601 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56caf77-00d9-4832-84bd-cc8ef59d10f5 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:40.379730 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1464/2944] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:35:40.650474 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3309909-aa42-44bf-b309-cac4aa90d58b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:40.652021 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d3309909-aa42-44bf-b309-cac4aa90d58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:40.664044 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3309909-aa42-44bf-b309-cac4aa90d58b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:40.669259 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbfc41-e241-4dc9-9798-724266cb0144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:40.669899 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbfc41-e241-4dc9-9798-724266cb0144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:40.670242 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbfc41-e241-4dc9-9798-724266cb0144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:40.670515 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbfc41-e241-4dc9-9798-724266cb0144 admin admin] PATH_INFO: `/v3/projects/770ed7aa9b454f6ea3f4475d4d83dba3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:40.671697 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbfc41-e241-4dc9-9798-724266cb0144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=770ed7aa9b454f6ea3f4475d4d83dba3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:40.673597 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbfc41-e241-4dc9-9798-724266cb0144 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:40.723884 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b2dbfc41-e241-4dc9-9798-724266cb0144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '770ed7aa9b454f6ea3f4475d4d83dba3', 'request_id': 'req-b2dbfc41-e241-4dc9-9798-724266cb0144'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:40.732117 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b2dbfc41-e241-4dc9-9798-724266cb0144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '770ed7aa9b454f6ea3f4475d4d83dba3', 'request_id': 'req-b2dbfc41-e241-4dc9-9798-724266cb0144'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:40.738920 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b2dbfc41-e241-4dc9-9798-724266cb0144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '770ed7aa9b454f6ea3f4475d4d83dba3', 'request_id': 'req-b2dbfc41-e241-4dc9-9798-724266cb0144'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:40.749269 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b2dbfc41-e241-4dc9-9798-724266cb0144 admin admin] The token cache is being invalidate because project 770ed7aa9b454f6ea3f4475d4d83dba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:35:40.749559 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b2dbfc41-e241-4dc9-9798-724266cb0144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:40.750194 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b2dbfc41-e241-4dc9-9798-724266cb0144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:40.751709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1481/2945] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:35:40 2022] DELETE /identity/v3/projects/770ed7aa9b454f6ea3f4475d4d83dba3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:35:40.757162 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30939a1-a912-4c50-9e22-cedafd9fe979 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:40.757624 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30939a1-a912-4c50-9e22-cedafd9fe979 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:40.757720 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30939a1-a912-4c50-9e22-cedafd9fe979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:40.777045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e30939a1-a912-4c50-9e22-cedafd9fe979 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:40.778243 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e30939a1-a912-4c50-9e22-cedafd9fe979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:40.836950 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1465/2946] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:35:40.845694 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32294c-783d-4cdd-b283-cc2c6188ab89 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:40.845982 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32294c-783d-4cdd-b283-cc2c6188ab89 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:40.846259 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32294c-783d-4cdd-b283-cc2c6188ab89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:40.873000 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0f32294c-783d-4cdd-b283-cc2c6188ab89 None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:40.874219 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0f32294c-783d-4cdd-b283-cc2c6188ab89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:40.882319 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1482/2947] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:35:40.886556 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30939a1-a912-4c50-9e22-cedafd9fe979 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:40.896916 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30939a1-a912-4c50-9e22-cedafd9fe979 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:40.901454 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819bf2a-98ca-41a0-995d-73fceb15ad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:40.902052 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819bf2a-98ca-41a0-995d-73fceb15ad1f admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:40.902331 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819bf2a-98ca-41a0-995d-73fceb15ad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:40.902606 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819bf2a-98ca-41a0-995d-73fceb15ad1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:40.903288 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819bf2a-98ca-41a0-995d-73fceb15ad1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 01:35:40.903595 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819bf2a-98ca-41a0-995d-73fceb15ad1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:40.905193 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819bf2a-98ca-41a0-995d-73fceb15ad1f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:40.917352 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1466/2948] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 13 01:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 01:35:40.921592 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32294c-783d-4cdd-b283-cc2c6188ab89 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:40.930820 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32294c-783d-4cdd-b283-cc2c6188ab89 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:40.935735 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8176482-58ea-43ba-8ff0-3b399b552e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:40.936336 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8176482-58ea-43ba-8ff0-3b399b552e5c admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:40.936613 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8176482-58ea-43ba-8ff0-3b399b552e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:40.936884 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8176482-58ea-43ba-8ff0-3b399b552e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:40.937514 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8176482-58ea-43ba-8ff0-3b399b552e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:40.939482 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8176482-58ea-43ba-8ff0-3b399b552e5c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:40.966236 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1483/2949] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 13 01:35:40 2022] POST /identity/v3/projects => generated 359 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:35:40.970870 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819bf2a-98ca-41a0-995d-73fceb15ad1f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:40.981516 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819bf2a-98ca-41a0-995d-73fceb15ad1f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:41.037929 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8858-f3a8-4d17-ab44-29f3505afaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:41.038686 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8858-f3a8-4d17-ab44-29f3505afaa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:41.038975 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8858-f3a8-4d17-ab44-29f3505afaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:41.039287 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8858-f3a8-4d17-ab44-29f3505afaa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:41.039946 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab8858-f3a8-4d17-ab44-29f3505afaa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:41.041854 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab8858-f3a8-4d17-ab44-29f3505afaa0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:41.065421 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1467/2950] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 13 01:35:40 2022] POST /identity/v3/users => generated 280 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 01:35:41.069512 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8176482-58ea-43ba-8ff0-3b399b552e5c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:41.079523 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8176482-58ea-43ba-8ff0-3b399b552e5c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:41.084306 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc7ca3-9675-402f-a73a-e4baf492d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:41.084894 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc7ca3-9675-402f-a73a-e4baf492d937 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:41.085170 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc7ca3-9675-402f-a73a-e4baf492d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:41.085438 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc7ca3-9675-402f-a73a-e4baf492d937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:41.086072 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc7ca3-9675-402f-a73a-e4baf492d937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:41.087677 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc7ca3-9675-402f-a73a-e4baf492d937 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:41.098508 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1484/2951] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:35:41.102604 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8858-f3a8-4d17-ab44-29f3505afaa0 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:41.113758 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8858-f3a8-4d17-ab44-29f3505afaa0 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:41.118403 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f896e6-d2c0-470d-a255-5e1858a129d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:41.119004 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f896e6-d2c0-470d-a255-5e1858a129d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:41.119316 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f896e6-d2c0-470d-a255-5e1858a129d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:41.119592 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f896e6-d2c0-470d-a255-5e1858a129d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:41.120228 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f896e6-d2c0-470d-a255-5e1858a129d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:41.121823 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f896e6-d2c0-470d-a255-5e1858a129d4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:41.133959 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1468/2952] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 13 01:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 01:35:41.138239 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc7ca3-9675-402f-a73a-e4baf492d937 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:41.148995 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc7ca3-9675-402f-a73a-e4baf492d937 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:41.153709 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cd2bc-7dba-4023-b5a3-d29f9ff4a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:41.154374 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cd2bc-7dba-4023-b5a3-d29f9ff4a598 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:41.154649 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cd2bc-7dba-4023-b5a3-d29f9ff4a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:41.154919 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cd2bc-7dba-4023-b5a3-d29f9ff4a598 admin admin] PATH_INFO: `/v3/projects/dc9e20996ca94414832671e7180df757/users/f6fc8baeb0bf492e800156c705eef779/roles/6ce9c4ba7196458380036520a04c9404` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:41.169435 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cd2bc-7dba-4023-b5a3-d29f9ff4a598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc9e20996ca94414832671e7180df757, user_id=f6fc8baeb0bf492e800156c705eef779, role_id=6ce9c4ba7196458380036520a04c9404)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:41.172075 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cd2bc-7dba-4023-b5a3-d29f9ff4a598 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:41.184423 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1485/2953] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 13 01:35:41 2022] PUT /identity/v3/projects/dc9e20996ca94414832671e7180df757/users/f6fc8baeb0bf492e800156c705eef779/roles/6ce9c4ba7196458380036520a04c9404 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:35:41.196017 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5486588-fac2-4661-b103-ed437a769ee7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:41.196307 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5486588-fac2-4661-b103-ed437a769ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:41.196612 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5486588-fac2-4661-b103-ed437a769ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:41.225308 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a5486588-fac2-4661-b103-ed437a769ee7 None None] MFA Rules not processed for user `f6fc8baeb0bf492e800156c705eef779`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:41.226511 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a5486588-fac2-4661-b103-ed437a769ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:41.235757 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:41.292711 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1469/2954] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:35:41.328728 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cd2bc-7dba-4023-b5a3-d29f9ff4a598 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:41.330391 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4d1cd2bc-7dba-4023-b5a3-d29f9ff4a598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:41.342102 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:41.397544 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cd2bc-7dba-4023-b5a3-d29f9ff4a598 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:41.401131 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0f7a1-85e2-4a80-a376-861c0ffe06b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff33b1a82c4c42f6ab4a0588d5b616db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:41.401732 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0f7a1-85e2-4a80-a376-861c0ffe06b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:41.402010 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0f7a1-85e2-4a80-a376-861c0ffe06b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:41.402282 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0f7a1-85e2-4a80-a376-861c0ffe06b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:41.410400 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0f7a1-85e2-4a80-a376-861c0ffe06b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:41.411847 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0f7a1-85e2-4a80-a376-861c0ffe06b5 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:41.422528 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1486/2955] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:35:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:35:41.440993 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5486588-fac2-4661-b103-ed437a769ee7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:41.504032 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5486588-fac2-4661-b103-ed437a769ee7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:41.508518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33296bb-ea48-4b23-83aa-4d768bca3ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:41.509139 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33296bb-ea48-4b23-83aa-4d768bca3ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:41.509413 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33296bb-ea48-4b23-83aa-4d768bca3ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:41.509680 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33296bb-ea48-4b23-83aa-4d768bca3ac4 admin admin] PATH_INFO: `/v3/users/f6fc8baeb0bf492e800156c705eef779` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:41.510808 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33296bb-ea48-4b23-83aa-4d768bca3ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6fc8baeb0bf492e800156c705eef779)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:41.512722 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33296bb-ea48-4b23-83aa-4d768bca3ac4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:41.558466 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c33296bb-ea48-4b23-83aa-4d768bca3ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6fc8baeb0bf492e800156c705eef779'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:41.559045 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c33296bb-ea48-4b23-83aa-4d768bca3ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6fc8baeb0bf492e800156c705eef779'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:41.566628 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c33296bb-ea48-4b23-83aa-4d768bca3ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6fc8baeb0bf492e800156c705eef779'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:41.578430 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c33296bb-ea48-4b23-83aa-4d768bca3ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6fc8baeb0bf492e800156c705eef779'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:41.579086 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c33296bb-ea48-4b23-83aa-4d768bca3ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6fc8baeb0bf492e800156c705eef779'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:41.592518 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1470/2956] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 13 01:35:41 2022] DELETE /identity/v3/users/f6fc8baeb0bf492e800156c705eef779 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:35:41.597328 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf1c31-e8b4-43a1-a1af-5ef951c37e6f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:41.597623 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf1c31-e8b4-43a1-a1af-5ef951c37e6f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:41.597890 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf1c31-e8b4-43a1-a1af-5ef951c37e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:41.617160 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-50cf1c31-e8b4-43a1-a1af-5ef951c37e6f None None] MFA Rules not processed for user `5c63bf57b4e7408d9fa4e45538832485`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 01:35:41.618378 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-50cf1c31-e8b4-43a1-a1af-5ef951c37e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:41.677939 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1487/2957] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 13 01:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 01:35:41.687576 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33296bb-ea48-4b23-83aa-4d768bca3ac4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:41.688990 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c33296bb-ea48-4b23-83aa-4d768bca3ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:41.723766 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:41.748526 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33296bb-ea48-4b23-83aa-4d768bca3ac4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:41.752117 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e46073-85ad-4a66-a5f4-f44512a4e934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a672e63fa5e345679bac3d67301fe875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:41.753304 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e46073-85ad-4a66-a5f4-f44512a4e934 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:41.753577 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e46073-85ad-4a66-a5f4-f44512a4e934 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:41.753841 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e46073-85ad-4a66-a5f4-f44512a4e934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:41.762679 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e46073-85ad-4a66-a5f4-f44512a4e934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:41.764165 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e46073-85ad-4a66-a5f4-f44512a4e934 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:41.773486 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1471/2958] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:35:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:35:42.047512 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf1c31-e8b4-43a1-a1af-5ef951c37e6f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:35:42.048978 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-50cf1c31-e8b4-43a1-a1af-5ef951c37e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:35:42.061568 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf1c31-e8b4-43a1-a1af-5ef951c37e6f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:35:42.066117 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fc8eb-ba83-41d8-9f69-69b317730279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c63bf57b4e7408d9fa4e45538832485', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd4174dd77554b79ab1278edaa747365', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:35:42.066751 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fc8eb-ba83-41d8-9f69-69b317730279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:35:42.067031 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fc8eb-ba83-41d8-9f69-69b317730279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:35:42.067414 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fc8eb-ba83-41d8-9f69-69b317730279 admin admin] PATH_INFO: `/v3/projects/dc9e20996ca94414832671e7180df757` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:35:42.068816 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fc8eb-ba83-41d8-9f69-69b317730279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc9e20996ca94414832671e7180df757)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:35:42.070724 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fc8eb-ba83-41d8-9f69-69b317730279 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:35:42.119022 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-960fc8eb-ba83-41d8-9f69-69b317730279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc9e20996ca94414832671e7180df757', 'request_id': 'req-960fc8eb-ba83-41d8-9f69-69b317730279'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:42.126470 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-960fc8eb-ba83-41d8-9f69-69b317730279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc9e20996ca94414832671e7180df757', 'request_id': 'req-960fc8eb-ba83-41d8-9f69-69b317730279'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:42.133858 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-960fc8eb-ba83-41d8-9f69-69b317730279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc9e20996ca94414832671e7180df757', 'request_id': 'req-960fc8eb-ba83-41d8-9f69-69b317730279'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:42.145511 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-960fc8eb-ba83-41d8-9f69-69b317730279 admin admin] The token cache is being invalidate because project dc9e20996ca94414832671e7180df757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 01:35:42.145800 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-960fc8eb-ba83-41d8-9f69-69b317730279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:42.146440 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-960fc8eb-ba83-41d8-9f69-69b317730279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 01:35:42.147955 dv-cinder-856941-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1488/2959] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 13 01:35:42 2022] DELETE /identity/v3/projects/dc9e20996ca94414832671e7180df757 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 01:35:51.769343 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=12 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:35:52.141909 dv-cinder-856941-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:38:09.655266 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e46073-85ad-4a66-a5f4-f44512a4e934 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 01:38:09.656807 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e6e46073-85ad-4a66-a5f4-f44512a4e934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:38:09.796206 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e46073-85ad-4a66-a5f4-f44512a4e934 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 01:38:09.854991 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f631a-f2bd-4781-9054-3e8712636534 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c5e6dae854a44a0ad6628e7dd69dfc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73ceb0a582452b9b636a701adafb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 01:38:09.855620 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f631a-f2bd-4781-9054-3e8712636534 service placement] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 01:38:09.855903 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f631a-f2bd-4781-9054-3e8712636534 service placement] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 01:38:09.856181 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f631a-f2bd-4781-9054-3e8712636534 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 01:38:09.857943 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7c5f631a-f2bd-4781-9054-3e8712636534 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 01:38:09.869763 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f631a-f2bd-4781-9054-3e8712636534 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 01:38:09.871564 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f631a-f2bd-4781-9054-3e8712636534 service placement] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 01:38:09.881631 dv-cinder-856941-3-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1472/2960] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 13 01:38:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 01:38:19.877265 dv-cinder-856941-3-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}